Neural Network Model For Fusion Of Visible And Infrared Sensor Outputs

Pongsak Ajjimarangsee; Terrance L. Huntsberger

doi:10.1117/12.948926

5 January 1989 Neural Network Model For Fusion Of Visible And Infrared Sensor Outputs

Pongsak Ajjimarangsee, Terrance L. Huntsberger

Proceedings Volume 1003, Sensor Fusion: Spatial Reasoning and Scene Interpretation; (1989) https://doi.org/10.1117/12.948926
Event: 1988 Cambridge Symposium on Advances in Intelligent Robotics Systems, 1988, Boston, MA, United States

Abstract

Integration of outputs from multiple sensors has been the subject of much of the recent research in the machine vision field. This process is useful in a variety of applications, such as three dimensional interpretation of scenes imaged by multiple cameras, integration of visible and range data, and the fusion of multiple types of sensors. The use of multiple types of sensors for machine vision poses the problem of how to integrate the information from these sensors. This paper presents a neural network model for the fusion of visible and thermal infrared sensor outputs. Since there is no human biological system that can be used as a model for integration of these sensor outputs, alternate biological systems for sensory fusions can serve as starting points. In this paper, a model is developed based upon six types of bimodal neurons found in the optic tectum of the rattlesnake. These neurons integrate visible and thermal infrared sensory inputs. The neural network model has a series of layers which include a layer for unsupervised clustering in the form of self-organizing feature maps, followed by a layer which has multiple filters that are generated by training a neural net with experimental rattlesnake response data. The final layer performs another unsupervised clustering for integration of the output from the filter layer. The results of a number of experiments are also presented.

Citation Download Citation

Pongsak Ajjimarangsee and Terrance L. Huntsberger "Neural Network Model For Fusion Of Visible And Infrared Sensor Outputs", Proc. SPIE 1003, Sensor Fusion: Spatial Reasoning and Scene Interpretation, (5 January 1989); https://doi.org/10.1117/12.948926

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available