Multimodality image registration and fusion using neural network

Multi-modality image registration and fusion are essential steps in building 3D models from remote sensing data. In this paper, we present a neural network technique for the registration and fusion of multi-modality remote sensing data for the reconstruction of 3D models of terrain regions. A feedforward neural network is used to fuse the intensity data sets with the spatial data set after learning its geometry. Results on real data are presented. Human performance evaluation is assessed on several perceptual tests in order to evaluate the fusion results.

[1]  Forrest W. Young,et al.  Introduction to Multidimensional Scaling: Theory, Methods, and Applications , 1981 .

[2]  Aly A. Farag,et al.  A two-step fuzzy-Bayesian classification for high dimensional data , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Geoffrey E. Hinton,et al.  Learning representations of back-propagation errors , 1986 .

[4]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[5]  W. Eric L. Grimson,et al.  An implementation of a computational theory of visual surface interpolation , 1983, Comput. Vis. Graph. Image Process..

[6]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Richard Szeliski,et al.  Fast Surface Interpolation Using Hierarchical Basis Functions , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Aly A. Farag,et al.  Integrating shape from shading and range data using neural networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  Wallace M. Porter,et al.  The airborne visible/infrared imaging spectrometer (AVIRIS) , 1993 .

[10]  R. Kwok,et al.  Automated Multisensor Registration: Requirements And Techniques , 1990, 10th Annual International Symposium on Geoscience and Remote Sensing.

[11]  Sharad Singhal,et al.  Training feed-forward networks with the extended Kalman algorithm , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[12]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[13]  Jason S. McCarley,et al.  Perceptual Ability with Real-World Nighttime Scenes: Image-Intensified, Infrared, and Fused-Color Imagery , 1999, Hum. Factors.

[14]  D. Landgrebe.  The Evolution of Landsat Data Analysis , 1997 .

[15]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .