Fusion of multisensor passive and active 3D imagery

We have extended our previous capabilities for fusion of multiple passive imaging sensors to now include 3D imagery obtained from a prototype flash ladar. Real-time fusion of low-light visible + uncooled LWIR + 3D LADAR, and SWIR + LWIR + 3D LADAR is demonstrated. Fused visualization is achieved by opponent-color neural networks for passive image fusion, which is then textured upon segmented object surfaces derived from the 3D data. An interactive viewer, coded in Java3D, is used to examine the 3D fused scene in stereo. Interactive designation, learning, recognition and search for targets, based on fused passive + 3D signatures, is achieved using Fuzzy ARTMAP neural networks with a Java-coded GUI. A client-server web-based architecture enables remote users to interact with fused 3D imagery via a wireless palmtop computer.

[1]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[2]  Alexander Toet,et al.  New false color mapping for image fusion , 1996 .

[3]  D. M. Ryan,et al.  Night pilotage assessment of image fusion , 1995, Defense, Security, and Sensing.

[4]  Allen M. Waxman,et al.  Fusion of 2- /3- /4-sensor imagery for visualization, target learning, and search , 2000, Defense, Security, and Sensing.

[5]  Du-Ming Tsai,et al.  A fast thresholding selection procedure for multimodal and unimodal histograms , 1995, Pattern Recognit. Lett..

[6]  Martin Rutishauser,et al.  Merging range images of arbitrarily shaped objects , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Alexander Toet,et al.  Multiscale contrast enhancement with applications to image fusion , 1992 .

[8]  Allen M. Waxman,et al.  Real-time fusion of low-light CCD and uncooled IR imagery for color night vision , 1998, Defense, Security, and Sensing.

[9]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[10]  Peter H. Schiller,et al.  The ON and OFF channels of the visual system , 1992, Trends in Neurosciences.

[11]  Allen M. Waxman,et al.  Color Night Vision: Opponent Processing in the Fusion of Visible and IR Imagery , 1997, Neural Networks.

[12]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .