Multispectral image fusion for visual display

This paper describes a contrast-based monochromatic fusion process. The fusion process is aimed for on board real time the information content in the combined image, while retaining visual clues that are essential for navigation/piloting tasks. The method is a multi scale fusion process that provides a combination of pixel selection from a single image and a weighing of the two/multiple images. The spectral region is divided into spatial sub bands of different scales and orientations, and within each scale a combination rule for the corresponding pixels taken from the two components is applied. Even when the combination rule is a binary selection the combined fused image may have a combination of pixel values taken from the two components at various scales since it is taken at each scale. The visual band input is given preference in low scale, large features fusion. This fusion process provides a fused image better tuned to the natural and intuitive human perception. This is necessary for pilotage and navigation under stressful conditions, while maintaining or enhancing the targeting detection and recognition performance of proven display fusion methodologies. The fusion concept was demonstrated against imagery from image intensifiers and forward looking IR sensors currently used by the US Navy for navigation and targeting. The approach is easily extendible to more than two bands.

[1]  M. Georgeson.  Human vision combines oriented filters to compute edges , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[2]  Philip Perconti,et al.  Part task investigation of multispectral image fusion using gray scale and synthetic color night vision sensor imagery for helicopter pilotage , 1997 .

[3]  E. Peli.  In search of a contrast metric: Matching the perceived contrast of gabor patches at different phases and bandwidths , 1997, Vision Research.

[4]  D. Burr,et al.  Discrimination of spatial phase in central and peripheral vision , 1989, Vision Research.

[5]  Alexander Toet.  Multiscale color image enhancement , 1992, Pattern Recognit. Lett..

[6]  L. B. Stotts.  Clutter rejection using multi-spectral processing , 1990, Defense + Commercial Sensing.

[7]  H. Schmidt.  Problem-based learning: An introduction , 1994 .

[8]  S. Merriam,et al.  Learning in Adulthood: A Comprehensive Guide , 1991 .

[9]  M. Gur,et al.  Color enhances mach bands detection threshold and perceived brightness , 1993, Vision Research.

[10]  C. Bonwell,et al.  Active learning : creating excitement in the classroom , 1991 .

[11]  Eli Peli,et al.  Display nonlinearity in digital image processing for visual communications , 1991, Other Conferences.

[12]  James William Scrofani.  An adaptive method for the enhanced fusion of low-light visible and uncooled thermal infrared imagery , 1997 .

[13]  Alan N. Gove,et al.  Color night vision: fusion of intensified visible and thermal IR imagery , 1995, Defense, Security, and Sensing.

[14]  Albert J. Ahumada,et al.  Sensor fusion for synthetic vision , 1991 .

[15]  E. Peli.  Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[16]  Tamar Peli,et al.  Combining linear and nonlinear processes for multispectral material detection/identification , 1997, Defense, Security, and Sensing.

[17]  D. M. Ryan,et al.  Night pilotage assessment of image fusion , 1995, Defense, Security, and Sensing.

[18]  D. B. Strohmetz,et al.  The Use of Role-Play in Teaching Research Ethics: A Validation Study , 1992, Teaching of psychology.

[19]  Jae S. Lim,et al.  Adaptive filtering for image enhancement , 1981, ICASSP.