Analysis of Multiresolution-Based Fusion Strategies for a Dual Infrared System

A dual infrared system to assist a driver in bad visibility conditions is studied. The problem of selecting the best multiresolution-based image fusion technique is addressed with reference to automotive scenarios. A new method for objective evaluation of multisensor image fusion strategies is presented for the optimal design of the fusion process. Multiresolution-based fusion methodologies are compared, and experimental results obtained from a prototype dual infrared camera system are shown and analyzed. Numerical results, in terms of the quality of the fused images and of the computational load, are presented and discussed. The effectiveness of the dual infrared system in urban and extraurban automotive scenarios is illustrated with a number of examples.

[1]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[2]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[3]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[4]  Alberto Broggi,et al.  Vehicle and Guard Rail Detection Using Radar and Vision Data Fusion , 2007, IEEE Transactions on Intelligent Transportation Systems.

[5]  Vladimir Petrovic,et al.  Objective evaluation of signal-level image fusion performance , 2005 .

[6]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[7]  Vladimir S. Petrovic,et al.  Objective pixel-level image fusion performance measure , 2000, SPIE Defense + Commercial Sensing.

[8]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[9]  Alexander Toet,et al.  Perceptual evaluation of different nighttime imaging modalities , 2000, Proceedings of the Third International Conference on Information Fusion.

[10]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[11]  R.S. Blum,et al.  Experimental tests of image fusion for night vision , 2005, 2005 7th International Conference on Information Fusion.

[12]  Nanning Zheng,et al.  Interactive Road Situation Analysis for Driver Assistance and Safety Warning Systems: Framework and Algorithms , 2007, IEEE Transactions on Intelligent Transportation Systems.

[13]  Jacqueline Le Moigne.  Multi-Sensor Image Fusion and Its Applications , 2005 .

[14]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[15]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[18]  Ying Zhu,et al.  Reliable Detection of Overtaking Vehicles Using Robust Information Fusion , 2006, IEEE Transactions on Intelligent Transportation Systems.

[19]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[20]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  Alexander Toet,et al.  New false color mapping for image fusion , 1996 .

[22]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[23]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[24]  Ren C. Luo,et al.  Multisensor integration and fusion for intelligent machines and systems , 1995 .

[25]  Richard R. Brooks,et al.  Atmospheric attenuation reduction through multisensor fusion , 1998, Defense, Security, and Sensing.

[26]  Aurelio Piazzi,et al.  Visual perception of obstacles and vehicles for platooning , 2000, IEEE Trans. Intell. Transp. Syst..

[27]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[28]  Edward H. Adelson,et al.  Merging Images Through Pattern Decomposition , 1985, Optics & Photonics.

[29]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[30]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[31]  A. Willsky,et al.  A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing , 1997, Proc. IEEE.