Visible and IR Data Fusion Technique Using the Contourlet Transform

In the last few years image fusion has gained considerable attention, where it can provide remarkable outputs for many image applications (\emph{i.e.}, detection of hidden objects). Images with different specifications (resolution, spectral, and spatial) can be fused to produce an output image that combines the best features of all input images. The quality of the output image varies based on the application. In this paper, a new region-based image fusion technique using the Contourlet Transform (CT) is proposed. The presented fusion approach combines the visual information from a visual colored image, and some information about the hidden objects from an IR image. The fused output image is better for human and machine interpretation, where it preserves the original chromaticity of the visual input image. The input images are segmented into small regions more suitable for the proposed algorithm. The segmentation process is performed in the frequency domain. The presented region-based fusion approach is more robust than the traditional pixel-based techniques, where it reduces: the blurring effects, sensitivity to the misregistration problem, and noise effects in the input images. Experimental results demonstrate the capability of the presented fusion technique in detecting hidden weapons and objects. Moreover, the algorithm preserves very high percentage of the input image's spectral components.

[1]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[2]  Jinwen Tian,et al.  Remote sensing image fusion based on average gradient of wavelet transform , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[3]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[4]  Rick S. Blum,et al.  A statistical signal processing approach to image fusion for concealed weapon detection , 2002, Proceedings. International Conference on Image Processing.

[5]  Alexander Toet,et al.  Uni-Modal Versus Joint Segmentation for Region-Based Image Fusion , 2006, 2006 9th International Conference on Information Fusion.

[6]  Rick S. Blum,et al.  Concealed weapon detection using color image fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[7]  D. D.-Y. Po,et al.  Directional multiscale modeling of images using the contourlet transform , 2006, IEEE Transactions on Image Processing.

[8]  Yulong Shen,et al.  Registration and fusion of retinal images-an evaluation study , 2003, IEEE Transactions on Medical Imaging.

[9]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[10]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[11]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[12]  P.K. Varshney,et al.  Imaging for concealed weapon detection: a tutorial overview of development in imaging sensors and processing , 2005, IEEE Signal Processing Magazine.