Multifocus Image Fusion Based on NSCT and Focused Area Detection

To overcome the difficulties of sub-band coefficients selection in multiscale transform domain-based image fusion and solve the problem of block effects suffered by spatial domain-based image fusion, this paper presents a novel hybrid multifocus image fusion method. First, the source multifocus images are decomposed using the nonsubsampled contourlet transform (NSCT). The low-frequency sub-band coefficients are fused by the sum-modified-Laplacian-based local visual contrast, whereas the high-frequency sub-band coefficients are fused by the local Log-Gabor energy. The initial fused image is subsequently reconstructed based on the inverse NSCT with the fused coefficients. Second, after analyzing the similarity between the previous fused image and the source images, the initial focus area detection map is obtained, which is used for achieving the decision map obtained by employing a mathematical morphology postprocessing technique. Finally, based on the decision map, the final fused image is obtained by selecting the pixels in the focus areas and retaining the pixels in the focus region boundary as their corresponding pixels in the initial fused image. Experimental results demonstrate that the proposed method is better than various existing transform-based fusion methods, including gradient pyramid transform, discrete wavelet transform, NSCT, and a spatial-based method, in terms of both subjective and objective evaluations.

[1]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[2]  Pan Lin,et al.  Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain , 2014, Comput. Math. Methods Medicine.

[3]  Ding Liu,et al.  Image Fusion Using Higher Order Singular Value Decomposition , 2012, IEEE Transactions on Image Processing.

[4]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[5]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..

[6]  Naixue Xiong,et al.  A Fingerprint Recognition Scheme Based on Assembling Invariant Moments for Cloud Computing Communications , 2011, IEEE Systems Journal.

[7]  Gabriel Cristóbal,et al.  Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique , 2009, Inf. Fusion.

[8]  屈小波,et al.  Multifocus image fusion method of sharp frequency localized Contourlet transform domain based on sum-modified-Laplacian , 2009 .

[9]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[10]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[11]  Huimin Lu,et al.  Maximum local energy: An effective approach for multisensor image fusion in beyond wavelet transform domain , 2012, Comput. Math. Appl..

[12]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[13]  S. Arumuga Perumal,et al.  Area level fusion of Multi-focused Images using Multi-Stationary Wavelet Packet Transform , 2010 .

[14]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[15]  A B Watson,et al.  Efficiency of a model human image code. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[16]  Veysel Aslantas,et al.  Fusion of multi-focus images using differential evolution algorithm , 2010, Expert Syst. Appl..

[17]  Bruno Aiazzi,et al.  Multispectral fusion of multisensor image data by the generalized Laplacian pyramid , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[20]  Aaron Fenster,et al.  Spine Image Fusion Via Graph Cuts , 2013, IEEE Transactions on Biomedical Engineering.

[21]  Yi Chai,et al.  Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain , 2012 .

[22]  Jing Tian,et al.  SAR and Multispectral Image Fusion Using Generalized IHS Transform Based on à Trous Wavelet and EMD Decompositions , 2010, IEEE Sensors Journal.

[23]  T. Stathaki,et al.  Optimal Contrast Correction for ICA-Based Fusion of Multimodal Images , 2008, IEEE Sensors Journal.

[24]  Yi Chai,et al.  Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain , 2011 .

[25]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[26]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[27]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[28]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[29]  Yaonan Wang,et al.  Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images , 2002, Inf. Fusion.

[30]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[31]  ChandaBhabatosh,et al.  Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure , 2013 .

[32]  Yi Shen,et al.  Region level based multi-focus image fusion using quaternion wavelet and normalized cut , 2014, Signal Process..

[33]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[34]  Yi Chai,et al.  Multifocus image fusion scheme using focused region detection and multiresolution , 2011 .

[35]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[36]  Vladimir Petrovic,et al.  Objective image fusion performance measures , 2008 .

[37]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[38]  Bin Li,et al.  Iris Recognition Algorithm Using Modified Log-Gabor Filters , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[40]  Yong Yang,et al.  Multi-focus Image Fusion Using an Effective Discrete Wavelet Transform Based Algorithm , 2014 .

[41]  Shutao Li,et al.  Pixel-level image fusion with simultaneous orthogonal matching pursuit , 2012, Inf. Fusion.

[42]  Matthias Bethge,et al.  How Sensitive Is the Human Visual System to the Local Statistics of Natural Images , 2012 .

[43]  Yi Chai,et al.  Multifocus image fusion scheme based on feature contrast in the lifting stationary wavelet domain , 2012, EURASIP Journal on Advances in Signal Processing.

[44]  Yong Jiang,et al.  Image fusion with morphological component analysis , 2014, Inf. Fusion.

[45]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[46]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[47]  Ramachandra Raghavendra,et al.  Novel image fusion scheme based on dependency measure for robust multispectral palmprint recognition , 2014, Pattern Recognit..

[48]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[49]  G. Padmavathi,et al.  Enhanced Image Fusion Algorithm Using Laplacian Pyramid and Spatial frequency Based Wavelet Algorithm , 2011 .

[50]  Bhabatosh Chanda,et al.  Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure , 2013, Inf. Fusion.

[51]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.