Multi-focus image fusion using HOSVD and edge intensity

The edge intensity metric is proposed.The relationship between the patch energy and the shrink factor of the sigmoid function is constructed.Multi-strategy fusion rule based on edge intensity and patch energy is designed.The proposed fusion method is performed in the HOSVD domain. The purpose of multi-focus image fusion is to integrate the partially focused images into one single image which is focused everywhere. To achieve this purpose, higher order singular value decomposition (HOSVD) and edge intensity (EDI) based multi-focus image fusion method is proposed. The main characteristics of the proposed method includes: 1. an effective and robust sharpness measure based on edge intensity is presented; 2. considering the fact that HOSVD is an effective data-driven decomposition technique and shows the outstanding ability in the representation of high-dimensional data, it is used to decompose multi-focus images; and 3. a multi-strategy fusion rule based on sigmoid function is used to fuse the decomposition coefficients. Furthermore, several experiments are conducted to verify the superiority of the proposed fusion framework in terms of visual and statistical analyses.

[1]  Jing Tian,et al.  Adaptive multi-focus image fusion using a wavelet-based statistical sharpness measure , 2012, Signal Process..

[2]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[3]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[4]  S. J. Devlin,et al.  Robust estimation and outlier detection with correlation coefficients , 1975 .

[5]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[6]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[7]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[8]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[9]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Qiguang Miao,et al.  A novel adaptive multi-focus image fusion algorithm based on PCNN and sharpness , 2005, SPIE Defense + Commercial Sensing.

[11]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[12]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[13]  B. S. Manjunath,et al.  Multi-sensor image fusion using the wavelet transform , 1994, Proceedings of 1st International Conference on Image Processing.

[14]  P. Geng,et al.  Image fusion by pulse couple neural network with shearlet , 2012 .

[15]  Jianbo Shi,et al.  Generalized Random Walks for Fusion of Multi-Exposure Images , 2011, IEEE Transactions on Image Processing.

[16]  Raveendran Paramesran,et al.  Measure of image sharpness using eigenvalues , 2007, Inf. Sci..

[17]  Feihong Yu,et al.  An automatic image fusion algorithm for unregistered multiply multi-focus images , 2015 .

[18]  Ding Liu,et al.  Image Fusion Using Higher Order Singular Value Decomposition , 2012, IEEE Transactions on Image Processing.

[19]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[20]  A. Ardeshir Goshtasby,et al.  Fusion of multifocus images to maximize image information , 2006, SPIE Defense + Commercial Sensing.

[21]  Uday B. Desai,et al.  Multimodal image/video fusion rule using generalized pixel significance based on statistical properties of the neighborhood , 2013, Signal, Image and Video Processing.

[22]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[23]  Shih-Sian Cheng,et al.  A novel algorithm of remote sensing image fusion based on Shearlets and PCNN , 2013 .

[24]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[25]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[26]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..

[27]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.