A novel image decomposition-based hybrid technique with super-resolution method for multi-focus image fusion

Abstract Multi-focus image fusion combines two or more images which have different focus values of the same scene using fusion rules. The meaningful image is named all-in-focus image which is more informative and useful for visual perception. In this paper, a novel approach for multi-focus image fusion is proposed. The method is a hybrid method with super-resolution. Firstly, super-resolution method is applied to all source images to enhance information like contrast. Thus, low-resolution source images are converted to high-resolution source images. Secondly, due to decomposing these source images, Stationary Wavelet Transform (SWT) is implemented and images are divided into four sub-bands. These sub-bands are LL (low–low), LH (low–high), HL (high–low) and HH (high–high). LL is the approximation coefficient of source images and others are the detail coefficients of source images. For all these sub-bands, Principal Component Analysis (PCA) is implemented and maximum eigenvector of each sub-band of source images is selected separately to fuse images. Then, Inverse Stationary Wavelet Transform (ISWT) is used to reconstruct the fused sub-bands. Finally, to measure quality of the proposed method objectively, fused image is resized to original source image's size using interpolation based resizing method. To measure the success of method, different metrics without reference image and with reference image, are selected. Results show that the proposed method produce clear edges, good visual perception, good clarity and very few distortion. The proposed hybrid method is applied to produce better quality fused images. Results prove success of the approach in this area. Also visual and quantitative results are very impressive.

[1]  Wei Liu,et al.  A novel infrared and visible image fusion algorithm based on shift-invariant dual-tree complex shearlet transform and sparse representation , 2017, Neurocomputing.

[2]  A. Hegde,et al.  A Review of Quality Metrics for Fused Image , 2015 .

[3]  Xiaosong Li,et al.  Multifocus image fusion by combining with mixed-order structure tensors and multiscale neighborhood , 2016, Inf. Sci..

[4]  V. Sowmya,et al.  Empirical Wavelet Transform for Multifocus Image Fusion , 2016 .

[5]  Syed Muhammad Anwar,et al.  Facial Expression Recognition Using Stationary Wavelet Transform Features , 2017 .

[6]  Ujwala Patil,et al.  Image fusion using hierarchical PCA. , 2011, 2011 International Conference on Image Information Processing.

[7]  Hao Shen,et al.  The optimal algorithm for Multi-source RS image fusion , 2016, MethodsX.

[8]  Jianwei Zhao,et al.  Image super-resolution via adaptive sparse representation , 2017, Knowl. Based Syst..

[9]  Baohua Zhang,et al.  Multi-focus image fusion based on sparse decomposition and background detection , 2016, Digit. Signal Process..

[10]  Yi Chai,et al.  A novel sparse-representation-based multi-focus image fusion approach , 2016, Neurocomputing.

[11]  Jing Lu,et al.  Discrete Meyer Wavelet Transform Features For online Hangul Script Recognition , 2012 .

[12]  T. Jemima Jebaseeli,et al.  A Survey on Multi-Focus ImageFusion Methods , 2012 .

[13]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[14]  Hai-hui Wang,et al.  A New Multiwavelet-Based Approach to Image Fusion , 2004, Journal of Mathematical Imaging and Vision.

[15]  Xiongfei Li,et al.  A new multifocus image fusion based on spectrum comparison , 2016, Signal Process..

[16]  Jianxu Mao,et al.  Energy-efficient multi-focus image fusion based on neighbor distance and morphology , 2016 .

[17]  Jiayi Zhou,et al.  A novel multi-focus image fusion approach based on image decomposition , 2017, Inf. Fusion.

[18]  P. S. Gomathi,et al.  Multi Focus Image Fusion Using Discrete Wavelet Transform , 2011 .

[19]  Chiou-Shann Fuh,et al.  Image Reconstruction With Improved Super-Resolution Algorithm , 2004, Int. J. Pattern Recognit. Artif. Intell..

[20]  Xinming Tang,et al.  IMAGE FUSION AND IMAGE QUALITY ASSESSMENT OF FUSED IMAGES , 2013 .

[21]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[22]  J. R. Raol,et al.  Pixel-level Image Fusion using Wavelets and Principal Component Analysis , 2008 .

[23]  Yi Chai,et al.  Multifocus image fusion and denoising scheme based on homogeneity similarity , 2012 .

[24]  Kai-Lung Hua,et al.  A novel multi-focus image fusion algorithm based on random walks , 2014, J. Vis. Commun. Image Represent..

[25]  Baohua Zhang,et al.  Multi-focus image fusion algorithm based on focused region extraction , 2016, Neurocomputing.

[26]  Tessamma Thomas,et al.  Single Frame Image super Resolution using Learned Directionlets , 2010, ArXiv.

[27]  C. H. Chen,et al.  Multifocus Image Fusion Based on Multiwavelet and Dfb , 2015 .

[28]  S. Arumuga Perumal,et al.  Performance Comparison of various levels of Fusion of Multi-focused Images using Wavelet Transform , 2010 .

[29]  H. Demirel,et al.  Image Super Resolution Based on Interpolation of Wavelet Domain High Frequency Subbands and the Spatial Domain Input Image , 2010 .

[30]  Yin Guofu,et al.  Defect detection in magnetic tile images based on stationary wavelet transform , 2016 .