A Spatial Fusion Scheme of Multi-focus Image Combining SVM-Based Classification and PCA-Based Weight

The image fusion technique aims to generate a comprehensive image that can combine complementary information from different source images. Traditional signal processing-based image fusion methods are well-studied in recent years, and researchers try to explore new ideas for this task. Especially, the machine learning method likes support vector machine (SVM) has an apparent advantage in many situations. In this work, a sliding window technique is first used to extract the key features of source images based on several effective evaluation metrics which can reflect the detailed information. Second, the extracted image features are employed to distinguish the focused areas and unfocused areas of source images by a trained SVM model, so the decision results for each source image will be obtained. Third, consistency verification (CV) is utilized to assimilate a single singular point of a specific region in the decision results in order to correct possible errors. At last, a new weighted fusion method for the pixel is designed based on principal component analysis (PCA) to deal with the disputed areas which come from the same position of decision maps of different source images. Experimental results reveal the proposed method is effective and can achieve better performance than comparative methods.

[1]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[2]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[3]  Lu Ding,et al.  Hybrid dual-tree complex wavelet transform and support vector machine for digital multi-focus image fusion , 2016, Neurocomputing.

[4]  Shaowen Yao,et al.  A Novel Multi-Focus Image Fusion Method Based on Stationary Wavelet Transform and Local Features of Fuzzy Sets , 2017, IEEE Access.

[5]  Jingyu Hou,et al.  Multimodal sensor medical image fusion based on nonsubsampled shearlet transform and S-PCNNs in HSV space , 2018, Signal Process..

[6]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Vladimir Petrovic,et al.  Objective image fusion performance characterisation , 2005, ICCV 2005.

[8]  B. K. Shreyamsha Kumar,et al.  Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform , 2013, Signal Image Video Process..

[9]  Vps Naidu,et al.  Image Fusion Technique using Multi-resolution Singular Value Decomposition , 2011 .

[10]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[11]  Yu Liu,et al.  Multi-focus image fusion with a deep convolutional neural network , 2017, Inf. Fusion.

[12]  Ebenezer Daniel,et al.  Optimum Wavelet-Based Homomorphic Medical Image Fusion Using Hybrid Genetic–Grey Wolf Optimization Algorithm , 2018, IEEE Sensors Journal.

[13]  Jinde Cao,et al.  Fully Convolutional Network-Based Multifocus Image Fusion , 2018, Neural Computation.

[14]  Ying Zhu,et al.  A multi-focus image fusion algorithm using modified adaptive PCNN model , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[15]  Susanto Rahardja,et al.  A New Multi-Focus Image Fusion Algorithm and Its Efficient Implementation , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Hitoshi Kiya,et al.  Scene Segmentation-Based Luminance Adjustment for Multi-Exposure Image Fusion , 2019, IEEE Transactions on Image Processing.

[17]  Panajotis Agathoklis,et al.  Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain , 2016, J. Circuits Syst. Comput..

[18]  Rabab Kreidieh Ward,et al.  Image Fusion With Convolutional Sparse Representation , 2016, IEEE Signal Processing Letters.

[19]  Germán Sánchez,et al.  Evaluating supervised learning approaches for spatial-domain multi-focus image fusion , 2017 .

[20]  Xiaorong Xue,et al.  A Parallel Fusion Algorithm of Remote Sensing Images Based on Wavelet Transform , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[21]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[22]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.