A novel sparse-representation-based multi-focus image fusion approach

In this paper, a novel multi-focus image fusion approach is presented. Firstly, a joint dictionary is constructed by combining several sub-dictionaries which are adaptively learned from source images using K-singular value decomposition (K-SVD) algorithm. The proposed dictionary constructing method does not need any prior knowledge, and no external pre-collected training image data is required either. Secondly, sparse coefficients are estimated by the batch orthogonal matching pursuit (batch-OMP) algorithm. It can effectively accelerate the sparse coding process. Finally, a maximum weighted multi-norm fusion rule is adopted to accurately reconstruct fused image from sparse coefficients and the joint dictionary. It can enable the fused image to contain most important information of the source images. To comprehensively evaluate the performance of the proposed method, comparison experiments are conducted on several multi-focus images and manually blurred images. Experimental results demonstrate that the proposed method outperforms many state-of-the-art techniques, in terms of visual and quantitative evaluations.

[1]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[2]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[3]  Chun-Liang Chien,et al.  Image Fusion With No Gamut Problem by Improved Nonlinear IHS Transforms for Remote Sensing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[5]  Jigisha N. Patel,et al.  Application of regression analysis in K-SVD dictionary learning , 2015 .

[6]  Michael Elad,et al.  Image Denoising Via Learned Dictionaries and Sparse representation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Fuchun Sun,et al.  Visual–Tactile Fusion for Object Recognition , 2017, IEEE Transactions on Automation Science and Engineering.

[8]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Gaofeng Meng,et al.  Multifocus image fusion via focus segmentation and region reconstruction , 2014, Neurocomputing.

[10]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Shutao Li,et al.  Simultaneous image fusion and super-resolution using sparse representation , 2013, Inf. Fusion.

[12]  Michael Elad,et al.  Analysis K-SVD: A Dictionary-Learning Algorithm for the Analysis Sparse Model , 2013, IEEE Transactions on Signal Processing.

[13]  Yu Liu,et al.  Multi-focus Image Fusion Based on Sparse Representation with Adaptive Sparse Domain Selection , 2013, 2013 Seventh International Conference on Image and Graphics.

[14]  Di Guo,et al.  Object Recognition Using Tactile Measurements: Kernel Sparse Coding Methods , 2016, IEEE Transactions on Instrumentation and Measurement.

[15]  Caiming Zhang,et al.  Adaptive sparse coding on PCA dictionary for image denoising , 2015, The Visual Computer.

[16]  Yong Jiang,et al.  Image fusion with morphological component analysis , 2014, Inf. Fusion.

[17]  Jan Kautz,et al.  Exposure Fusion , 2007 .

[18]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2013, IEEE Trans. Geosci. Remote. Sens..

[19]  Lu Ding,et al.  Hybrid dual-tree complex wavelet transform and support vector machine for digital multi-focus image fusion , 2016, Neurocomputing.

[20]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[21]  Shutao Li,et al.  Color image fusion with extend joint sparse model , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[22]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[23]  Lu Yang,et al.  Sparse representation and learning in visual recognition: Theory and applications , 2013, Signal Process..

[24]  Shutao Li,et al.  Multimodal image fusion with joint sparsity model , 2011 .

[25]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[26]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[28]  Yi Chai,et al.  A novel dictionary learning approach for multi-modality medical image fusion , 2016, Neurocomputing.

[29]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[31]  Yide Ma,et al.  Spiking cortical model for multifocus image fusion , 2014, Neurocomputing.

[32]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[33]  Veysel Aslantas,et al.  A pixel based multi-focus image fusion method , 2014 .

[34]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[35]  Kai-Lung Hua,et al.  A novel multi-focus image fusion algorithm based on random walks , 2014, J. Vis. Commun. Image Represent..

[36]  Baohua Zhang,et al.  Multi-focus image fusion algorithm based on focused region extraction , 2016, Neurocomputing.

[37]  Jian Cheng,et al.  Multiresolution fusion of Pan and MS images based on the Curvelet transform , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[38]  Hiroshi Nagahashi,et al.  Cross-Parameterization for Triangular Meshes with Semantic Features , 2007 .

[39]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[40]  Tanaya Guha,et al.  Learning Sparse Representations for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Zhaodong Liu,et al.  A novel fusion scheme for visible and infrared images based on compressive sensing , 2015 .

[42]  David Bull,et al.  Region-Based Multimodal Image Fusion Using ICA Bases , 2007 .

[43]  Yunhui Liu,et al.  Robust Exemplar Extraction Using Structured Sparse Coding , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Zheng Liu,et al.  A new contrast based multimodal medical image fusion framework , 2015, Neurocomputing.