A New Multi-Focus Image Fusion Algorithm and Its Efficient Implementation

Wavelet transform using Haar filter is a fast process for decomposing an image into low and high frequency sub-bands, which is an important step in multi-focus image fusion. This transformation alone is usually not sufficient to produce satisfying fused images, and therefore additional tools like focused region decision map and feature extraction are needed to enhance the fusion quality. In this paper, we propose a multi-focus image fusion algorithm that is suitable for efficient hardware implementation. The algorithm speed is significantly improved by utilizing Haar wavelet and computationally simple fusion rules. To further improve the circuit power and delay, we limit the logic operations to additions, subtractions, and multiplications only. Experiments on different benchmarks demonstrate that our proposed algorithm can reduce the fusion time by up to 99.97% compared with the state-of-the-art competing methods without compromising the fusion quality. In addition, the hardware implementation of the proposed algorithm reduces the circuit area and delay by 79.5% and 92.5%, respectively, when compared to the most competitive algorithm in this paper while maintaining similar fusion quality.

[1]  Shaowen Yao,et al.  A Novel Multi-Focus Image Fusion Method Based on Stationary Wavelet Transform and Local Features of Fuzzy Sets , 2017, IEEE Access.

[2]  Aili Wang,et al.  Multifocus image fusion based on nonsubsampled contourlet transform , 2012, 2012 7th International Forum on Strategic Technology (IFOST).

[3]  Jiajia Chen,et al.  A fast multi-focus image fusion algorithm by DWT and focused region decision map , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[4]  Sabalan Daneshvar,et al.  Multifocus image fusion via the Hartley transform , 2016, 2016 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[5]  Liu Cao,et al.  Multi-Focus Image Fusion Based on Spatial Frequency in Discrete Cosine Transform Domain , 2015, IEEE Signal Processing Letters.

[6]  Peng-Lang Shui,et al.  Multifocus image fusion in wavelet domain , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[7]  Jun Sun,et al.  Multifocus Image Fusion Based on Extreme Learning Machine and Human Visual System , 2017, IEEE Access.

[8]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[9]  Yu Liu,et al.  Multi-focus image fusion with a deep convolutional neural network , 2017, Inf. Fusion.

[10]  Nader Karimi,et al.  Multifocus image fusion based on surface area analysis , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[11]  M. Roux,et al.  Multifocus image fusion based on redundant wavelet transform , 2010 .

[12]  A. Azizi,et al.  QUALITY ASSESSMENT OF IMAGE FUSION TECHNIQUES FOR MULTISENSOR HIGH RESOLUTION SATELLITE IMAGES (CASE STUDY: IRS-P5 AND IRS-P6 SATELLITE IMAGES) , 2010 .

[13]  Ashish Khare,et al.  Fusion of multifocus noisy images using contourlet transform , 2013, 2013 Sixth International Conference on Contemporary Computing (IC3).

[14]  A. Haar.  Zur Theorie der orthogonalen Funktionensysteme , 1910 .

[15]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Shesheng Gao,et al.  Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network , 2017, IEEE Access.

[17]  Chip-Hong Chang,et al.  A New Paradigm of Common Subexpression Elimination by Unification of Addition and Subtraction , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[18]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[19]  Rabab Kreidieh Ward,et al.  Deep learning for pixel-level image fusion: Recent advances and future prospects , 2018, Inf. Fusion.

[20]  J. E. Fowler,et al.  The redundant discrete wavelet transform and additive noise , 2005, IEEE Signal Processing Letters.

[21]  Shutao Li,et al.  Pixel-level image fusion with simultaneous orthogonal matching pursuit , 2012, Inf. Fusion.

[22]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Feng Zhao,et al.  Application of multi-focus image fusion in visual power patrol inspection , 2017, 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[24]  Aleksandra Pizurica,et al.  Extending the Depth of Field in Microscopy Through Curvelet-Based Frequency-Adaptive Image Fusion , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[25]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[26]  R. Zaciu,et al.  Image compression using the overcomplete discrete wavelet transform , 1996, 1996. Digest of Technical Papers., International Conference on Consumer Electronics.

[27]  P. Dutilleux.  An Implementation of the “algorithme à trous” to Compute the Wavelet Transform , 1989 .

[28]  Syed Zulqarnain Gilani,et al.  Unsupervised Deep Multi-focus Image Fusion , 2018, ArXiv.

[29]  Manoj Kumar,et al.  A novel hybrid approach for image fusion using DCT and SML , 2016, 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC).

[30]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  B. Silverman,et al.  The Stationary Wavelet Transform and some Statistical Applications , 1995 .

[33]  Hadi Seyedarabi,et al.  Multifocus image fusion based on compressive sensing for visual sensor networks , 2014, 2014 22nd Iranian Conference on Electrical Engineering (ICEE).

[34]  Robert Hovden,et al.  Extended Depth of Field for High-Resolution Scanning Transmission Electron Microscopy , 2010, Microscopy and Microanalysis.

[35]  Hadi Seyedarabi,et al.  A non-reference image fusion metric based on mutual information of image features , 2011, Comput. Electr. Eng..

[36]  M. Omair Ahmad,et al.  Multiresolution DCT decomposition for multifocus image fusion , 2013, 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[37]  Jan Kautz,et al.  Computational zoom , 2017, ACM Trans. Graph..

[38]  Rabab Kreidieh Ward,et al.  Image Fusion With Convolutional Sparse Representation , 2016, IEEE Signal Processing Letters.

[39]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[40]  Pan Lin,et al.  Multifocus Image Fusion Based on NSCT and Focused Area Detection , 2014, IEEE Sensors Journal.

[41]  C. Burrus,et al.  Noise reduction using an undecimated discrete wavelet transform , 1996, IEEE Signal Processing Letters.

[42]  Prabhpreet Kaur,et al.  Survey on multifocus image fusion techniques , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).