A classification and fuzzy-based approach for digital multi-focus image fusion

This paper presents a new wavelet-based method for fusion of spatially registered multi-focus images. We have formulated the image fusion process as a two-class classification problem: in and out-of-focus classes. First, a 12–dimensional feature vector using dual-tree discrete wavelet transform (DT-DWT) sub-bands of the source images are extracted, and then a trained two-class fisher classifier projects it to the class labels. The classifier output is used as a decision map for fusing high-frequency wavelet coefficients of multi-focus source images in different directions and decomposition levels of the DT-DWT. In addition, there is an uncertainty for selecting high-frequency wavelet coefficients in smooth regions of source images, which causes some misclassified pixels in the classification output or the decision map. In order to solve this uncertainty and integrate as much information as possible from the source images into the fused image, we propose an algorithm based on fuzzy logic, which combines outputs of two different fusion rules based on a dissimilarity measure from the source images: Selection based on the decision map and weighted averaging. An estimation of the decision map is also used for fusing low-frequency wavelet coefficients of the source images instead of simple averaging. After fusing low- and high-frequency wavelet coefficients of the source images, the final fused image is obtained using the inverse DT-DWT. This new method provides improved subjective and objectives results (more than 4.5 dB on average) as compared to previous fusion methods.

[1]  A. Rosenfeld,et al.  Edge and Curve Detection for Visual Scene Analysis , 1971, IEEE Transactions on Computers.

[2]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[3]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[4]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[5]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[6]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[7]  B. S. Manjunath,et al.  Multi-sensor image fusion using the wavelet transform , 1994, Proceedings of 1st International Conference on Image Processing.

[8]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[9]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[10]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[11]  Nick Kingsbury,et al.  The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters , 1998 .

[12]  Thomas Fechner,et al.  Pixel-level image fusion: the case of image sequences , 1998, Defense, Security, and Sensing.

[13]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[14]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Nick G. Kingsbury,et al.  A dual-tree complex wavelet transform with improved orthogonality and symmetry properties , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[16]  Costas Xydeas,et al.  On the effects of sensor noise in pixel-level image fusion performance , 2000, Proceedings of the Third International Conference on Information Fusion.

[17]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[18]  Cedric Nishan Canagarajah,et al.  Image Fusion Using Complex Wavelets , 2002, BMVC.

[19]  Amrane Houacine,et al.  Redundant versus orthogonal wavelet decomposition for multisensor image fusion , 2003, Pattern Recognit..

[20]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[21]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[22]  David S. Doermann,et al.  Machine printed text and handwriting identification in noisy document images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  S. Garg,et al.  Multilevel Medical Image Fusion using Segmented Image by Level Set Evolution with Region Competition , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[24]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[25]  Peter J. O'Shea,et al.  The Generalised Image Fusion Toolkit (GIFT) , 2006, The Insight Journal.

[26]  Lining Sun,et al.  A New Wavelet Based Multi-focus Image Fusion Scheme and Its Application on Optical Microscopy , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[27]  Yifeng Niu,et al.  A Novel Approach to Image Fusion Based on Multi-Objective Optimization , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[28]  K. Kannan,et al.  Optimal Decomposition Level of Discrete Wavelet Transform for Pixel Based Fusion of Multi - Focused Images , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[29]  Gengui Zhou,et al.  A New Tree Encoding for the Degree-Constrained Spanning Tree Problem , 2007 .

[30]  Gang Liu,et al.  Fusion of multi-spectral and panchromatic images using fuzzy rule , 2007 .

[31]  Sunil Kumar,et al.  Text Extraction and Document Image Segmentation Using Matched Wavelets and MRF Model , 2007, IEEE Transactions on Image Processing.

[32]  Henry Selvaraj,et al.  Constrained Disjoint Paths in Geometric Network , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[33]  Sun Wei,et al.  A Multi-Focus Image Fusion Algorithm with DT-CWT , 2007 .

[34]  Jamal Saeedi,et al.  Fisher classifier and fuzzy logic based multi-focus image fusion , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.