Random forest-based scheme using feature and decision levels information for multi-focus image fusion

Often captured images are not focussed everywhere. Many applications of pattern recognition and computer vision require all parts of the image to be well-focussed. The all-in-focus image obtained, through the improved image fusion scheme, is useful for downstream tasks of image processing such as image enhancement, image segmentation, and edge detection. Mostly, fusion techniques have used feature-level information extracted from spatial or transform domain. In contrast, we have proposed a random forest (RF)-based novel scheme that has incorporated feature and decision levels information. In the proposed scheme, useful features are extracted from both spatial and transform domains. These features are used to train randomly generated trees of RF algorithm. The predicted information of trees is aggregated to construct more accurate decision map for fusion. Our proposed scheme has yielded better-fused image than the fused image produced by principal component analysis and Wavelet transform-based previous approaches that use simple feature-level information. Moreover, our approach has generated better-fused images than Support Vector Machine and Probabilistic Neural Network-based individual Machine Learning approaches. The performance of proposed scheme is evaluated using various qualitative and quantitative measures. The proposed scheme has reported 98.83, 97.29, 98.97, 97.78, and 98.14 % accuracy for standard images of Elaine, Barbara, Boat, Lena, and Cameraman, respectively. Further, this scheme has yielded 97.94, 98.84, 97.55, and 98.09 % accuracy for the real blurred images of Calendar, Leaf, Tree, and Lab, respectively.

[1]  Yaonan Wang,et al.  Fusing Images with Multiple Focuses Using Support Vector Machines , 2002, ICANN.

[2]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[3]  Basilio Sierra,et al.  Fusing multiple image transformations and a thermal sensor with kinect to improve person detection ability , 2013, Eng. Appl. Artif. Intell..

[4]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[5]  Asifullah Khan,et al.  IDM-PhyChm-Ens: Intelligent decision-making ensemble methodology for classification of human breast cancer using physicochemical properties of amino acids , 2014, Amino Acids.

[6]  Xiangyang Wang,et al.  Active SVM-based relevance feedback using multiple classifiers ensemble and features reweighting , 2013, Eng. Appl. Artif. Intell..

[7]  Yong Zhang,et al.  Multi-band Vector Wavelet Transformation based Multi-Focus Image Fusion Algorithm , 2013, J. Softw..

[8]  S. Marshall,et al.  Multiresolution morphological fusion of MR and CT images of the human brain , 1995 .

[9]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[10]  Manfred Ehlers,et al.  Performance of evaluation methods in image fusion , 2009, 2009 12th International Conference on Information Fusion.

[11]  Cyril Prasanna Raj,et al.  Feature-Level Multi-focus Image Fusion using Neural Network and Image Enhancement , 2012 .

[12]  Yun He,et al.  A multiscale approach to pixel-level image fusion , 2005, Integr. Comput. Aided Eng..

[13]  Nikolaos Mitianoudis,et al.  Joint Fusion and Blind Restoration For Multiple Image Scenarios With Missing Data , 2007, Comput. J..

[14]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ivor W. Tsang,et al.  Fusing images with different focuses using support vector machines , 2004, IEEE Transactions on Neural Networks.

[16]  Huazhong Shu,et al.  Legendre moment invariants to blur and affine transformation and their use in image recognition , 2012, Pattern Analysis and Applications.

[17]  S. L. Lee,et al.  Wavelets in wandering subspaces , 1993 .

[18]  Li Jie,et al.  A Novel Support Vector Machine-Based Multifocus Image Fusion Algorithm , 2006, 2006 International Conference on Communications, Circuits and Systems.

[19]  J. R. Raol,et al.  Pixel-level Image Fusion using Wavelets and Principal Component Analysis , 2008 .

[20]  K. Ashok Babu,et al.  An all Approach for Multi-Focus Image Fusion Using Neural Network , 2011 .

[21]  Yingjie Zhang,et al.  Efficient fusion scheme for multi-focus images by using blurring measure , 2009, Digit. Signal Process..

[22]  Min Liu,et al.  Combined invariants to blur and rotation using Zernike moment descriptors , 2010, Pattern Analysis and Applications.

[23]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[24]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[25]  Feng Xue-zhi,et al.  Multi-source remote sensing image fusion based on support vector machine , 2002 .

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.