Visible and thermal image fusion using curvelet transform and brain storm optimization

In this paper, we propose a brain storm optimized image fusion framework in the curvelet transform domain that combines thermal image with the visual image to obtain a single informative fused image. The source images are decomposed using the curvelet transform and the high frequency sub-band coefficients are fused by maximum selection rule, whereas the low frequency sub-band coefficients are fused by weighted linear combination rule. The human intelligence based brain storm optimization (BSO) algorithm is employed to find the optimal weights in fusing low frequency sub-band coefficients. Simulation have been performed to compare our results with other multi resolution fusion methods such as gradient (GRAD) pyramid, shift invariant discrete wavelet transform (SIDWT) and non sub-sampled contourlet transform (NSCT). The quality of the fused image is assessed using five different quality metrics and the results indicate that the proposed method outperforms other multiresolution fusion methods in terms of both subjective and objective quality metrics.

[1]  Kishor P. Upla,et al.  An Edge Preserving Multiresolution Fusion: Use of Contourlet Transform and MRF Prior , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  M. Roux,et al.  Multifocus image fusion based on redundant wavelet transform , 2010 .

[3]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[4]  Ashish Khare,et al.  Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach , 2014, Inf. Fusion.

[5]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[6]  R. Vidhya,et al.  Optical image fusion using support value transform (SVT) and curvelets , 2015 .

[7]  M. Swamy,et al.  Contrast-based fusion of noisy images using discrete wavelet transform , 2010 .

[8]  M. L. Dewal,et al.  Medical image denoising using adaptive fusion of curvelet transform and total variation , 2013, Comput. Electr. Eng..

[9]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[10]  Eduardo A. B. da Silva,et al.  Multiscale Image Fusion Using the Undecimated Wavelet Transform With Spectral Factorization and Nonorthogonal Filter Banks , 2013, IEEE Transactions on Image Processing.

[11]  Jan Flusser,et al.  Near infrared face recognition by combining Zernike moments and undecimated discrete wavelet transform , 2014, Digit. Signal Process..

[12]  Tumpa Dey A Survey on Different Fusion Techniques of Visual and Thermal Images for Human Face Recognition , 2013 .

[13]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Mingliang Xu,et al.  High quality multi-spectral and panchromatic image fusion technologies based on Curvelet transform , 2015, Neurocomputing.

[15]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[16]  Saurabh Singh,et al.  Face recognition by fusing thermal infrared and visible imagery , 2006, Image Vis. Comput..