New optimised region-based multi-scale image fusion method for thermal and visible images

On constructing a fused image by employing only individual pixels or a set of pixels within a small neighbourhood of the images (SIs) acquired from the same scene, pixel-based fusion techniques suffer from some drawbacks, such as blurring effects, high sensitivity to noise and misregistration. To overcome these drawbacks, this study proposes a new region-based image fusion method for thermal and visible images. Since different regions with certain properties need to be emphasised differently in the fused image, the corresponding regions of the SIs are optimally merged to obtain the fused image by employing multiple weighting factors (WFs). To improve the quality of the fused images, WFs were optimised by employing the differential evolution algorithm. Furthermore, a new quality metric was also developed to measure the quality of the fused images during the optimisation process. Experimental results show the feasibility of the proposed method.

[1]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[2]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[3]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[4]  Yifeng Niu,et al.  Airborne Infrared and Visible Image Fusion for Target Perception Based on Target Region Segmentation and Discrete Wavelet Transform , 2012 .

[5]  M. Swamy,et al.  Contrast-based fusion of noisy images using discrete wavelet transform , 2010 .

[6]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  Pengfei Xu,et al.  A novel algorithm of remote sensing image fusion based on Shearlets and PCNN , 2013, Neurocomputing.

[9]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[10]  James W. Davis,et al.  Background-subtraction using contour-based fusion of thermal and visible imagery , 2007, Comput. Vis. Image Underst..

[11]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[12]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[13]  Rick S. Blum,et al.  Fusion of visual and IR images for concealed weapon detection , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[14]  Karim Faez,et al.  Infrared and visible image fusion using fuzzy logic and population-based optimization , 2012, Appl. Soft Comput..

[15]  Veysel Aslantas,et al.  A comparison of image fusion methods on visible, thermal and multi-focus images for surveillance applications , 2011, ICDP.

[16]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .

[17]  Sung-Jea Ko,et al.  Morphological pyramids with alternating sequential filters , 1995, IEEE Trans. Image Process..

[18]  X. Li,et al.  Efficient fusion for infrared and visible images based on compressive sensing principle , 2011 .

[19]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[20]  Shih-Sian Cheng,et al.  A novel algorithm of remote sensing image fusion based on Shearlets and PCNN , 2013 .

[21]  Hadi Seyedarabi,et al.  A non-reference image fusion metric based on mutual information of image features , 2011, Comput. Electr. Eng..

[22]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[23]  Mei Yang,et al.  Multi-focus image fusion algorithm based on shearlets , 2011 .

[24]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[25]  Ramachandra Raghavendra,et al.  Particle swarm optimization based fusion of near infrared and visible images for improved face verification , 2011, Pattern Recognit..

[26]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[27]  Veysel Aslantas,et al.  Fusion of multi-focus images using differential evolution algorithm , 2010, Expert Syst. Appl..

[28]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[29]  Yvonne Schuhmacher.  Image Fusion Theories Techniques And Applications , 2016 .

[30]  Lincheng Shen,et al.  Multi-resolution Image Fusion Using AMOPSO-II , 2006 .

[31]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[32]  A. Mumtaz,et al.  Genetic Algorithms and its application to image fusion , 2008, 2008 4th International Conference on Emerging Technologies.

[33]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[34]  Shutao Li,et al.  The multiscale directional bilateral filter and its application to multisensor image fusion , 2012, Inf. Fusion.