Infrared and visible images fusion based on contourlet-domain Hidden Markov Tree model

According to the fusion problem of infrared and visible images, the algorithm based on Contourlet-domain Hidden Markov Tree model (CHMT) is proposed in this paper. After the contourlet transform on the images, contourlet coefficients of the source images are trained to Contourlet-domain HMT model using the Expectation Maximization (EM) algorithm. Because the Contourlet-domain HMT model efficiently captures all dependencies across scales, space and directions through a tree structured dependence network, it can give more accurate description of images. Then a new fusion rule for the high frequency is built based on the window energy ratio, and weight average is adopted for low frequency. Experimental results show that the proposed algorithm provides more satisfying fusion results in terms of visual effect and objective evaluations, such as standard deviation, standard variance and clarity.

[1]  Richard Baraniuk,et al.  Hidden Markov models for wavelet-based signal processing , 1996, Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers.

[2]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[3]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[4]  Jiao Li Advances and Perspective on Image Perception and Recognition in Multiscale Transform Domains , 2006 .

[5]  R. Blum,et al.  Image fusion using the expectation-maximization algorithm and a hidden Markov model , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[6]  D. D.-Y. Po,et al.  Directional multiscale modeling of images using the contourlet transform , 2006, IEEE Transactions on Image Processing.

[7]  Richard G. Baraniuk,et al.  Multiscale image segmentation using wavelet-domain hidden Markov models , 2001, IEEE Trans. Image Process..