Image fusion using a contourlet HMT model

In this paper hidden Markov tree (HMT) based image fusion methods are investigated. Considering the failure of wavelet in representing the geometry of image edges in dimension 2, here a new contourlet HMT model for image fusion is proposed. Because the CHMT model efficiently captures all dependencies across scales, space and directions through a tree structured dependence network, it can give more accurate description of images. Moreover, the CHMT has a simple tree structure with fewer parameters than wavelet HMT (WHMT), which enables efficient training using the expectation maximization (EM) algorithm. Inputting the contourlet coefficients of source images to train the CHMT model, we can get the edge probability density functions. Local inner-product fusion rule is performed on the high- frequency directional sub-bands, which is acquired by the product of the high-frequency directional coefficients by the edge probability density function of CHMT. The low- frequency sub-bands are compared to preserve the coefficients whose module are minimum. The experiment results show the superiority of the proposed image fusion method to WHMT and contourlets, both in image clarity, implementation speed, standard deviation, average gradient and average cross entropy.

[1]  R. Blum,et al.  Image fusion using the expectation-maximization algorithm and a hidden Markov model , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[2]  D. D.-Y. Po,et al.  Directional multiscale modeling of images using the contourlet transform , 2006, IEEE Transactions on Image Processing.

[3]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[4]  Z. W. Liao,et al.  Region-based multifocus image fusion based on Hough transform and wavelet domain hidden Markov models , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[5]  Jiao Li Advances and Perspective on Image Perception and Recognition in Multiscale Transform Domains , 2006 .

[6]  Harald Haas,et al.  Asilomar Conference on Signals, Systems, and Computers , 2006 .

[7]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[8]  Richard Baraniuk,et al.  Hidden Markov models for wavelet-based signal processing , 1996, Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers.

[9]  Justin K. Romberg,et al.  Bayesian tree-structured image modeling , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[10]  M. Vetterli,et al.  Contourlets: a new directional multiresolution image representation , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..