Statistical Modeling of Multi-modal Medical Image Fusion Method Using C-CHMM and M-PCNN

In this paper, a new Contextual hidden Markov Model (CHMM) and modified Pulse Coupled Neural Network (M-PCNN) based fusion approach in the Contour domain is proposed for multi-modal medical image fusion. The Contour transform as an emerging multi-scale multi-direction geometric analyzing tool can provide an efficient and flexible representation of images, e.g. edges, contours and textures, which overcomes the drawback of the 2-D wavelet transform. Considering the powerful advantages for statistical modeling and processing of Contour let coefficients by HMM, the context information integrated with HMM is established to construct a comprehensive statistical correlative model, which can collectively capture persistence across scales, directional selectivity within scales and energy concentration in the spatial neighborhood of the high-frequency sub-band coefficients. Low-frequency sub-band coefficients are fused by the magnitude maximum rule, and a modified PCNN is developed where the linking strength of each neuron is determined by the normalized region energy of Edge PDF and modified spatial frequency is employed as the image feature to motivate M-PCNN. The high-frequency directional sub-band coefficients are selected by total pulse number maximum strategy. The experimental results demonstrate that the presented fusion method can further improve fusion image quality and visual effects.

[1]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[2]  Haixu Wang,et al.  Multimodal medical image fusion based on IHS and PCA , 2010 .

[3]  Nicolas H. Younan,et al.  Statistical image modeling in the contourlet domain using contextual hidden Markov models , 2009, Signal Process..

[4]  Zhiling Long,et al.  Contourlet Image Modeling with Contextual Hidden Markov Models , 2006, 2006 IEEE Southwest Symposium on Image Analysis and Interpretation.

[5]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[6]  Richard Baraniuk,et al.  Hidden Markov models for wavelet-based signal processing , 1996, Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers.

[7]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[10]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[11]  Roberto Orecchia,et al.  MR and CT image fusion for postimplant analysis in permanent prostate seed implants. , 2004, International journal of radiation oncology, biology, physics.

[12]  R.G. Baraniuk,et al.  Contextual hidden Markov models for wavelet-domain signal processing , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[13]  Guoliang Fan,et al.  Image denoising using a local contextual hidden Markov model in the wavelet domain , 2001, IEEE Signal Processing Letters.

[14]  M. Do,et al.  Directional multiscale modeling of images using the contourlet transform , 2003, IEEE Workshop on Statistical Signal Processing, 2003.

[15]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[16]  Shuyuan Yang,et al.  Contourlet hidden Markov Tree and clarity-saliency driven PCNN based remote sensing images fusion , 2012, Appl. Soft Comput..

[17]  G. Piella.  New quality measures for image fusion , 2004 .

[18]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..