On Combination of Fuzzy Memberships for Medical Image Fusion using NSST based Fuzzy-PCNN

In this article the proposed Medical Image Fusion (MIF) technique uses combination of fuzzy membership val- ues as input to Pulse Coupled Neural Network (PCNN). We named the used PCNN model as Fuzzy-PCNN as the inputs are fuzzy in nature. The spatially co-registered medical images are multi-modal in nature. After decomposing the source medical images using Non-Subsampled Shearlet Transform (NSST) low frequency subbands (LFSs) are fused using the $\displaystyle \max$-selection rule. To fuse the high frequency subbands (HFSs), fuzzy member- ships using multiple membership functions are generated from a specific local-region of the HFSs’ coefficients. Then an L2- norm based ensembling operation is applied to find out the resultant of them. These resultant fuzzy memberships are used as input of PCNN. Inverse NSST (INSST) is applied to the fused coefficients to get the fused image. Visual and quantitative analysis and comparisons with state-of-the-art MIF techniques show the effectiveness of the proposed scheme.

[1]  Dong Sun Park,et al.  Medical Image Fusion via an Effective Wavelet-Based Approach , 2010, EURASIP J. Adv. Signal Process..

[2]  Anil K. Jain,et al.  Clustering ensembles: models of consensus and weak partitions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Witold Pedrycz,et al.  Collaborative fuzzy clustering , 2002, Pattern Recognit. Lett..

[4]  Azriel Rosenfeld,et al.  The fuzzy geometry of image subsets , 1984, Pattern Recognit. Lett..

[5]  Abdolreza Mirzaei,et al.  A Novel Hierarchical-Clustering-Combination Scheme Based on Fuzzy-Similarity Relations , 2010, IEEE Transactions on Fuzzy Systems.

[6]  W. Pedrycz Why triangular membership functions , 1994 .

[7]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[8]  Kanti V. Mardia,et al.  Spatial Classification Using Fuzzy Membership Models , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[10]  Witold Pedrycz,et al.  Fuzzy sets in pattern recognition: Methodology and methods , 1990, Pattern Recognit..

[11]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[12]  Vinod Kumar,et al.  Nonsubsampled shearlet based CT and MR medical image fusion using biologically inspired spiking neural network , 2015, Biomed. Signal Process. Control..

[13]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[14]  Ana L. N. Fred,et al.  Combining multiple clusterings using evidence accumulation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Shihong Yue,et al.  Fuzzy clustering based ET image fusion , 2013, Inf. Fusion.

[16]  Yide Ma,et al.  Review of pulse-coupled neural networks , 2010, Image Vis. Comput..

[17]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[18]  A. Kandel Fuzzy Mathematical Techniques With Applications , 1986 .

[19]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[20]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[21]  Wlodzislaw Duch,et al.  Uncertainty of data, fuzzy membership functions, and multilayer perceptrons , 2005, IEEE Transactions on Neural Networks.

[22]  Vincent Barra,et al.  A General Framework for the Fusion of Anatomical and Functional Medical Images , 2001, NeuroImage.

[23]  James C. Bezdek,et al.  Fuzzy models—What are they, and why? [Editorial] , 1993, IEEE Transactions on Fuzzy Systems.

[24]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.