Multimodal medical image fusion using fuzzy radial basis function neural networks

Most medical images are blurry for two reasons: one is that noise signal blurs the high frequency signal of image edge, the other one is the border of tumor with normal tissues cannot be very well defined on the images, therefore it is difficult for radiology experts to delineate image. It is necessary that an approach based on fuzzy inference fusion is used for coping with these difficulties. The paper puts forward a new method for multimodal medical image fusion, that fuzzy radial basis function neural networks (fuzzy-RBFNN) is used to perform auto-adaptive image fusion. Global genetic algorithm (GA) is employed to train the networks. In the experiments, samples sets include artificial blurred medical image. Experimental results show, comparing with other image fusion method, the proposed approach is more excellent for multimodal medical images both in visual effect of fused images and in objective evaluation criteria, especially for blurry source images.

[1]  John N. Lygouras,et al.  A neuro-fuzzy-based system for detecting abnormal patterns in wireless-capsule endoscopic images , 2007, Neurocomputing.

[2]  Jean-Marc Constans,et al.  A framework of fuzzy information fusion for the segmentation of brain tumor tissues on MR images , 2007, Image Vis. Comput..

[3]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[4]  Helen C. Shen,et al.  Interdependence and information loss in multi-sensor systems , 1999 .

[5]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[6]  Helen C. Shen,et al.  Interdependence and information loss in multi-sensor systems , 1999, J. Field Robotics.

[7]  Roderick Murray-Smith,et al.  Extending the functional equivalence of radial basis function networks and fuzzy inference systems , 1996, IEEE Trans. Neural Networks.

[8]  Zhongfei Zhang,et al.  "Automatic" multimodal medical image fusion , 2003, 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings..

[9]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[10]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[11]  Hilary Buxton,et al.  Learning identity with radial basis function networks , 1998, Neurocomputing.

[12]  A. Wang,et al.  The Application of Wavelet Transform to Multi-modality Medical Image Fusion , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[13]  U. Raff,et al.  Image fusion in neuroradiology: Three clinical examples including MRI of Parkinson disease , 2007, Comput. Medical Imaging Graph..

[14]  Rodrigo Verschae,et al.  Fuzzy fusion for skin detection , 2007, Fuzzy Sets Syst..

[15]  Mitsuo Gen,et al.  Genetic algorithms and engineering design , 1997 .