A New Pulse Coupled Neural Network (PCNN) for Brain Medical Image Fusion Empowered by Shuffled Frog Leaping Algorithm

Recent research has reported the application of image fusion technologies in medical images in a wide range of aspects, such as in the diagnosis of brain diseases, the detection of glioma and the diagnosis of Alzheimer’s disease. In our study, a new fusion method based on the combination of the shuffled frog leaping algorithm (SFLA) and the pulse coupled neural network (PCNN) is proposed for the fusion of SPECT and CT images to improve the quality of fused brain images. First, the intensity-hue-saturation (IHS) of a SPECT and CT image are decomposed using a non-subsampled contourlet transform (NSCT) independently, where both low-frequency and high-frequency images, using NSCT, are obtained. We then used the combined SFLA and PCNN to fuse the high-frequency sub-band images and low-frequency images. The SFLA is considered to optimize the PCNN network parameters. Finally, the fused image was produced from the reversed NSCT and reversed IHS transforms. We evaluated our algorithms against standard deviation (SD), mean gradient (Ḡ), spatial frequency (SF) and information entropy (E) using three different sets of brain images. The experimental results demonstrated the superior performance of the proposed fusion method to enhance both precision and spatial resolution significantly.

[1]  M. Arndt,et al.  A neural network for feature linking via synchronous activity: Results from cat visual cortex and from simulations , 1989 .

[2]  Bin Xiao,et al.  Medical image fusion by combining parallel features on multi-scale local extrema scheme , 2016, Knowl. Based Syst..

[3]  Fuad E. Alsaadi,et al.  A switching delayed PSO optimized extreme learning machine for short-term load forecasting , 2017, Neurocomputing.

[4]  Gong Zhang,et al.  Image fusion method of SAR and infrared image based on Curvelet transform with adaptive weighting , 2015, Multimedia Tools and Applications.

[5]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[6]  Vinod Kumar,et al.  Nonsubsampled shearlet based CT and MR medical image fusion using biologically inspired spiking neural network , 2015, Biomed. Signal Process. Control..

[7]  He Jianhua,et al.  Image fusion method based on average grads and wavelet contrast , 2012 .

[8]  C. Christober Asir Rajan,et al.  Hybrid: Particle Swarm Optimization–Genetic Algorithm and Particle Swarm Optimization–Shuffled Frog Leaping Algorithm for long-term generator maintenance scheduling , 2015 .

[9]  辛亚楠 Xin Yanan,et al.  An Improved Remote Sensing Image Fusion Method Based on Wavelet Transform , 2013 .

[10]  L. Otterbein,et al.  Isolation of a new laccase isoform from the white-rot fungi Pycnoporus cinnabarinus strain ss3. , 2000, Canadian journal of microbiology.

[11]  C. Chellamuthu,et al.  Fusion of SPECT and MRI images using integer wavelet transform in combination with curvelet transform , 2015 .

[12]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[13]  Hai Wang,et al.  Image fusion algorithm based on nonsubsampled contourlet transform , 2010, 2010 2nd International Conference on Future Computer and Communication.

[14]  Ke Lu,et al.  An overview of multi-modal medical image fusion , 2016, Neurocomputing.

[15]  Fuad E. Alsaadi,et al.  A Novel Switching Delayed PSO Algorithm for Estimating Unknown Parameters of Lateral Flow Immunoassay , 2016, Cognitive Computation.

[16]  Hong Zhang,et al.  Denoising and deblurring gold immunochromatographic strip images via gradient projection algorithms , 2017, Neurocomputing.

[17]  Azlan Mohd Zain,et al.  The role of basic, modified and hybrid shuffled frog leaping algorithm on optimization problems: a review , 2015, Soft Comput..

[18]  Yonghong Peng,et al.  A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images , 2018, IEEE Access.

[19]  Zidong Wang,et al.  Inferring nonlinear lateral flow immunoassay state-space models via an unscented Kalman filter , 2016, Science China Information Sciences.

[20]  Yuan Zhang,et al.  Double regularization medical CT image blind restoration reconstruction based on proximal alternating direction method of multipliers , 2017, EURASIP J. Image Video Process..

[21]  Zidong Wang,et al.  Image-Based Quantitative Analysis of Gold Immunochromatographic Strip via Cellular Neural Network Approach , 2014, IEEE Transactions on Medical Imaging.

[22]  Tristan Barrett,et al.  Comparison of initial and tertiary centre second opinion reads of multiparametric magnetic resonance imaging of the prostate prior to repeat biopsy , 2016, European Radiology.

[23]  Yanyan Wu,et al.  A novel fusion technique for CT and MRI medical image based on NSST , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[24]  De-Shuang Huang,et al.  A constructive approach for finding arbitrary roots of polynomials by neural networks , 2004, IEEE Transactions on Neural Networks.

[25]  Pierre-Marc Jodoin,et al.  Left-Ventricle Segmentation of SPECT Images of Rats , 2015, IEEE Transactions on Biomedical Engineering.

[26]  Zhang Ke.  An improved remote sensing image fusion method , 2007 .

[27]  Xiongfei Li,et al.  Image fusion based on simultaneous empirical wavelet transform , 2017, Multimedia Tools and Applications.

[28]  元治 崇,et al.  Hybrid Particle Swarm Optimization を用いた配電系統状態推定のパラメータ感度解析 , 2001 .

[29]  Jinwen Tian,et al.  Remote sensing image fusion based on average gradient of wavelet transform , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[30]  De-Shuang Huang,et al.  A General CPL-AdS Methodology for Fixing Dynamic Parameters in Dual Environments , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Madheswari Kanmani,et al.  An optimal weighted averaging fusion strategy for thermal and visible images using dual tree discrete wavelet transform and self tunning particle swarm optimization , 2016, Multimedia Tools and Applications.

[32]  De-Shuang Huang,et al.  A Neural Root Finder of Polynomials Based on Root Moments , 2004, Neural Computation.

[33]  De-Shuang Huang,et al.  A Constructive Hybrid Structure Optimization Methodology for Radial Basis Probabilistic Neural Networks , 2008, IEEE Transactions on Neural Networks.

[34]  Jiang Pin.  Fusion algorithm for infrared and visible image based on NSST and adaptive PCNN , 2014 .

[35]  Behzad Kalafje Nobariyan,et al.  Fusion of SPECT and MRI images using back and fore ground information , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[36]  D.-S. Huang,et al.  Radial Basis Probabilistic Neural Networks: Model and Application , 1999, Int. J. Pattern Recognit. Artif. Intell..

[37]  Zidong Wang,et al.  A new switching-delayed-PSO-based optimized SVM algorithm for diagnosis of Alzheimer's disease , 2018, Neurocomputing.

[38]  Li Yan,et al.  A fusion algorithm for infrared and visible images based on adaptive dual-channel unit-linking PCNN in NSCT domain , 2015 .

[39]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[40]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[41]  Parmeet Kaur,et al.  Resource provisioning and work flow scheduling in clouds using augmented Shuffled Frog Leaping Algorithm , 2017, J. Parallel Distributed Comput..

[42]  Bin Xiao,et al.  Union Laplacian pyramid with multiple features for medical image fusion , 2016, Neurocomputing.

[43]  N. Aishwarya,et al.  An image fusion framework using novel dictionary based sparse representation , 2017, Multimedia Tools and Applications.