Neuro‐wavelet based intelligent medical image fusion

Imaging based sensitive clinical diagnosis is critically depending on image quality. In this article, the problem of enhancing fundus images is addressed by a novel fusion technique. The proposed approach utilizes the representation capability of wavelet transform and the learning ability of artificial neural networks. In this approach, input images are decomposed into wavelet transform followed by appropriate feature extraction for training of neural networks to obtain fused image. To ensure homogeneity, it employs consistency verification for minimizing the fusion artifacts. The visual and quantitative performance of the proposed approach is assessed using a number of experiments performed on the standard datasets of DRIVE and DRION‐DB. The experimental results demonstrate that the proposed fusion technique offers high average structural similarity of “0.99.” The proposed approach outperforms state‐of‐the‐art techniques which validates its effectiveness. The developed approach might be applied by the clinical diagnosis system for fundus related diseases.

[1]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[2]  Hadi Seyedarabi,et al.  Multi-focus image fusion for visual sensor networks in DCT domain , 2011, Comput. Electr. Eng..

[3]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[4]  Liu Cao,et al.  Multi-Focus Image Fusion Based on Spatial Frequency in Discrete Cosine Transform Domain , 2015, IEEE Signal Processing Letters.

[5]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[6]  Vps Naidu Discrete Cosine Transform-based Image Fusion , 2010 .

[7]  Jinshan Tang,et al.  A contrast based image fusion technique in the DCT domain , 2004, Digit. Signal Process..

[8]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[9]  B.K.P. Horn,et al.  Application of the discrete Haar wavelet transform to image fusion for nighttime driving , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[10]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[11]  Firouz Abdullah Al-Wassai,et al.  The IHS Transformations Based Image Fusion , 2011, ArXiv.

[12]  Yu Hu,et al.  Fusion of noisy images based on joint distribution model in dual‐tree complex wavelet domain , 2018, Int. J. Imaging Syst. Technol..

[13]  Gang Xiao,et al.  Fusion of MRI and CT images using guided image filter and image statistics , 2017, Int. J. Imaging Syst. Technol..

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  T. Meitzler,et al.  Iterative image fusion technique using fuzzy and neuro fuzzy logic and applications , 2005, NAFIPS 2005 - 2005 Annual Meeting of the North American Fuzzy Information Processing Society.

[16]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[17]  C. O. Alenoghena,et al.  Application of wavelet transform in spectrum sensing for cognitive radio: A survey , 2018, Phys. Commun..

[18]  Bo Zhao,et al.  Non-sampling Contourlet Based "Consistency Verification" Method of Image Fusion , 2011, ICIC.

[19]  Macarena Boix,et al.  Wavelet Transform application to the compression of images , 2010, Math. Comput. Model..

[20]  Dong Han,et al.  Multispectral palmprint recognition using wavelet-based image fusion , 2008, 2008 9th International Conference on Signal Processing.

[21]  M. Pradeep Implementation of image fusion algorithm using MATLAB (LAPLACIAN PYRAMID) , 2013, 2013 International Mutli-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s).

[22]  Dong Sun Park,et al.  Medical Image Fusion via an Effective Wavelet-Based Approach , 2010, EURASIP J. Adv. Signal Process..

[23]  Shenghuo Zhu,et al.  A survey on wavelet applications in data mining , 2002, SKDD.

[24]  Kai-Lung Hua,et al.  A novel multi-focus image fusion algorithm based on random walks , 2014, J. Vis. Commun. Image Represent..

[25]  Sébastien Chabrier,et al.  Hue and Saturation in the RGB Color Space , 2014, ICISP.

[26]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[27]  Lay Teen Ong,et al.  International Conference on Communications, Circuits and Systems, ICCCAS, Volume 2 , 2006, ICCCAS 2006.

[28]  Sheng-He Sun,et al.  A Robust 3D Model Watermarking Scheme Based on Feature Recognition , 2007 .

[29]  C.-C. Jay Kuo Understanding convolutional neural networks with a mathematical model , 2016, J. Vis. Commun. Image Represent..

[30]  Ashwini Galande,et al.  The art of medical image fusion: A survey , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[31]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[32]  A B Watson,et al.  Efficiency of a model human image code. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[33]  Kumaravel Subramaniam Tamilselvan,et al.  Survey and analysis of various image fusion techniques for clinical CT and MRI images , 2014, Int. J. Imaging Syst. Technol..

[34]  Shuaiqi Liu,et al.  Medical image fusion based on improved sum‐modified‐Laplacian , 2015, Int. J. Imaging Syst. Technol..

[35]  Bülent Sankur,et al.  Statistical evaluation of image quality measures , 2002, J. Electronic Imaging.

[36]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[37]  Ming-Hu Ha,et al.  Applications of wavelet transform in medical image processing , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[38]  Pooja,et al.  A New Image Fusion Algorithm Based on Wavelet Transform and Adaptive Neuro Fuzzy Logic Approach , 2014 .

[39]  Chunsheng Li,et al.  Feature-level image fusion for SAR and optical images , 2012 .

[40]  Mahantapas Kundu,et al.  Classification of fused images using radial basis function neural network for human face recognition , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[41]  A. Haar Zur Theorie der orthogonalen Funktionensysteme , 1910 .

[42]  Meenu Manchanda,et al.  A novel method of multimodal medical image fusion using fuzzy transform , 2016, J. Vis. Commun. Image Represent..

[43]  Junyu Dong,et al.  New Texture Features Based on Wavelet Transform Coinciding with Human Visual Perception , 2007, Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007).

[44]  VPS Naidu,et al.  Multi-resolution image fusion by FFT , 2011, 2011 International Conference on Image Information Processing.

[45]  Ali Aghagolzadeh,et al.  Multi-focus image fusion in DCT domain based on correlation coefficient , 2015, 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI).

[46]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[47]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[48]  Paul Bao,et al.  Wavelet transform image coding based on visual perception modeling , 1998, Defense, Security, and Sensing.

[49]  Harpreet Singh,et al.  Image fusion using fuzzy logic and applications , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[50]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[51]  Patrick J. Van Fleet,et al.  Wavelet Theory: An Elementary Approach with Applications , 2009 .

[52]  Miao Qi-guang,et al.  A Novel Image Fusion Method Using Contourlet Transform , 2006, 2006 International Conference on Communications, Circuits and Systems.

[53]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[54]  Muhammad Tahir,et al.  Protein subcellular localization of fluorescence imagery using spatial and transform domain features , 2012, Bioinform..

[55]  Shamik Sural,et al.  Human color perception in the HSV space and its application in histogram generation for image retrieval , 2005, IS&T/SPIE Electronic Imaging.

[56]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Manfred Ehlers Spectral characteristics preserving image fusion based on Fourier domain filtering , 2004, SPIE Remote Sensing.

[58]  Zhu Xizhi,et al.  The Application of Wavelet Transform in Digital Image Processing , 2008, 2008 International Conference on MultiMedia and Information Technology.

[59]  Mongi A. Abidi,et al.  Physics-based Fusion of Multispectral Data for Improved Face Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[60]  G. Siddalingesh,et al.  Feature-Level Image Fusion Using DWT, SWT, and DT-CWT , 2014 .

[61]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[62]  Anil K. Jain,et al.  Decision-Level Fusion in Fingerprint Verification , 2001, Multiple Classifier Systems.

[63]  Chaitali Chakrabarti,et al.  Architectures for wavelet transforms: A survey , 1996, J. VLSI Signal Process..

[64]  George K. Matsopoulos,et al.  Application of Morphological Pyramids: Fusion of MR and CT Phantoms , 1995, J. Vis. Commun. Image Represent..

[65]  Jonathan Lawry,et al.  IEEE International Conference on Fuzzy Systems , 2017 .

[66]  Vladimir Petrovic,et al.  Objective evaluation of signal-level image fusion performance , 2005 .

[67]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[68]  Ting Liu,et al.  Remote sensing image fusion via wavelet transform and sparse representation , 2015 .

[69]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..