Multi-focus Image Fusion using Neutrosophic based Wavelet Transform

Abstract The key aim of Multi-focus Image Fusion (MFIF) is to gather all the necessary and useful information as well as features from the source images and then merge that information to develop a fused image. This fused image is having more information and better image quality than the source images. There exist a number of MFIF techniques in spatial as well as transform domain. However, since the source images have low resolution, high level of noise and are blurred, it becomes quite difficult for the traditional MFIF techniques to provide a fused image with high image quality. Thus, to fuse the source images efficiently, a hybrid MFIF method is proposed which consists of Neutrosophic Set and Stationary Wavelet Transform. Various state-of-the-art MFIF techniques have been used to compare the performance of the Neutrosophic Stationary Wavelet Transform (NSWT) technique. To evaluate the proposed technique, quantitative as well as qualitative evaluation has been done on two different datasets. To quantitatively evaluate the proposed method based on the NSWT, two different types of evaluation metrics are used namely ”reference-based” and ”reference-less”. From the experimental results and comparison with the existing state-of-the-art techniques it has been found that the NSWT has achieved better quantitative and qualitative results that in turn helpful in extending the Depth-of-Field of the imaging system. The achieved fusion results has shown the effectiveness of the proposed MFIF technique.

[1]  Florentin Smarandache,et al.  A unifying field in logics : neutrosophic logic : neutrosophy, neutrosophic set, neutrosophic probability , 2020 .

[2]  Vps Naidu,et al.  Pixel Level Image Fusion using FuzzyletFusion Algorithm , 2013 .

[3]  Arif Mahmood,et al.  Multi-focus image fusion using Content Adaptive Blurring , 2019, Inf. Fusion.

[4]  Nader Karimi,et al.  Surface area-based focus criterion for multi-focus image fusion , 2017, Inf. Fusion.

[5]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[6]  Yanhui Guo,et al.  Color texture image segmentation based on neutrosophic set and wavelet transformation , 2011, Comput. Vis. Image Underst..

[7]  Hadi Seyedarabi,et al.  Multi-focus image fusion for visual sensor networks in DCT domain , 2011, Comput. Electr. Eng..

[8]  Prabhpreet Kaur,et al.  Survey on multifocus image fusion techniques , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[9]  Ying Liu,et al.  Multi-focus image fusion using deep support value convolutional neural network , 2019, Optik.

[10]  Deepika Koundal,et al.  Multi-focus Image Fusion: Quantitative and Qualitative Comparative Analysis , 2020 .

[11]  Shadrokh Samavi,et al.  Multi-focus image fusion using dictionary-based sparse representation , 2015, Inf. Fusion.

[12]  Eran A. Edirisinghe,et al.  MULTI-EXPOSURE&MULTI-FOCUS IMAGE FUSION IN TRANSFORM DOMAIN , 2006 .

[13]  Zheng Liu,et al.  Algebraic Multi-Grid Based Multi-Focus Image Fusion Using Watershed Algorithm , 2018, IEEE Access.

[14]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[15]  D. Shalini Punithavathani,et al.  Optimized ensemble decision-based multi-focus imagefusion using binary genetic Grey-Wolf optimizer in camera sensor networks , 2016, Multimedia Tools and Applications.

[16]  Chen Jin,et al.  A wavelet based algorithm for multi-focus micro-image fusion , 2004, Third International Conference on Image and Graphics (ICIG'04).

[17]  Kanagaraj Kannan,et al.  Optimal Decomposition Level of Discrete, Stationary and Dual Tree Complex Wavelet Transform for Pixel based Fusion of Multi-focused Images , 2010 .

[19]  Zengchang Qin,et al.  Multifocus image fusion based on robust principal component analysis , 2013, Pattern Recognit. Lett..

[20]  Qiguang Miao,et al.  A novel adaptive multi-focus image fusion algorithm based on PCNN and sharpness , 2005, SPIE Defense + Commercial Sensing.

[21]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[22]  Yan Yan,et al.  Super-Resolution Reconstruction via Multi-frame Defocused Images Based on PSF Estimation and Compressive Sensing , 2018, Sensing and Imaging.

[23]  Preeti Gupta,et al.  Survey on multi-focus image fusion algorithms , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).

[24]  D. Koundal,et al.  Image Fusion Techniques: A Survey , 2021, Archives of computational methods in engineering : state of the art reviews.

[25]  Aboul Ella Hassanien,et al.  Neutrosophic Sets and Fuzzy C-Means Clustering for Improving CT Liver Image Segmentation , 2014, IBICA.

[26]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[27]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[28]  Sarjinder Singh,et al.  Neurofuzzy and neutrosophic approach to compute the rate of change in new economies , 2002 .

[29]  Meenu Manchanda,et al.  An improved multimodal medical image fusion algorithm based on fuzzy transform , 2018, J. Vis. Commun. Image Represent..

[30]  Shiveta Bhat,et al.  Multi-focus image fusion techniques: a survey , 2021, Artificial Intelligence Review.

[31]  Penghua Li,et al.  A novel Image Fusion Framework based on Non-Subsampled Shearlet Transform (NSST) Domain , 2019, 2019 Chinese Control And Decision Conference (CCDC).

[32]  A. Aghagolzadeh,et al.  Real-time fusion of multi-focus images for visual sensor networks , 2010, 2010 6th Iranian Conference on Machine Vision and Image Processing.

[33]  M V Patil,et al.  Multi Focus Image Fusion Based on Spatial Frequency and Contrast Based Analysis under Stationary Wavelet Transform Domain , 2016 .

[34]  Bin Yang,et al.  Multi-focus image fusion and super-resolution with convolutional neural network , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[35]  Shaowen Yao,et al.  A Novel Multi-Focus Image Fusion Method Based on Stationary Wavelet Transform and Local Features of Fuzzy Sets , 2017, IEEE Access.

[36]  Pan Lin,et al.  Technique for multi-focus image fusion based on fuzzy-adaptive pulse-coupled neural network , 2017, Signal Image Video Process..

[37]  Savita Gupta,et al.  Neutrosophic Based Nakagami Total Variation Method for Speckle Suppression in Thyroid Ultrasound Images , 2017 .

[38]  Dilbag Singh,et al.  Efficient Landsat image fusion using fuzzy and stationary discrete wavelet transform , 2017 .

[39]  Giancarlo Mauri,et al.  Automated Prostate Gland Segmentation Based on an Unsupervised Fuzzy C-Means Clustering Technique Using Multispectral T1w and T2w MR Imaging , 2017, Inf..

[40]  Feng Zhao,et al.  Application of multi-focus image fusion in visual power patrol inspection , 2017, 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[41]  V. Sangeetha,et al.  Review of Image Fusion Techniques and Evaluation Metrics for Remote Sensing Applications , 2015 .

[42]  Malay Kumar Kundu,et al.  Corrections to "A Neuro-Fuzzy Approach for Medical Image Fusion" , 2015, IEEE Trans. Biomed. Eng..

[43]  E Vakaimalar,et al.  Multifocus image fusion scheme based on discrete cosine transform and spatial frequency , 2018, Multimedia Tools and Applications.

[44]  Y. Asnath Victy Phamila,et al.  Discrete Cosine Transform based fusion of multi-focus images for visual sensor networks , 2014, Signal Process..

[45]  Rajvi Patel,et al.  Comparative Study on Multi-focus Image Fusion Techniques in Dynamic Scene , 2015 .

[46]  Saeed Mozaffari,et al.  Multi-focus Image Fusion Based on Fuzzy and Wavelet Transform , 2009, CIARP.

[47]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[48]  Jiayi Zhou,et al.  A novel multi-focus image fusion approach based on image decomposition , 2017, Inf. Fusion.

[49]  Chunxia Zhang,et al.  MFFW: A new dataset for multi-focus image fusion , 2020, ArXiv.

[50]  Abdulkadir Sengür,et al.  A novel 3D skeleton algorithm based on neutrosophic cost function , 2015, Appl. Soft Comput..

[51]  Syed Muhammad Anwar,et al.  Facial Expression Recognition Using Stationary Wavelet Transform Features , 2017 .

[52]  Yanhui Guo,et al.  A novel image segmentation algorithm based on neutrosophic similarity clustering , 2014, Appl. Soft Comput..

[53]  Savita Gupta,et al.  Speckle reduction method for thyroid ultrasound images in neutrosophic domain , 2016, IET Image Process..

[54]  Xin Zhang,et al.  Fusion Algorithm of Multi-focus Images with Weighted Ratios and Weighted Gradient Based on Wavelet Transform , 2019, J. Intell. Syst..

[55]  M. P. Parsai,et al.  Different Image Fusion Techniques –A Critical Review , 2012 .

[56]  Jun Sun,et al.  Robust Sparse Representation Combined With Adaptive PCNN for Multifocus Image Fusion , 2018, IEEE Access.

[57]  Jamal Saeedi,et al.  Fisher classifier and fuzzy logic based multi-focus image fusion , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[58]  Cemal Köse,et al.  A novel image decomposition-based hybrid technique with super-resolution method for multi-focus image fusion , 2019, Inf. Fusion.

[59]  Jun Sun,et al.  Multifocus Image Fusion Based on Extreme Learning Machine and Human Visual System , 2017, IEEE Access.

[60]  Yong Yang A Novel DWT Based Multi-focus Image Fusion Method , 2011 .

[61]  Pagavathigounder Balasubramaniam,et al.  Image fusion using intuitionistic fuzzy sets , 2014, Inf. Fusion.

[62]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[63]  Massimo Midiri,et al.  A fully automatic 2D segmentation method for uterine fibroid in MRgFUS treatment evaluation , 2015, Comput. Biol. Medicine.

[64]  Shesheng Gao,et al.  Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network , 2017, IEEE Access.

[65]  Xin Jin,et al.  Infrared and visual image fusion method based on discrete cosine transform and local spatial frequency in discrete stationary wavelet transform domain , 2018 .

[66]  Savita Gupta,et al.  Automated delineation of thyroid nodules in ultrasound images using spatial neutrosophic clustering and level set , 2016, Appl. Soft Comput..

[67]  Cemal Köse,et al.  Multi-focus image fusion using Stationary Wavelet Transform (SWT) with Principal Component Analysis (PCA) , 2017, 2017 10th International Conference on Electrical and Electronics Engineering (ELECO).