Focal Liver Lesion Detection in Ultrasound Image Using Deep Feature Fusions and Super Resolution

This research presents a machine vision approach to detect lesions in liver ultrasound as well as resolving some issues in ultrasound such as artifacts, speckle noise, and blurring effect. The anisotropic diffusion is modified using the edge preservation conditions which found better than traditional ones in quantitative evolution. To dig for more potential information, a learnable super-resolution (SR) is embedded into the deep CNN. The feature is fused using Gabor Wavelet Transform (GWT) and Local Binary Pattern (LBP) with a pre-trained deep CNN model. Moreover, we propose a Bayes rule-based informative patch selection approach to reduce the processing time with the selective image patches and design an algorithm to mark the lesion region from identified ultrasound image patches. To train this model, standard data ensures promising resolution. The testing phase considers generalized data with a varying resolution and test the performance of the model. Exploring cross-validation, it finds that a 5-fold strategy can successfully eradicate the overfitting problem. Experiment data are collected using 298 consecutive ultrasounds comprising 15,296 image patches. This proposed feature fusion technique confirms satisfactory performance compared to the current relevant works with an accuracy of 98.40%.

[1]  A. Ahmadian,et al.  A texture classification method for diffused liver diseases using Gabor wavelets , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[2]  Otmar Scherzer,et al.  Handbook of Mathematical Methods in Imaging , 2015, Handbook of Mathematical Methods in Imaging.

[3]  Vinod Kumar,et al.  Neural network based focal liver lesion diagnosis using ultrasound images , 2011, Comput. Medical Imaging Graph..

[4]  Mohammad Motiur Rahman,et al.  An intelligent system for gastrointestinal polyp detection in endoscopic video using fusion of bidimensional empirical mode decomposition and convolutional neural network features , 2020, Int. J. Imaging Syst. Technol..

[5]  Marcos Martin-Fernandez,et al.  Anisotropic Diffusion Filter With Memory Based on Speckle Statistics for Ultrasound Images , 2015, IEEE Transactions on Image Processing.

[6]  Rahmita Wirza O. K. Rahmat,et al.  Components and implementation of a picture archiving and communication system in a prototype application , 2018 .

[7]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[8]  Yaonan Wang,et al.  Texture classification using the support vector machines , 2003, Pattern Recognit..

[9]  Sung Min Kim,et al.  Classification of focal liver lesions on ultrasound images by extracting hybrid textural features and using an artificial neural network. , 2015, Bio-medical materials and engineering.

[10]  Pham Quoc Phu,et al.  Classification of Liver Diseases Based on Ultrasound Image Texture Features , 2018, Applied Sciences.

[11]  Abhay Chowdhary,et al.  Artificial Neural Network Application in the Diagnosis of Disease Conditions with Liver Ultrasound Images , 2014, Adv. Bioinformatics.

[12]  Scott T. Acton,et al.  Speckle reducing anisotropic diffusion , 2002, IEEE Trans. Image Process..

[13]  Yong Man Ro,et al.  Multiple ROI selection based focal liver lesion classification in ultrasound images , 2013, Expert Syst. Appl..

[14]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[15]  Jitendra Virmani,et al.  Neural Network Ensemble Based CAD System for Focal Liver Lesions from B-Mode Ultrasound , 2014, Journal of Digital Imaging.

[16]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[17]  Thomas B. Moeslund,et al.  Improved interpolation kernels for super resolution algorithms , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[18]  Huiyan Jiang,et al.  The Research of Feature Extraction Method of Liver Pathological Image Based on Multispatial Mapping and Statistical Properties , 2016, Comput. Math. Methods Medicine.

[19]  Morium Akter,et al.  An improved method of automatic exudates detection in retinal image , 2014 .

[20]  Vinod Kumar,et al.  A comparative study of computer-aided classification systems for focal hepatic lesions from B-mode ultrasound , 2013, Journal of medical engineering & technology.

[21]  Sendren Sheng-Dong Xu,et al.  Classification of liver diseases based on ultrasound image texture features , 2019 .

[22]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[23]  Zarko Celicanin,et al.  Hybrid Ultrasound/Magnetic Resonance Simultaneous Acquisition and Image Fusion for Motion Monitoring in the Upper Abdomen , 2013, Investigative radiology.

[24]  P. Srinivasan,et al.  Automatic Classification of Focal Lesions in Ultrasound Liver Images using Principal Component Analysis and Neural Networks , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Guang-ming Xian,et al.  An identification method of malignant and benign liver tumors from ultrasonography based on GLCM texture features and fuzzy SVM , 2010, Expert Syst. Appl..

[26]  Gábor Székely,et al.  A Learning-Based Approach for Fast and Robust Vessel Tracking in Long Ultrasound Sequences , 2013, MICCAI.

[27]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[29]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[30]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[31]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Vinod Kumar,et al.  Pca-SVm based caD System for Focal liver lesions using B-mode ultrasound Images , 2013 .

[33]  Carl-Fredrik Westin,et al.  Oriented Speckle Reducing Anisotropic Diffusion , 2007, IEEE Transactions on Image Processing.

[34]  Ce Liu,et al.  Markov Random Fields for Super-resolution and Texture Synthesis , 2010 .

[35]  A. Samir,et al.  Machine learning for medical ultrasound: status, methods, and future opportunities , 2018, Abdominal Radiology.

[36]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[37]  Mohammad Shorif Uddin,et al.  Gastrointestinal polyp classification through empirical mode decomposition and neural features , 2020 .

[38]  Heung-No Lee,et al.  Computer aided diagnostic system for ultrasound liver images: A systematic review , 2017 .

[39]  Ahmed M. Elgammal,et al.  A Statistically Selected Part-Based Probabilistic Model for Object Recognition , 2006, IWICPAS.

[40]  Mohammed Elmogy,et al.  Diagnosis of Focal Liver Diseases Based on Deep Learning Technique for Ultrasound Images , 2017, Arabian Journal for Science and Engineering.