Preliminary Study of Chronic Liver Classification on Ultrasound Images Using an Ensemble Model

Chronic liver diseases are fifth leading cause of fatality in developing countries. Their early diagnosis is extremely important for timely treatment and salvage life. To examine abnormalities of liver, ultrasound imaging is the most frequently used modality. However, the visual differentiation between chronic liver and cirrhosis, and presence of heptocellular carcinomas (HCC) evolved over cirrhotic liver is difficult, as they appear almost similar in ultrasound images. In this paper, to deal with this difficult visualization problem, a method has been developed for classifying four liver stages, that is, normal, chronic, cirrhosis, and HCC evolved over cirrhosis. The method is formulated with selected set of “handcrafted” texture features obtained after hierarchal feature fusion. These multiresolution and higher order features, which are able to characterize echotexture and roughness of liver surface, are extracted by using ranklet, gray-level difference matrix and gray-level co-occurrence matrix methods. Thereafter, these features are applied on proposed ensemble classifier that is designed with voting algorithm in conjunction with three classifiers, namely, k–nearest neighbor (k-NN), support vector machine (SVM), and rotation forest. The experiments are conducted to evaluate the (a) effectiveness of “handcrafted” texture features, (b) performance of proposed ensemble model, (c) effectiveness of proposed ensemble strategy, (d) performance of different classifiers, and (e) performance of proposed ensemble model based on Convolutional Neural Networks (CNN) features to differentiate four liver stages. These experiments are carried out on database of 754 segmented regions of interest formed by clinically acquired ultrasound images. The results show that classification accuracy of 96.6% is obtained by use of proposed classifier model.

[1]  K. Blekas,et al.  Fuzzy neural network-based texture analysis of ultrasonic images , 2000, IEEE Engineering in Medicine and Biology Magazine.

[2]  Jing Cai,et al.  A Weighted Voting Classifier Based on Differential Evolution , 2014 .

[3]  G. Davey Smith,et al.  Supplementary Tables , 2009 .

[4]  Yung-Chang Chen,et al.  Ultrasonic Liver Tissues Classification by Fractal Feature Vector Based on M-band Wavelet Transform , 2001, IEEE Trans. Medical Imaging.

[5]  Kesari Verma,et al.  Fuzzy cluster based neural network classifier for classifying breast tumors in ultrasound images , 2016, Expert Syst. Appl..

[6]  D. Mittal,et al.  Computer-aided Characterization and Diagnosis of Diffuse Liver Diseases Based on Ultrasound Imaging , 2017, Ultrasonic imaging.

[7]  De-Shuang Huang,et al.  Cancer classification using Rotation Forest , 2008, Comput. Biol. Medicine.

[8]  Renato Campanini,et al.  Texture classification using invariant ranklet features , 2008, Pattern Recognit. Lett..

[9]  Hisham Tchelepi,et al.  Sonography of Diffuse Liver Disease , 2002, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[10]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[12]  Jesús Ariel Carrasco-Ochoa,et al.  A new hybrid filter-wrapper feature selection method for clustering based on ranking , 2016, Neurocomputing.

[13]  Hamid Behnam,et al.  Breast cancer detection in automated 3D breast ultrasound using iso‐contours and cascaded RUSBoosts , 2017, Ultrasonics.

[14]  Roger Williams Global challenges in liver disease , 2006, Hepatology.

[15]  Enrico Blanzieri,et al.  A multiple classifier system for early melanoma diagnosis , 2003, Artif. Intell. Medicine.

[16]  S. Nedevschi,et al.  Usefulness of textural analysis as a tool for noninvasive liver fibrosis staging , 2011, Journal of Medical Ultrasonics.

[17]  Zhu-Hong You,et al.  An improved sequence-based prediction protocol for protein-protein interactions using amino acids substitution matrix and rotation forest ensemble classifiers , 2017, Neurocomputing.

[18]  David Dagan Feng,et al.  Classification of Medical Images in the Biomedical Literature by Jointly Using Deep and Handcrafted Visual Features , 2018, IEEE Journal of Biomedical and Health Informatics.

[19]  R. Allan,et al.  Accuracy of ultrasound to identify chronic liver disease. , 2010, World journal of gastroenterology.

[20]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Akin Özçift,et al.  SVM Feature Selection Based Rotation Forest Ensemble Classifiers to Improve Computer-Aided Diagnosis of Parkinson Disease , 2011, Journal of Medical Systems.

[22]  Abhay Chowdhary,et al.  Artificial Neural Network Application in the Diagnosis of Disease Conditions with Liver Ultrasound Images , 2014, Adv. Bioinformatics.

[23]  I. Masroor,et al.  Evaluation of Chronic Liver Disease: Does Ultrasound Scoring Criteria Help? , 2013, International journal of chronic diseases.

[24]  U. Rajendra Acharya,et al.  Automated detection of coronary artery disease using different durations of ECG segments with convolutional neural network , 2017, Knowl. Based Syst..

[25]  Hui Li,et al.  Digital mammographic tumor classification using transfer learning from deep convolutional neural networks , 2016, Journal of medical imaging.

[26]  Savita Gupta,et al.  An information fusion based method for liver classification using texture analysis of ultrasound images , 2014, Inf. Fusion.

[27]  Cheng-Chi Wu,et al.  Evolution-based hierarchical feature fusion for ultrasonic liver tissue characterization. , 2013, IEEE journal of biomedical and health informatics.

[28]  Wagner Coelho A. Pereira,et al.  Analysis of Co-Occurrence Texture Statistics as a Function of Gray-Level Quantization for Classifying Breast Ultrasound , 2012, IEEE Transactions on Medical Imaging.

[29]  Cagatay CATAL,et al.  A sentiment classification model based on multiple classifiers , 2017, Appl. Soft Comput..

[30]  José Silvestre Silva,et al.  Classifier Approaches for Liver Steatosis using Ultrasound Images , 2012 .

[31]  Carlo Cattani,et al.  Application of Local Fractional Series Expansion Method to Solve Klein-Gordon Equations on Cantor Sets , 2014 .

[32]  D. Koutsouris,et al.  Computer assisted characterization of diffused liver disease using image texture analysis techniques on B-scan images , 1997, 1997 IEEE Nuclear Science Symposium Conference Record.

[33]  Javier Fernández,et al.  A new survival status prediction system for severe trauma patients based on a multiple classifier system , 2017, Comput. Methods Programs Biomed..

[34]  Andreas Uhl,et al.  Exploring Deep Learning and Transfer Learning for Colonic Polyp Classification , 2016, Comput. Math. Methods Medicine.

[35]  Wen-Li Lee,et al.  An ensemble-based data fusion approach for characterizing ultrasonic liver tissue , 2013, Appl. Soft Comput..

[36]  Zhe Li,et al.  A novel computer-aided diagnosis system for breast MRI based on feature selection and ensemble learning , 2017, Comput. Biol. Medicine.

[37]  Yung-Chang Chen,et al.  Texture features for classification of ultrasonic liver images , 1992, IEEE Trans. Medical Imaging.

[38]  Konstantina S. Nikita,et al.  Differential diagnosis of CT focal liver lesions using texture features, feature selection and ensemble driven classifiers , 2007, Artif. Intell. Medicine.

[39]  Emilio Corchado,et al.  A survey of multiple classifier systems as hybrid systems , 2014, Inf. Fusion.

[40]  C. Ding,et al.  Gene selection algorithm by combining reliefF and mRMR , 2008, BMC Genomics.

[41]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[42]  Kweku-Muata Osei-Bryson,et al.  Exploration of a hybrid feature selection algorithm , 2003, J. Oper. Res. Soc..

[43]  K. Raghesh Krishnan,et al.  Hybrid approach to classification of focal and diffused liver disorders using ultrasound images with wavelets and texture features , 2017, IET Image Process..

[44]  Jeon-Hor Chen,et al.  Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis , 2013, IEEE Transactions on Medical Imaging.

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[47]  Sergiu Nedevschi,et al.  Abdominal Tumor Characterization and Recognition Using Superior-Order Cooccurrence Matrices, Based on Ultrasound Images , 2012, Comput. Math. Methods Medicine.

[48]  Ming-Huwi Horng,et al.  An ultrasonic image evaluation system for assessing the severity of chronic liver disease , 2007, Comput. Medical Imaging Graph..

[49]  Yang Li,et al.  Melanoma Classification on Dermoscopy Images Using a Neural Network Ensemble Model , 2017, IEEE Transactions on Medical Imaging.

[50]  José Silvestre Silva,et al.  Detection of pathologic liver using ultrasound images , 2014, Biomed. Signal Process. Control..

[51]  Jitendra Virmani,et al.  SVM-Based Characterization of Liver Ultrasound Images Using Wavelet Packet Texture Descriptors , 2013, Journal of Digital Imaging.

[52]  Vinod Kumar,et al.  Enhancement of the ultrasound images by modified anisotropic diffusion method , 2010, Medical & Biological Engineering & Computing.

[53]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[54]  Rui Tato Marinho,et al.  Classification and Staging of Chronic Liver Disease From Multimodal Data , 2013, IEEE Transactions on Biomedical Engineering.

[55]  Jian Yang,et al.  Feature fusion: parallel strategy vs. serial strategy , 2003, Pattern Recognit..

[56]  Renato Campanini,et al.  A Ranklet-Based CAD for Digital Mammography , 2006, Digital Mammography / IWDM.

[57]  Kazuhiko Hamamoto,et al.  Discrimination of Breast Tumors in Ultrasonic Images Using an Ensemble Classifier Based on the AdaBoost Algorithm With Feature Selection , 2010, IEEE Transactions on Medical Imaging.

[58]  Arif Gulten,et al.  A Robust Multi-Class Feature Selection Strategy Based on Rotation Forest Ensemble Algorithm for Diagnosis of Erythemato-Squamous Diseases , 2012, Journal of medical systems.

[59]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[60]  Yung-Chang Chen,et al.  Ultrasonic liver tissue characterization by feature fusion , 2012, Expert Syst. Appl..