HMIC: Hierarchical Medical Image Classification, A Deep Learning Approach

Image classification is central to the big data revolution in medicine. Improved information processing methods for diagnosis and classification of digital medical images have shown to be successful via deep learning approaches. As this field is explored, there are limitations to the performance of traditional supervised classifiers. This paper outlines an approach that is different from the current medical image classification tasks that view the issue as multi-class classification. We performed a hierarchical classification using our Hierarchical Medical Image classification (HMIC) approach. HMIC uses stacks of deep learning models to give particular comprehension at each level of the clinical picture hierarchy. For testing our performance, we use biopsy of the small bowel images that contain three categories in the parent level (Celiac Disease, Environmental Enteropathy, and histologically normal controls). For the child level, Celiac Disease Severity is classified into 4 classes (I, IIIa, IIIb, and IIIC).

[1]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[2]  Sana Syed,et al.  Environmental Enteric Dysfunction in Children: A Review , 2016 .

[3]  Kyung-shik Shin,et al.  Hierarchical convolutional neural networks for fashion image classification , 2019, Expert Syst. Appl..

[4]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[5]  Naomi S. Altman,et al.  Points of Significance: Classification evaluation , 2016, Nature Methods.

[6]  Raimondo Schettini,et al.  Error-Tolerant Color Rendering for Digital Cameras , 2014, Journal of Mathematical Imaging and Vision.

[7]  Donald E. Brown,et al.  RMDL: Random Multimodel Deep Learning for Classification , 2018, ICISDM '18.

[8]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[9]  R. Wüthrich,et al.  Secreted Klotho and FGF23 in chronic kidney disease Stage 1 to 5: a sequence suggested from a cross-sectional study. , 2013, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[10]  Rashidul Haque,et al.  Environmental Enteropathy, Oral Vaccine Failure and Growth Faltering in Infants in Bangladesh , 2015, EBioMedicine.

[11]  Donald E. Brown,et al.  Hierarchical Deep Convolutional Neural Networks for Multi-category Diagnosis of Gastrointestinal Disorders on Histopathological Images , 2020, ArXiv.

[12]  Donald E. Brown,et al.  Diagnosis of Celiac Disease and Environmental Enteropathy on Biopsy Images Using Color Balancing on Convolutional Neural Networks , 2019, Proceedings of the Future Technologies Conference (FTC) 2019. Future Technologies Conference.

[13]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[14]  Robinson Piramuthu,et al.  HD-CNN: Hierarchical Deep Convolutional Neural Network for Image Classification , 2014, ArXiv.

[15]  Kamran Kowsari,et al.  Weighted Unsupervised Learning for 3D Object Detection , 2015, ArXiv.

[16]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Kamran Kowsari.  Diagnosis and Analysis of Celiac Disease and Environmental Enteropathy on Biopsy Images using Deep Learning Approaches , 2020, ArXiv.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  James K. Hahn,et al.  Automatic, Real Time, Unsupervised Spatio-temporal 3D Object Detection Using RGB-D Cameras , 2015, 2015 19th International Conference on Information Visualisation.

[21]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[22]  Marcus Liwicki,et al.  Page segmentation of historical document images with convolutional autoencoders , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[23]  Donald E. Brown,et al.  Text Classification Algorithms: A Survey , 2019, Inf..

[24]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[25]  Meena Mahajan,et al.  The Planar k-means Problem is NP-hard I , 2009 .

[26]  Zhongfei Zhang,et al.  Doubly Convolutional Neural Networks , 2016, NIPS.

[27]  A. Fischer,et al.  Hematoxylin and eosin staining of tissue and cell sections. , 2008, CSH protocols.

[28]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[29]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[30]  Sana Syed,et al.  Environmental Enteric Dysfunction in Children , 2016, Journal of pediatric gastroenterology and nutrition.

[31]  Yiming Yang,et al.  An Evaluation of Statistical Approaches to Text Categorization , 1999, Information Retrieval.

[32]  Bethany A. Teachman,et al.  Identification of Imminent Suicide Risk Among Young Adults using Text Messages , 2018, CHI.

[33]  Donald E. Brown,et al.  An Improvement of Data Classification Using Random Multimodel Deep Learning (RMDL) , 2018, International Journal of Machine Learning and Computing.

[34]  Hong Liang,et al.  Text feature extraction based on deep learning: a review , 2017, EURASIP Journal on Wireless Communications and Networking.

[35]  Keerthana Prasad,et al.  Comparison of traditional image processing and deep learning approaches for classification of white blood cells in peripheral blood smear images , 2019, Biocybernetics and Biomedical Engineering.

[36]  James Anderson,et al.  An Introduction to Routine and Special Staining , 2012 .

[37]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[38]  Susan T. Dumais,et al.  Hierarchical classification of Web content , 2000, SIGIR '00.

[39]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[40]  Michael Bain,et al.  B-CNN: Branch Convolutional Neural Network for Hierarchical Classification , 2017, ArXiv.

[41]  Donald E. Brown,et al.  CeliacNet: Celiac Disease Severity Diagnosis on Duodenal Histopathological Images Using Deep Residual Networks , 2019, 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[42]  A. Fasano,et al.  Current approaches to diagnosis and treatment of celiac disease: an evolving spectrum. , 2001, Gastroenterology.

[43]  Xiaogang Wang,et al.  Medical image classification with convolutional neural network , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[44]  Paolo Napoletano,et al.  Improving CNN-Based Texture Classification by Color Balancing , 2017, J. Imaging.

[45]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[46]  Wei Wang,et al.  Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[47]  James H. Harrison,et al.  Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record , 2018, IEEE Access.

[48]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[49]  Nidhi Ranjan,et al.  Hierarchical Approach for Breast Cancer Histopathology Images Classification , 2018 .

[50]  K. Giersiepen,et al.  European Society for Pediatric Gastroenterology, Hepatology, and Nutrition Guidelines for the Diagnosis of Coeliac Disease , 2012, Journal of pediatric gastroenterology and nutrition.

[51]  Donald E. Brown,et al.  HDLTex: Hierarchical Deep Learning for Text Classification , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[52]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[53]  Min Guo,et al.  Soft-sensor Method for Surface Water Qualities Based on Fuzzy Neural Network , 2019, 2019 Chinese Control Conference (CCC).

[54]  Maryam Yammahi,et al.  Construction of FuzzyFind Dictionary using Golay Coding Transformation for Searching Applications , 2015, International Journal of Advanced Computer Science and Applications.