Computer-aided diagnosis of external and middle ear conditions: A machine learning approach

In medicine, a misdiagnosis or the absence of specialists can affect the patient’s health, leading to unnecessary tests and increasing the costs of healthcare. In particular, the lack of specialists in otolaryngology in third world countries forces patients to seek medical attention from general practitioners, whom might not have enough training and experience for making correct diagnosis in this field. To tackle this problem, we propose and test a computer-aided system based on machine learning models and image processing techniques for otoscopic examination, as a support for a more accurate diagnosis of ear conditions at primary care before specialist referral; in particular, for myringosclerosis, earwax plug, and chronic otitis media. To characterize the tympanic membrane and ear canal for each condition, we implemented three different feature extraction methods: color coherence vector, discrete cosine transform, and filter bank. We also considered three machine learning algorithms: support vector machine (SVM), k-nearest neighbor (k-NN) and decision trees to develop the ear condition predictor model. To conduct the research, our database included 160 images as testing set and 720 images as training and validation sets of 180 patients. We repeatedly trained the learning models using the training dataset and evaluated them using the validation dataset to thus obtain the best feature extraction method and learning model that produce the highest validation accuracy. The results showed that the SVM and k-NN presented the best performance followed by decision trees model. Finally, we performed a classification stage –i.e., diagnosis– using testing data, where the SVM model achieved an average classification accuracy of 93.9%, average sensitivity of 87.8%, average specificity of 95.9%, and average positive predictive value of 87.7%. The results show that this system might be used for general practitioners as a reference to make better decisions in the ear pathologies diagnosis.

[1]  Ping Chen,et al.  Generalized Discrete Cosine Transform , 2009, 2009 Pacific-Asia Conference on Circuits, Communications and Systems.

[2]  David G. Stork,et al.  Pattern Classification , 1973 .

[3]  Josef Kittler,et al.  A Comparative Study of Hough Transform Methods for Circle Finding , 1989, Alvey Vision Conference.

[4]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2005, International Journal of Computer Vision.

[5]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[6]  Timothy C. Y. Chan,et al.  Automated Treatment Planning in Radiation Therapy using Generative Adversarial Networks , 2018, MLHC.

[7]  Chongwon Pae,et al.  Automated diagnosis of ear disease using ensemble deep learning with a big otoendoscopy image database , 2019, EBioMedicine.

[8]  Nazhat Taj-Schaal,et al.  Digital otoscopy versus microscopy: How correct and confident are ear experts in their diagnoses? , 2018, Journal of telemedicine and telecare.

[9]  Metin Nafi Gürcan,et al.  Detection of eardrum abnormalities using ensemble deep learning approaches , 2018, Medical Imaging.

[10]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[11]  Jesús Chamorro-Martínez,et al.  Diatom autofocusing in brightfield microscopy: a comparative study , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[12]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[13]  Constantin Vertan,et al.  Automatic pediatric otitis detection by classification of global image features , 2011, 2011 E-Health and Bioengineering Conference (EHB).

[14]  Chia-Ping Huang,et al.  A Depth-First Search Algorithm Based Otoscope Application for Real-Time Otitis Media Image Interpretation , 2017, 2017 18th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT).

[15]  F. Chung,et al.  Connected Components in Random Graphs with Given Expected Degree Sequences , 2002 .

[16]  Hermanus Carel Myburgh,et al.  Towards low cost automated smartphone- and cloud-based otitis media diagnosis , 2018, Biomed. Signal Process. Control..

[17]  Christos Davatzikos,et al.  Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme , 2009, Magnetic resonance in medicine.

[18]  Giovanni Maria Farinella,et al.  Semantic segmentation of images exploiting DCT based features and random forest , 2016, Pattern Recognit..

[19]  E TamaraBarría,et al.  Permanencia laboral de otorrinolaringólogos en el servicio público luego de egresar de la especialidad y factores asociados a ésta Permanence of otolaryngologists in public service after graduating from the specialty and factors associated with this , 2013 .

[20]  F. Lasheras,et al.  Survival model in oral squamous cell carcinoma based on clinicopathological parameters, molecular markers and support vector machines , 2013, Expert Syst. Appl..

[21]  Adrian Tsang,et al.  Machine Learning for Biomedical Literature Triage , 2014, PloS one.

[22]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[23]  Cömert Zafer,et al.  Fusing fine-tuned deep features for recognizing different tympanic membranes , 2020 .

[24]  Robert H Eikelboom,et al.  Clinical decision support systems and computer-aided diagnosis in otology , 2007, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[25]  Sajjad Waheed,et al.  An Automatic Gastrointestinal Polyp Detection System in Video Endoscopy Using Fusion of Color Wavelet and Convolutional Neural Network Features , 2017, Int. J. Biomed. Imaging.

[26]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[27]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[28]  Seung-Ho Choi,et al.  Automated Classification of the Tympanic Membrane Using a Convolutional Neural Network , 2019, Applied Sciences.

[29]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[30]  Ajay Shah,et al.  A machine learning approach for the prediction of pulmonary hypertension , 2019, PloS one.

[31]  Jae-Jin Song,et al.  The semantic segmentation approach for normal and pathologic tympanic membrane using deep learning , 2019, bioRxiv.

[32]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[33]  Michelle Viscaino,et al.  Machine learning for computer-aided polyp detection using wavelets and content-based image , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  Robert M. Nishikawa,et al.  A study on several Machine-learning methods for classification of Malignant and benign clustered microcalcifications , 2005, IEEE Transactions on Medical Imaging.

[35]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[36]  D. Bing,et al.  Predicting the hearing outcome in sudden sensorineural hearing loss via machine learning models , 2018, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.

[37]  Klajdi Qirko,et al.  A machine learning approach to triaging patients with chronic obstructive pulmonary disease , 2017, PloS one.

[38]  María P. Trujillo,et al.  Classification of cardiovascular tissues using LBP based descriptors and a cascade SVM , 2017, Comput. Methods Programs Biomed..

[39]  Mark A. Eckert,et al.  Classifying Human Audiometric Phenotypes of Age-Related Hearing Loss from Animal Models , 2013, Journal of the Association for Research in Otolaryngology.

[40]  John S Oghalai,et al.  ELHnet: a convolutional neural network for classifying cochlear endolymphatic hydrops imaged with optical coherence tomography. , 2017, Biomedical optics express.

[41]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[42]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[43]  Stephen R. Marsland,et al.  Machine Learning - An Algorithmic Perspective , 2009, Chapman and Hall / CRC machine learning and pattern recognition series.

[44]  Dinggang Shen,et al.  Machine Learning in Medical Imaging , 2012, Lecture Notes in Computer Science.

[45]  Metin Nafi Gürcan,et al.  Autoscope: automated otoscopy image analysis to diagnose ear pathology and use of clinically motivated eardrum features , 2017, Medical Imaging.

[46]  Sejong Oh,et al.  Development of machine learning models for diagnosis of glaucoma , 2017, PloS one.

[47]  Bogdan Ionescu,et al.  Eardrum color content analysis in video-otoscopy images for the diagnosis support of pediatric otitis , 2011, ISSCS 2011 - International Symposium on Signals, Circuits and Systems.

[48]  Dinggang Shen,et al.  Morphological classification of brains via high-dimensional shape transformations and machine learning methods , 2004, NeuroImage.

[49]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[50]  Shih-Hau Fang,et al.  Detection of Pathological Voice Using Cepstrum Vectors: A Deep Learning Approach. , 2019, Journal of voice : official journal of the Voice Foundation.

[51]  Pa-Chun Wang,et al.  A hybrid feature-based segmentation and classification system for the computer aided self-diagnosis of otitis media , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  Matthew G. Crowson,et al.  A contemporary review of machine learning in otolaryngology–head and neck surgery , 2019, The Laryngoscope.

[53]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[54]  Damminda Alahakoon,et al.  Machine learning to support social media empowered patients in cancer care and cancer treatment decisions , 2018, PloS one.