Automated Classification of the Tympanic Membrane Using a Convolutional Neural Network

Precise evaluation of the tympanic membrane (TM) is required for accurate diagnosis of middle ear diseases. However, making an accurate assessment is sometimes difficult. Artificial intelligence is often employed for image processing, especially for performing high level analysis such as image classification, segmentation and matching. In particular, convolutional neural networks (CNNs) are increasingly used in medical image recognition. This study demonstrates the usefulness and reliability of CNNs in recognizing the side and perforation of TMs in medical images. CNN was constructed with typically six layers. After random assignment of the available images to the training, validation and test sets, training was performed. The accuracy of the CNN model was consequently evaluated using a new dataset. A class activation map (CAM) was used to evaluate feature extraction. The CNN model accuracy of detecting the TM side in the test dataset was 97.9%, whereas that of detecting the presence of perforation was 91.0%. The side of the TM and the presence of a perforation affect the activation sites. The results show that CNNs can be a useful tool for classifying TM lesions and identifying TM sides. Further research is required to consider real-time analysis and to improve classification accuracy.

[1]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[2]  Panos Liatsis,et al.  Application of Convolutional Neural Networks for Automated Ulcer Detection in Wireless Capsule Endoscopy Images , 2019, Sensors.

[3]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[4]  Shrishail T. Patil,et al.  Detection of Alzheimers Disease from MRI using Convolutional Neural Network with Tensorflow , 2018, ArXiv.

[5]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[6]  S. Han,et al.  Classification of the Clinical Images for Benign and Malignant Cutaneous Tumors Using a Deep Learning Algorithm. , 2018, The Journal of investigative dermatology.

[7]  Sewon Kim,et al.  Fine-Grain Segmentation of the Intervertebral Discs from MR Spine Images Using Deep Convolutional Neural Networks: BSU-Net , 2018, Applied sciences.

[8]  Nazhat Taj-Schaal,et al.  Digital otoscopy versus microscopy: How correct and confident are ear experts in their diagnoses? , 2018, Journal of telemedicine and telecare.

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[11]  Hamid R Djalilian,et al.  Smartphone-Enabled Otoscopy in Neurotology/Otology , 2017, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[12]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Pa-Chun Wang,et al.  A hybrid feature-based segmentation and classification system for the computer aided self-diagnosis of otitis media , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Neil J. Joshi,et al.  Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks , 2017, JAMA ophthalmology.

[15]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[16]  Muhammad Shazam Kasher Otitis Media Analysis - An Automated Feature Extraction and Image Classification System , 2018 .

[17]  Constantin Vertan,et al.  Automatic pediatric otitis detection by classification of global image features , 2011, 2011 E-Health and Bioengineering Conference (EHB).

[18]  M. Pichichero,et al.  Assessing diagnostic accuracy and tympanocentesis skills in the management of otitis media. , 2001, Archives of pediatrics & adolescent medicine.

[19]  M. Lo,et al.  Development of an Automatic Diagnostic Algorithm for Pediatric Otitis Media. , 2018, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[20]  M. Pichichero,et al.  Spectral gradient acoustic reflectometry for the detection of middle ear effusion by pediatricians and parents. , 1998, The Pediatric infectious disease journal.

[21]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[22]  James M. Brown,et al.  Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks , 2018, JAMA ophthalmology.

[23]  Jelena Kovacevic,et al.  Automated Diagnosis of Otitis Media: Vocabulary and Grammar , 2013, Int. J. Biomed. Imaging.

[24]  Paolo Campisi,et al.  Otoscopy simulation training in a classroom setting: A novel approach to teaching otoscopy to medical students , 2014, The Laryngoscope.

[25]  R. Rosenfeld,et al.  The diagnosis and management of acute otitis media. , 2013, Pediatrics.

[26]  Eduard Schreibmann,et al.  Convolutional neural networks for the detection of diseased hearts using CT images and left atrium patches , 2018, Medical Imaging.