Automated classification platform for the identification of otitis media using optical coherence tomography

The diagnosis and treatment of otitis media (OM), a common childhood infection, is a significant burden on the healthcare system. Diagnosis relies on observer experience via otoscopy, although for non-specialists or inexperienced users, accurate diagnosis can be difficult. In past studies, optical coherence tomography (OCT) has been used to quantitatively characterize disease states of OM, although with the involvement of experts to interpret and correlate image-based indicators of infection with clinical information. In this paper, a flexible and comprehensive framework is presented that automatically extracts features from OCT images, classifies data, and presents clinically relevant results in a user-friendly platform suitable for point-of-care and primary care settings. This framework was used to test the discrimination between OCT images of normal controls, ears with biofilms, and ears with biofilms and middle ear fluid (effusion). Predicted future performance of this classification platform returned promising results (90%+ accuracy) in various initial tests. With integration into patient healthcare workflow, users of all levels of medical experience may be able to collect OCT data and accurately identify the presence of middle ear fluid and/or biofilms.

[1]  Woodson S Jones,et al.  How helpful is pneumatic otoscopy in improving diagnostic accuracy? , 2003, Pediatrics.

[2]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[3]  Geraint Rees,et al.  Automated analysis of retinal imaging using machine learning techniques for computer vision , 2016, F1000Research.

[4]  Jeehyun Kim,et al.  Optical Coherence Tomography for the Diagnosis and Evaluation of Human Otitis Media , 2015, Journal of Korean medical science.

[5]  Nikhil Balram,et al.  Light field otoscope design for 3D in vivo imaging of the middle ear. , 2017, Biomedical optics express.

[6]  A. Samir,et al.  Machine learning for medical ultrasound: status, methods, and future opportunities , 2018, Abdominal Radiology.

[7]  Zhongping Chen,et al.  Imaging the Human Tympanic Membrane Using Optical Coherence Tomography In Vivo , 2008, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[8]  Dennis S. Poe,et al.  Clinical Practice Guideline: Otitis Media with Effusion (Update) , 2016, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[9]  Guillermo L. Monroy,et al.  Direct Analysis of Pathogenic Structures Affixed to the Tympanic Membrane during Chronic Otitis Media , 2018, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[10]  Michael V. McConnell,et al.  Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning , 2017, Nature Biomedical Engineering.

[11]  Stephen A. Boppart,et al.  Investigation of bacterial biofilm in the human middle ear using optical coherence tomography and acoustic measurements , 2013, Hearing Research.

[12]  Tahereh Marvdashti,et al.  Classification of basal cell carcinoma in human skin using machine learning and quantitative features captured by polarization sensitive optical coherence tomography. , 2016, Biomedical optics express.

[13]  Eduard Clotet,et al.  Measuring Gas Concentration and Wind Intensity in a Turbulent Wind Tunnel with a Mobile Robot , 2016, J. Sensors.

[14]  John P Birchall,et al.  Update on otitis media – prevention and treatment , 2014, Infection and drug resistance.

[15]  L S Chan,et al.  Diagnosis, natural history, and late effects of otitis media with effusion. , 2002, Evidence report/technology assessment.

[16]  P. Bossew,et al.  Machine learning methods as a tool to analyse incomplete or irregularly sampled radon time series data. , 2018, The Science of the total environment.

[17]  Rajendu Srivastava,et al.  Variation in costs among surgeons and hospitals in Pediatric tympanostomy tube placement , 2016, The Laryngoscope.

[18]  Stephen A. Boppart,et al.  Quantitative Pneumatic Otoscopy Using a Light-Based Ranging Technique , 2017, Journal of the Association for Research in Otolaryngology.

[19]  David B. Matchar,et al.  Options for Summarizing Medical Test Performance in the Absence of a “Gold Standard” -- Methods Guide for Medical Test Reviews , 2012 .

[20]  Michael J. A. Girard,et al.  A Deep Learning Approach to Digitally Stain Optical Coherence Tomography Images of the Optic Nerve Head , 2017, Investigative ophthalmology & visual science.

[21]  Jimi L. Brandon,et al.  Automated classification of optical coherence tomography images for the diagnosis of oral malignancy in the hamster cheek pouch. , 2014, Journal of biomedical optics.

[22]  De Wet Swanepoel,et al.  Remote evaluation of video-otoscopy recordings in an unselected pediatric population with an otitis media scale. , 2014, International journal of pediatric otorhinolaryngology.

[23]  Richard M Rosenfeld,et al.  Clinical Practice Guideline (Update): Earwax (Cerumen Impaction) , 2017, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[24]  Stephen A. Boppart,et al.  Sensor-Based Technique for Manually Scanned Hand-Held Optical Coherence Tomography Imaging , 2017, J. Sensors.

[25]  Cac T. Nguyen,et al.  Noninvasive in vivo optical detection of biofilm in the human middle ear , 2012, Proceedings of the National Academy of Sciences.

[26]  Garth D Ehrlich,et al.  Direct detection of bacterial biofilms on the middle-ear mucosa of children with chronic otitis media. , 2006, JAMA.

[27]  Rahul Seth,et al.  Ultrasound characterization of middle ear effusion. , 2013, American journal of otolaryngology.

[28]  Roshan Dsouza,et al.  Economical and compact briefcase spectral-domain optical coherence tomography system for primary care and point-of-care applications , 2018, Journal of biomedical optics.

[29]  Guillermo L. Monroy,et al.  Rapid diagnosis and differentiation of microbial pathogens in otitis media with a combined Raman spectroscopy and low-coherence interferometry probe: toward in vivo implementation , 2016, Journal of biomedical optics.

[30]  Heather L. Burrows,et al.  Otitis media: diagnosis and treatment. , 2013, American family physician.

[31]  R. Rosenfeld,et al.  The diagnosis and management of acute otitis media. , 2013, Pediatrics.

[32]  Metin Nafi Gürcan,et al.  Detection of eardrum abnormalities using ensemble deep learning approaches , 2018, Medical Imaging.

[33]  Paul Stoodley,et al.  Bacterial biofilms: from the Natural environment to infectious diseases , 2004, Nature Reviews Microbiology.

[34]  Marc Rubinstein,et al.  Optical Coherence Tomography of Cholesteatoma , 2010, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[35]  Yue Wu,et al.  Deep-Learning Based, Automated Segmentation of Macular Edema in Optical Coherence Tomography , 2017, bioRxiv.

[36]  Roshan Dsouza,et al.  Pneumatic low-coherence interferometry otoscope to quantify tympanic membrane mobility and middle ear pressure. , 2018, Biomedical optics express.

[37]  S. Schaffer,et al.  Improving Wait Times and Patient Satisfaction in Primary Care , 2013, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[38]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[39]  Paul Stoodley,et al.  Evolving concepts in biofilm infections , 2009, Cellular microbiology.

[40]  Jelena Kovacevic,et al.  Automated Diagnosis of Otitis Media: Vocabulary and Grammar , 2013, Int. J. Biomed. Imaging.

[41]  James M. Coticchia,et al.  Grand Challenges in Pediatric Otolaryngology , 2013, Front. Pediatr..

[42]  L H Kunze,et al.  Effect of chronic otitis media on language and speech development. , 1969, Pediatrics.

[43]  John C Carey,et al.  Academy of Pediatric Education and Leadership: Preparing Leaders for Educational Innovation , 2011, Pediatrics.

[44]  H. Lemij,et al.  Depth-resolved model-based reconstruction of attenuation coefficients in optical coherence tomography. , 2013, Biomedical optics express.

[45]  Michael Chen,et al.  New Paradigms in the Pathogenesis of Otitis Media in Children , 2013, Front. Pediatr..

[46]  R. Rosenfeld,et al.  Otitis media , 1994, The Lancet.

[47]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[48]  Guillermo L. Monroy,et al.  Noninvasive depth‐resolved optical measurements of the tympanic membrane and middle ear for differentiating otitis media , 2015, The Laryngoscope.

[49]  Stephen A. Boppart,et al.  Non-invasive optical interferometry for the assessment of biofilm growth in the middle ear , 2010, Biomedical optics express.

[50]  Daniel J. Shapiro,et al.  Antibiotic Prescribing in Ambulatory Pediatrics in the United States , 2011, Pediatrics.

[51]  A. Cerasa,et al.  Machine learning on brain MRI data for differential diagnosis of Parkinson's disease and Progressive Supranuclear Palsy , 2014, Journal of Neuroscience Methods.

[52]  M. Alan Brookhart,et al.  Trends in Antibiotic Treatment of Acute Otitis Media and Treatment Failure in Children, 2000–2011 , 2013, PloS one.

[53]  C. Guilhen,et al.  Biofilm dispersal: multiple elaborate strategies for dissemination of bacteria with unique properties , 2017, Molecular microbiology.

[54]  Miia K Laine,et al.  Tympanometry in Discrimination of Otoscopic Diagnoses in Young Ambulatory Children , 2012, The Pediatric infectious disease journal.

[55]  G. Take,et al.  Bacterial Biofilm Formation in the Middle-Ear Mucosa of Chronic Otitis Media Patients , 2013, Indian Journal of Otolaryngology and Head & Neck Surgery.

[56]  Tulio A. Valdez,et al.  Using the shortwave infrared to image middle ear pathologies , 2016, Proceedings of the National Academy of Sciences.

[57]  Richard A. Strugnell,et al.  Successful treatment of biofilm infections using shock waves combined with antibiotic therapy , 2015, Scientific Reports.

[58]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[59]  N. Høiby,et al.  Strategies for combating bacterial biofilm infections , 2014, International Journal of Oral Science.

[60]  Guillermo L. Monroy,et al.  Non‐invasive optical assessment of viscosity of middle ear effusions in otitis media , 2017, Journal of biophotonics.

[61]  Roshan Dsouza,et al.  In vivo detection of nanometer-scale structural changes of the human tympanic membrane in otitis media , 2018, Scientific Reports.

[62]  Kenneth W. Bayles,et al.  Staphylococcus aureus Biofilms Prevent Macrophage Phagocytosis and Attenuate Inflammation In Vivo , 2011, The Journal of Immunology.

[63]  Aaron Y. Lee,et al.  Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration , 2016, bioRxiv.

[64]  Miia K Laine,et al.  Acoustic Reflectometry in Discrimination of Otoscopic Diagnoses in Young Ambulatory Children , 2012, The Pediatric infectious disease journal.

[65]  Hermanus C. Myburgh,et al.  Otitis Media Diagnosis for Developing Countries Using Tympanic Membrane Image-Analysis , 2016, EBioMedicine.

[66]  Aaron Y. Lee,et al.  Reply. , 2016, Ophthalmology. Retina.

[67]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[68]  Thomas A. Trikalinos,et al.  Chapter 9: Options for Summarizing Medical Test Performance in the Absence of a “Gold Standard” , 2012, Journal of General Internal Medicine.

[69]  F. Cheriet,et al.  Deep feature learning for automatic tissue classification of coronary artery using optical coherence tomography. , 2017, Biomedical optics express.

[70]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[71]  Martin Villiger,et al.  Automatic classification of atherosclerotic plaques imaged with intravascular OCT. , 2016, Biomedical optics express.

[72]  Gregory S. Corrado,et al.  Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning , 2017, Nature Biomedical Engineering.

[73]  Guillermo L. Monroy,et al.  Noninvasive in vivo optical coherence tomography tracking of chronic otitis media in pediatric subjects after surgical intervention , 2017, Journal of biomedical optics.

[74]  Scott J. Hultgren,et al.  Precision antimicrobial therapeutics: the path of least resistance? , 2018, npj Biofilms and Microbiomes.

[75]  Geraint Rees,et al.  Automated analysis of retinal imaging using machine learning techniques for computer vision , 2016, F1000Research.

[76]  M. Pichichero,et al.  Assessing diagnostic accuracy and tympanocentesis skills in the management of otitis media. , 2001, Archives of pediatrics & adolescent medicine.

[77]  Mario Vaneechoutte,et al.  Haemophilus influenzae biofilm formation in chronic otitis media with effusion , 2016, European Archives of Oto-Rhino-Laryngology.

[78]  Metin Nafi Gürcan,et al.  Autoscope: automated otoscopy image analysis to diagnose ear pathology and use of clinically motivated eardrum features , 2017, Medical Imaging.

[79]  Mirian Domenech,et al.  Biofilm Formation Avoids Complement Immunity and Phagocytosis of Streptococcus pneumoniae , 2013, Infection and Immunity.

[80]  Waleed M. Abuzeid,et al.  Biofilms in chronic rhinosinusitis: Pathophysiology and therapeutic strategies , 2016, World journal of otorhinolaryngology - head and neck surgery.

[81]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[82]  I. Brook,et al.  Otitis media. , 2012, Future microbiology.

[83]  Rebecca Richards-Kortum,et al.  Optical imaging with a high‐resolution microendoscope to identify cholesteatoma of the middle ear , 2013, The Laryngoscope.

[84]  V. Caron,et al.  United states. , 2018, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[85]  M. L.,et al.  Low-cost hand-held probe for depth-resolved low-coherence interferometry , 2016 .