Recent Advances in the Application of Artificial Intelligence in Otorhinolaryngology-Head and Neck Surgery

This study presents an up-to-date survey of the use of artificial intelligence (AI) in the field of otorhinolaryngology, considering opportunities, research challenges, and research directions. We searched PubMed, the Cochrane Central Register of Controlled Trials, Embase, and the Web of Science. We initially retrieved 458 articles. The exclusion of non-English publications and duplicates yielded a total of 90 remaining studies. These 90 studies were divided into those analyzing medical images, voice, medical devices, and clinical diagnoses and treatments. Most studies (42.2%, 38/90) used AI for image-based analysis, followed by clinical diagnoses and treatments (24 studies). Each of the remaining two subcategories included 14 studies. Machine learning and deep learning have been extensively applied in the field of otorhinolaryngology. However, the performance of AI models varies and research challenges remain.

[1]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[2]  D T Freeman,et al.  Computer recognition of brain stem auditory evoked potential wave V by a neural network. , 1992, The Annals of otology, rhinology, and laryngology.

[3]  Jean-Charles Pomerol,et al.  Artificial intelligence and human decision making , 1997 .

[4]  P.C. Loizou,et al.  A neural network model for optimizing vowel recognition by cochlear implant listeners , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Yuan-Ting Zhang,et al.  The application of bionic wavelet transform to speech signal processing in cochlear implants using neural network simulations , 2002, IEEE Trans. Biomed. Eng..

[6]  John C Middlebrooks,et al.  Auditory cortical images of cochlear-implant stimuli: coding of stimulus channel and current level. , 2002, Journal of neurophysiology.

[7]  Rolf Unbehauen,et al.  An application of mapping neural networks and a digital signal processor for cochlear neuroprostheses , 1993, Biological Cybernetics.

[8]  Hung Thai-Van,et al.  Automatic analysis of auditory nerve electrically evoked compound action potential with an artificial neural network , 2004, Artif. Intell. Medicine.

[9]  Thomas Lenarz,et al.  Clinical Results of AutoNRT,™ a Completely Automatic ECAP Recording System for Cochlear Implants , 2007, Ear and hearing.

[10]  Matthijs Killian,et al.  AutoNRTTM: An automated system that measures ECAP thresholds with the Nucleus® FreedomTM cochlear implant via machine intelligence , 2007, Artif. Intell. Medicine.

[11]  C. James,et al.  Objective source selection in Blind Source Separation of AEPs in children with Cochlear Implants , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Andreas Büchner,et al.  Clinical use of a system for the automated recording and analysis of electrically evoked compound action potentials (ECAPs) in cochlear implant patients , 2010, Acta oto-laryngologica.

[13]  J. Ding,et al.  Inroads Toward Robot-Assisted Cochlear Implant Surgery Using Steerable Electrode Arrays , 2010, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[14]  P. Densen.  Challenges and opportunities facing medical education. , 2011, Transactions of the American Clinical and Climatological Association.

[15]  Peter A. Flach,et al.  Machine Learning - The Art and Science of Algorithms that Make Sense of Data , 2012 .

[16]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[17]  Leslie M Collins,et al.  Using channel-specific statistical models to detect reverberation in cochlear implant stimuli. , 2013, The Journal of the Acoustical Society of America.

[18]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[19]  H. Mirzadeh,et al.  Dexamethasone‐releasing cochlear implant coatings: application of artificial neural networks for modelling of formulation parameters and drug release profile , 2013, The Journal of pharmacy and pharmacology.

[20]  Angel Ramos-Miguel,et al.  Use of data mining to predict significant factors and benefits of bilateral cochlear implantation , 2015, European Archives of Oto-Rhino-Laryngology.

[21]  H. Mirzadeh,et al.  Artificial neural networks for bilateral prediction of formulation parameters and drug release profiles from cochlear implant coatings fabricated as porous monolithic devices based on silicone rubber , 2014, The Journal of pharmacy and pharmacology.

[22]  Jieun Kim,et al.  Decoding Multiple Sound Categories in the Human Temporal Cortex Using High Resolution fMRI , 2015, PloS one.

[23]  DeLiang Wang,et al.  An algorithm to increase speech intelligibility for hearing-impaired listeners in novel segments of the same noise type. , 2015, The Journal of the Acoustical Society of America.

[24]  Ye Chen,et al.  A semi‐supervised Support Vector Machine model for predicting the language outcomes following cochlear implantation based on pre‐implant brain fMRI imaging , 2015, Brain and behavior.

[25]  P. Lambin,et al.  Radiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck Cancer , 2015, Front. Oncol..

[26]  H. Kita,et al.  Symptom-Based Clustering in Chronic Rhinosinusitis Relates to History of Aspirin Sensitivity and Postsurgical Outcomes. , 2015, The journal of allergy and clinical immunology. In practice.

[27]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[28]  V. Manchaiah,et al.  Disease Profiling for Computerized Peer Support of Ménière's Disease , 2015, JMIR rehabilitation and assistive technologies.

[29]  V. Ramakrishnan,et al.  Identification of chronic rhinosinusitis phenotypes using cluster analysis , 2015, International forum of allergy & rhinology.

[30]  H. Khanna Nehemiah,et al.  A clinical decision support system for diagnosis of Allergic Rhinitis based on intradermal skin tests , 2015, Comput. Biol. Medicine.

[31]  Richard F. Lewis,et al.  Clinical vestibular testing assessed with machine-learning algorithms. , 2015, JAMA otolaryngology-- head & neck surgery.

[32]  V. Ramakrishnan,et al.  Cluster analysis and prediction of treatment outcomes for chronic rhinosinusitis. , 2016, The Journal of allergy and clinical immunology.

[33]  Yu-Hsiang Wu,et al.  Predicting three-month and 12-month post-fitting real-world hearing-aid outcome using pre-fitting acceptable noise level (ANL) , 2016, International journal of audiology.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  C. Adnane,et al.  Using preoperative unsupervised cluster analysis of chronic rhinosinusitis to inform patient decision and endoscopic sinus surgery outcome , 2017, European Archives of Oto-Rhino-Laryngology.

[36]  Á. Ramos de Miguel,et al.  Cochlear Implant Evaluation: Prognosis Estimation by Data Mining System. , 2016, The journal of international advanced otology.

[37]  DeLiang Wang,et al.  Large-scale training to increase speech intelligibility for hearing-impaired listeners in novel noises. , 2016, The Journal of the Acoustical Society of America.

[38]  C. Bachert,et al.  Inflammatory endotypes of chronic rhinosinusitis based on cluster analysis of biomarkers. , 2016, The Journal of allergy and clinical immunology.

[39]  H. Johno,et al.  Construction of mass spectra database and diagnosis algorithm for head and neck squamous cell carcinoma. , 2017, Oral oncology.

[40]  C. Wood,et al.  MRI-Based Texture Analysis to Differentiate Sinonasal Squamous Cell Carcinoma from Inverted Papilloma , 2017, American Journal of Neuroradiology.

[41]  Bayu Adhi Tama,et al.  Tree-based classifier ensembles for early detection method of diabetes: an exploratory study , 2019, Artificial Intelligence Review.

[42]  T. McNutt,et al.  Quantitative Evaluation of Head and Neck Cancer Treatment-Related Dysphagia in the Development of a Personalized Treatment Deintensification Paradigm. , 2017, International journal of radiation oncology, biology, physics.

[43]  Yu-Ri Lee,et al.  Cascade recurring deep networks for audible range prediction , 2017, BMC Medical Informatics and Decision Making.

[44]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[45]  David B. Grayden,et al.  An integrated model of pitch perception incorporating place and temporal pitch codes with application to cochlear implant research , 2017, Hearing Research.

[46]  James V. Little,et al.  Label-free reflectance hyperspectral imaging for tumor margin assessment: a pilot study on surgical specimens of cancer patients , 2017, Journal of biomedical optics.

[47]  Yu Tsao,et al.  A Deep Denoising Autoencoder Approach to Improving the Intelligibility of Vocoded Speech in Cochlear Implant Simulation , 2017, IEEE Transactions on Biomedical Engineering.

[48]  Xavier Intes,et al.  Optical tomographic imaging for breast cancer detection , 2017, Journal of biomedical optics.

[49]  Ling Ma,et al.  Deep learning based classification for head and neck cancer detection with hyperspectral imaging in an animal model , 2017, Medical Imaging.

[50]  James V. Little,et al.  Detection of Head and Neck Cancer in Surgical Specimens Using Quantitative Hyperspectral Imaging , 2017, Clinical Cancer Research.

[51]  C. Reinhold,et al.  Spectral multi-energy CT texture analysis with machine learning for tissue classification: an investigation using classification of benign parotid tumours as a testing paradigm , 2018, European Radiology.

[52]  I. Bigio,et al.  The color of cancer: Margin guidance for oral cancer resection using elastic scattering spectroscopy , 2017, The Laryngoscope.

[53]  A. Madabhushi,et al.  An oral cavity squamous cell carcinoma quantitative histomorphometric-based image classifier of nuclear morphology can risk stratify patients for disease-specific survival , 2017, Modern Pathology.

[54]  Mark D. McDonnell,et al.  Modeling Electrode Place Discrimination in Cochlear Implant Stimulation , 2017, IEEE Transactions on Biomedical Engineering.

[55]  C. Hopkins,et al.  SNOT‐22–based clusters in chronic rhinosinusitis without nasal polyposis exhibit distinct endotypic and prognostic differences , 2018, International forum of allergy & rhinology.

[56]  Tobias Ortmaier,et al.  A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation , 2018, International Journal of Computer Assisted Radiology and Surgery.

[57]  Wesley H. Stepp,et al.  RNA Oncoimmune Phenotyping of HPV-Positive p16-Positive Oropharyngeal Squamous Cell Carcinomas by Nodal Status , 2018, JAMA otolaryngology-- head & neck surgery.

[58]  Jake Luo,et al.  Unique Clinical Language Patterns Among Expert Vestibular Providers Can Predict Vestibular Diagnoses. , 2018, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[59]  D. Bing,et al.  Predicting the hearing outcome in sudden sensorineural hearing loss via machine learning models , 2018, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.

[60]  Amy Y. Chen,et al.  Detection and delineation of squamous neoplasia with hyperspectral imaging in a mouse model of tongue carcinogenesis , 2018, Journal of biophotonics.

[61]  A. Katsumata,et al.  Deep-learning classification using convolutional neural network for evaluation of maxillary sinusitis on panoramic radiography , 2018, Oral Radiology.

[62]  Xu Wang,et al.  Tumor margin classification of head and neck cancer using hyperspectral imaging and convolutional neural networks , 2018, Medical Imaging.

[63]  Yejun Wang,et al.  A response prediction model for taxane, cisplatin, and 5-fluorouracil chemotherapy in hypopharyngeal carcinoma , 2018, Scientific Reports.

[64]  Yu Tsao,et al.  Demographic and Symptomatic Features of Voice Disorders and Their Potential Application in Classification Using Machine Learning Algorithms , 2018, Folia Phoniatrica et Logopaedica.

[65]  Min Young Kwak,et al.  Cochlear Implantation in Postlingually Deaf Adults is Time-sensitive Towards Positive Outcome: Prediction using Advanced Machine Learning Techniques , 2018, Scientific Reports.

[66]  Martin Halicek,et al.  Optical biopsy of head and neck cancer using hyperspectral imaging and convolutional neural networks , 2018, BiOS.

[67]  Saeed Kermani,et al.  The design and validation of a hybrid digital-signal-processing plug-in for traditional cochlear implant speech processors , 2018, Comput. Methods Programs Biomed..

[68]  S. Kujawa,et al.  Use of non-invasive measures to predict cochlear synapse counts , 2018, Hearing Research.

[69]  Shih-Hau Fang,et al.  Detection of Pathological Voice Using Cepstrum Vectors: A Deep Learning Approach. , 2019, Journal of voice : official journal of the Voice Foundation.

[70]  M. Lo,et al.  Development of an Automatic Diagnostic Algorithm for Pediatric Otitis Media. , 2018, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[71]  Burhan Ergen,et al.  Determination of the relationship between internal auditory canal nerves and tinnitus based on the findings of brain magnetic resonance imaging , 2018, Biomed. Signal Process. Control..

[72]  G. Kennedy,et al.  Performance of a Genomic Sequencing Classifier for the Preoperative Diagnosis of Cytologically Indeterminate Thyroid Nodules , 2018, JAMA surgery.

[73]  Shamik Mascharak,et al.  Detecting oropharyngeal carcinoma using multispectral, narrow‐band imaging and machine learning , 2018, The Laryngoscope.

[74]  P. Lambin,et al.  Combining deep learning and radiomics to predict HPV status in oropharyngeal squamous cell carcinoma , 2018 .

[75]  Yu Tsao,et al.  Deep Learning–Based Noise Reduction Approach to Improve Speech Intelligibility for Cochlear Implant Recipients , 2018, Ear and hearing.

[76]  R. Moorthy,et al.  A web‐based prediction score for head and neck cancer referrals , 2018, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.

[77]  Tina M. Grieco-Calub,et al.  Neural preservation underlies speech improvement from auditory deprivation in young cochlear implant recipients , 2018, Proceedings of the National Academy of Sciences.

[78]  Yang Hu,et al.  Dual‐modality endoscopic probe for tissue surface shape reconstruction and hyperspectral imaging enabled by deep neural networks , 2018, Medical Image Anal..

[79]  Radhika K. Poduval,et al.  Micron resolution, high-fidelity three-dimensional vascular optical imaging phantoms , 2019, Journal of biomedical optics.

[80]  M. Inoue,et al.  Discrimination of “hot potato voice” caused by upper airway obstruction utilizing a support vector machine , 2018, The Laryngoscope.

[81]  H. Lv,et al.  Morphological Neuroimaging Biomarkers for Tinnitus: Evidence Obtained by Applying Machine Learning , 2019, Neural plasticity.

[82]  F. Hou,et al.  Sleep heart rate variability assists the automatic prediction of long-term cardiovascular outcomes. , 2019, Sleep medicine.

[83]  Jeong-Whun Kim,et al.  Unsupervised cluster analysis of chronic rhinosinusitis with nasal polyp using routinely available clinical markers and its implication in treatment outcomes , 2018, International forum of allergy & rhinology.

[84]  J. Koo,et al.  Feasibility of Eye Tracking Assisted Vestibular Rehabilitation Strategy Using Immersive Virtual Reality , 2019, Clinical and experimental otorhinolaryngology.

[85]  Yanmei Wang,et al.  Deep Learning in Automated Region Proposal and Diagnosis of Chronic Otitis Media Based on Computed Tomography , 2019, Ear and hearing.

[86]  Peng Zhang,et al.  Decoding phonation with artificial intelligence (DeP AI): Proof of concept , 2019, Laryngoscope investigative otolaryngology.

[87]  A. Habib,et al.  An artificial intelligence algorithm that differentiates anterior ethmoidal artery location on sinus computed tomography scans , 2019, The Journal of Laryngology & Otology.

[88]  Lili Zhang,et al.  Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy , 2019, Theranostics.

[89]  Naweed I Chowdhury,et al.  Patterns of olfactory dysfunction in chronic rhinosinusitis identified by hierarchical cluster analysis and machine learning algorithms , 2018, International forum of allergy & rhinology.

[90]  Jae-Jun Song.  Virtual Reality for Vestibular Rehabilitation , 2019, Clinical and experimental otorhinolaryngology.

[91]  Justin K. Chau,et al.  Building an Otoscopic screening prototype tool using deep learning , 2019, Journal of Otolaryngology - Head & Neck Surgery.

[92]  A. Lyshchik,et al.  Machine Learning by Ultrasonography for Genetic Risk Stratification of Thyroid Nodules. , 2019, JAMA otolaryngology-- head & neck surgery.

[93]  Abhijit Ghatak,et al.  Deep Learning with R , 2019, Springer Singapore.

[94]  Yong Ren,et al.  Expert-level Diagnosis of Nasal Polyps Using Deep Learning on Whole-slide Imaging. , 2019, The Journal of allergy and clinical immunology.

[95]  Xinyu D Song,et al.  Online Machine Learning Audiometry. , 2019, Ear and hearing.

[96]  Matthew G. Crowson,et al.  A contemporary review of machine learning in otolaryngology–head and neck surgery , 2020, The Laryngoscope.

[97]  A. Rameau.  Pilot study for a novel and personalized voice restoration device for patients with laryngectomy , 2019, Head & neck.

[98]  Omar A. Karadaghy,et al.  Machine learning to predict occult nodal metastasis in early oral squamous cell carcinoma. , 2019, Oral oncology.

[99]  Naweed I Chowdhury,et al.  Automated classification of osteomeatal complex inflammation on computed tomography using convolutional neural networks , 2018, International forum of allergy & rhinology.

[100]  D. Koestler,et al.  Using Machine Learning to Predict Sensorineural Hearing Loss Based on Perilymph Micro RNA Expression Profile , 2019, Scientific Reports.

[101]  Omar A. Karadaghy,et al.  Development and Assessment of a Machine Learning Model to Help Predict Survival Among Patients With Oral Squamous Cell Carcinoma. , 2019, JAMA otolaryngology-- head & neck surgery.

[102]  David Kent,et al.  Automated Sleep Stage Scoring of the Sleep Heart Health Study Using Deep Neural Networks. , 2019, Sleep.

[103]  Naweed I Chowdhury,et al.  Baseline mucus cytokines predict 22‐item Sino‐Nasal Outcome Test results after endoscopic sinus surgery , 2020, International forum of allergy & rhinology.

[104]  T. Niu,et al.  A novel gene panel for prediction of lymph-node metastasis and recurrence in patients with thyroid cancer. , 2019, Surgery.

[105]  R. Onimaru,et al.  Machine-Learning-Based Prediction of Treatment Outcomes Using MR Imaging-Derived Quantitative Tumor Information in Patients with Sinonasal Squamous Cell Carcinomas: A Preliminary Study , 2019, Cancers.

[106]  Haidi Yang,et al.  Computer-aided diagnosis of laryngeal cancer via deep learning based on laryngoscopic images , 2019, EBioMedicine.

[107]  C. Reinhold,et al.  Dual-Energy CT Texture Analysis With Machine Learning for the Evaluation and Characterization of Cervical Lymphadenopathy , 2019, Computational and structural biotechnology journal.

[108]  M. Shew,et al.  Machine Learning to Predict Delays in Adjuvant Radiation following Surgery for Head and Neck Cancer , 2019, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[109]  Shyamnath Gollakota,et al.  Detecting middle ear fluid using smartphones , 2019, Science Translational Medicine.

[110]  Jenna Wiens,et al.  Automatically Evaluating Balance: A Machine Learning Approach , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[111]  Michael B. Wilson,et al.  Machine Learning Diagnosis of Peritonsillar Abscess , 2019, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[112]  Y. Matsumoto,et al.  Cellular cartography of the organ of Corti based on optical tissue clearing and machine learning , 2019, eLife.

[113]  H. Bartelink,et al.  Drug sensitivity prediction models reveal a link between DNA repair defects and poor prognosis in HNSCC. , 2019, Cancer research.

[114]  A. Lesinski-Schiedat,et al.  Computational analysis based on audioprofiles: A new possibility for patient stratification in office-based otology , 2019, Audiology research.

[115]  Martin T. Halicek,et al.  Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning , 2019, Cancers.

[116]  Otoscopic diagnosis using computer vision: An automated machine learning approach , 2020, The Laryngoscope.

[117]  D. H. Kim,et al.  Virtual Reality Simulators for Endoscopic Sinus and Skull Base Surgery: The Present and Future , 2018, Clinical and experimental otorhinolaryngology.

[118]  Zhen Zhao,et al.  Deep learning-based model for predicting progression in patients with head and neck squamous cell carcinoma. , 2019, Cancer biomarkers : section A of Disease markers.

[119]  W. Yarbrough,et al.  Multi-Institutional Validation of Deep Learning for Pretreatment Identification of Extranodal Extension in Head and Neck Squamous Cell Carcinoma. , 2019, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[120]  Pa-Chun Wang,et al.  Transient-evoked otoacoustic emission signals predicting outcomes of acute sensorineural hearing loss in patients with Ménière’s disease , 2020, Acta oto-laryngologica.

[121]  H. Ladak,et al.  Intrinsic Measures and Shape Analysis of the Intratemporal Facial Nerve. , 2020, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[122]  S. Iwasaki,et al.  Prediction of Vestibular Dysfunction by Applying Machine Learning Algorithms to Postural Instability , 2020, Frontiers in Neurology.

[123]  S. Redline,et al.  Artificial intelligence in sleep medicine: Background and implications for clinicians. , 2020, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[124]  Geoffrey Liu,et al.  Automatic Recognition of Laryngoscopic Images Using a Deep‐Learning Technique , 2020, The Laryngoscope.

[125]  K. Miyazawa,et al.  Lipidome-based rapid diagnosis with machine learning for detection of TGF-β signalling activated area in head and neck cancer , 2020, British Journal of Cancer.

[126]  Kyogu Lee,et al.  Prediction of Apnea-Hypopnea Index Using Sound Data Collected by a Noncontact Device , 2020, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[127]  Jonathan R. Clark,et al.  Development and validation of a multivariable prediction model for the identification of occult lymph node metastasis in oral squamous cell carcinoma , 2020, Head & neck.

[128]  P. Parmar,et al.  An artificial intelligence algorithm that identifies middle turbinate pneumatisation (concha bullosa) on sinus computed tomography scans. , 2020, The Journal of laryngology and otology.

[129]  Ziyao Xu,et al.  Automated multi-model deep neural network for sleep stage scoring with unfiltered clinical data , 2020, Sleep and Breathing.

[130]  I. El-Sayed,et al.  Machine Learning for Predicting Complications in Head and Neck Microvascular Free Tissue Transfer , 2020, The Laryngoscope.