Machine Learning Aided Diagnosis of Diseases Without Clinical Gold Standard: A New Score for Laryngopharyngeal Reflux Disease Based on pH Monitoring

Objective: Laryngopharyngeal Reflux Disease (LPRD) is prevalent and has a range of symptoms. However, diagnosing LPRD is difficult because of the lack of specific symptoms or clinical gold standard. An objective and reliable test, which does not rely on a perfect clinical gold standard, is required in clinical practice. Methods: 60 normal volunteers and 74 confirmed Laryngopharyngeal Reflux (LPR) patients were labelled based on the combined consideration of the reflux symptom index, reflux finding score, 24h oropharyngeal pH monitoring and results of anti-reflux treatment. 72 candidate features were extracted from pH recordings and the most efficient feature combination was detected using a stepwise wrapper method. The labelled data were combined with 1552 unlabelled data for feature selection and model training using semi-supervised learning. A latent class model method was used to assess the proposed model based on 64 additional validation data and an imperfect clinical reference test. Results: A new score (named W score), which significantly improved the sensitivity of the LPRD test (82.67% vs. 24.09%) and has a relatively high specificity (80.19%), was proposed. W score concurs with the complicated clinical test. Conclusion: W score which significantly improves LPRD diagnostic efficiency, can aid the clinical diagnosis of LPRD. W score provides an objective, efficient, and reliable indicator for the application of anti-reflux treatment in clinical practice. Significance: More LPRD patients can benefit from anti-reflux treatment in clinical practice and fewer patients may suffer from, for example, the side effects of unnecessary long-term Proton Pump Inhibitors (PPI) treatments.

[1]  Mohammad Ali Zare Chahooki,et al.  A Survey on semi-supervised feature selection methods , 2017, Pattern Recognit..

[2]  M. Vaezi,et al.  Oropharyngeal Reflux Monitoring and Atypical Gastroesophageal Reflux Disease , 2016, Current Gastroenterology Reports.

[3]  Bernard Harmegnies,et al.  Validity and Reliability of the Reflux Sign Assessment , 2019, The Annals of otology, rhinology, and laryngology.

[4]  J. Koufman,et al.  Proton Pump Inhibitor Resistance in the Treatment of Laryngopharyngeal Reflux , 2001, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[5]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[6]  John M. DelGaudio,et al.  Proximal pharyngeal reflux correlates with increasing severity of lingual tonsil hypertrophy , 2008, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[7]  J. Koufman The Otolaryngologic Manifestations of Gastroesophageal Reflux Disease (GERD): A Clinical Investigation of 225 Patients Using Ambulatory 24‐Hour pH Monitoring and an Experimental Investigation of the Role of Acid and Pepsin in the Development of Laryngeal Injury , 1991, The Laryngoscope.

[8]  S. Walter,et al.  Estimating the error rates of diagnostic tests. , 1980, Biometrics.

[9]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[10]  Charles A Onyekwere,et al.  Prevalence of gastroesophageal reflux disease among patients with bronchial asthma. , 2010, Tropical gastroenterology : official journal of the Digestive Diseases Foundation.

[11]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[12]  Shuwen Liang,et al.  Reflux finding score is associated with gastroesophageal flap valve status in patients with laryngopharyngeal reflux disease: a retrospective study , 2019, Scientific Reports.

[13]  E. Weitzel,et al.  Diagnosis of Laryngopharyngeal Reflux Disease with Digital Imaging , 2003, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[14]  R. Simon,et al.  Sinusitis and chronic progressive exercise-induced cough and dyspnea. , 2008, Allergy and asthma proceedings.

[15]  P M Vacek,et al.  The effect of conditional dependence on the evaluation of diagnostic tests. , 1985, Biometrics.

[16]  Nagarajan Natarajan,et al.  Learning with Noisy Labels , 2013, NIPS.

[17]  Lei Wang,et al.  Utility of 24-hour pharyngeal pH monitoring and clinical feature in laryngopharyngeal reflux disease , 2019, Acta oto-laryngologica.

[18]  Edward Greenberg,et al.  Developing a new reference standard: is validation necessary? , 2010, Academic radiology.

[19]  Denis Hamad,et al.  Constraint scores for semi-supervised feature selection: A comparative study , 2011, Pattern Recognit. Lett..

[20]  Tieniu Tan,et al.  Feature Selection Based on Structured Sparsity: A Comprehensive Study , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Bernard Harmegnies,et al.  Instruments evaluating the clinical findings of laryngopharyngeal reflux: A systematic review , 2018, The Laryngoscope.

[22]  W O Johnson,et al.  Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. , 2000, Preventive veterinary medicine.

[23]  M. E. Beaver,et al.  Clinical utility of 24 hour pharyngeal pH monitoring for hoarseness , 2012 .

[24]  L Crevier-Buchman,et al.  The development of new clinical instruments in laryngopharyngeal reflux disease: The international project of young otolaryngologists of the International Federation of Oto-rhino-laryngological Societies. , 2018, European annals of otorhinolaryngology, head and neck diseases.

[25]  Tieniu Tan,et al.  Representative Vector Machines: A Unified Framework for Classical Classifiers , 2016, IEEE Transactions on Cybernetics.

[26]  J. T. Spooner,et al.  Adaptive and Learning Systems for Signal Processing , Communications , and Control , 2013 .

[27]  B. Chang,et al.  The Reliability of the Reflux Finding Score Among General Otolaryngologists. , 2015, Journal of voice : official journal of the Voice Foundation.

[28]  Zhi-Hua Zhou,et al.  Towards Making Unlabeled Data Never Hurt , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  M. Vaezi,et al.  Evaluation of Patients with Suspected Laryngopharyngeal Reflux: A Practical Approach , 2011, Current gastroenterology reports.

[30]  Bernard Harmegnies,et al.  Clinical outcomes of laryngopharyngeal reflux treatment: A systematic review and meta‐analysis , 2018, The Laryngoscope.

[31]  N. Gupta,et al.  Evaluation of a laryngopharyngeal reflux management protocol. , 2016, American journal of otolaryngology.

[32]  P. Bossuyt,et al.  Evaluation of diagnostic tests when there is no gold standard. A review of methods. , 2007, Health technology assessment.

[33]  Venkatesan Rajinikanth,et al.  Deep Learning for Medical Image Processing , 2020 .

[34]  Craig Hamilton,et al.  The Value of Routine pH Monitoring in the Diagnosis and Treatment of Laryngopharyngeal Reflux , 2012, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[35]  Hannah Kavookjian,et al.  The Reflux Symptom Index and Symptom Overlap in Dysphonic Patients , 2020, The Laryngoscope.

[36]  Philip S. Yu,et al.  Building text classifiers using positive and unlabeled examples , 2003, Third IEEE International Conference on Data Mining.

[37]  J. Hagen,et al.  A New Technique for Measurement of Pharyngeal pH: Normal Values and Discriminating pH Threshold , 2009, Journal of Gastrointestinal Surgery.

[38]  D. Collett,et al.  Modelling Binary Data , 1991 .

[39]  D. Piper,et al.  pH stability and activity curves of pepsin with special reference to their clinical importance. , 1965, Gut.

[40]  Jo Shapiro,et al.  The Reliability of the Assessment of Endoscopic Laryngeal Findings Associated With Laryngopharyngeal Reflux Disease , 2002, The Laryngoscope.

[41]  R. Jiang,et al.  Airway pH monitoring in patients with suspected obstructive sleep apnoea using the Dx‐pH oropharyngeal probe: preliminary report of a prospective cohort study , 2014, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.