Performance of a Deep Learning Model vs Human Reviewers in Grading Endoscopic Disease Severity of Patients With Ulcerative Colitis

Key Points Question What is the agreement of automatically determined endoscopic severity of ulcerative colitis using deep learning models compared with expert human reviewers? Findings In this diagnostic study including colonoscopy data from 3082 adults, performance of a deep learning model for distinguishing moderate to severe disease from remission compared with multiple expert reviewers was excellent, with an area under the receiver operating curve of 0.97 using still images and full-motion video. Meaning Deep learning offers a practical and scalable method to provide objective and reproducible assessments of endoscopic disease severity for patients with ulcerative colitis.

[1]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[2]  W. Tremaine,et al.  Coated oral 5-aminosalicylic acid therapy for mildly to moderately active ulcerative colitis. A randomized study. , 1987, The New England journal of medicine.

[3]  P. Baldi,et al.  Deep Learning Localizes and Identifies Polyps in Real Time With 96% Accuracy in Screening Colonoscopy. , 2018, Gastroenterology.

[4]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[6]  S. Travis,et al.  Central Reading of Endoscopy Endpoints in Inflammatory Bowel Disease Trials , 2015, Inflammatory bowel diseases.

[7]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[8]  Lars Aabakken,et al.  Inter-observer agreement in the assessment of endoscopic findings in ulcerative colitis , 2004, BMC gastroenterology.

[9]  H. El‐Serag,et al.  Accuracy of Diagnostic Codes for Identifying Patients with Ulcerative Colitis and Crohn’s Disease in the Veterans Affairs Health Care System , 2014, Digestive Diseases and Sciences.

[10]  S. Grundy,et al.  Design and methodological considerations in the National Cooperative Gallstone Study: a multicenter clinical trial. , 1981, Controlled Clinical Trials.

[11]  O. Dewit,et al.  Endoscopic improvement of mucosal lesions in patients with moderate to severe ileocolonic Crohn's disease following treatment with certolizumab pegol , 2012, Gut.

[12]  B. Feagan,et al.  Endoscopic scoring indices for evaluation of disease activity in ulcerative colitis. , 2018, The Cochrane database of systematic reviews.

[13]  Henry Horng-Shing Lu,et al.  Accurate Classification of Diminutive Colorectal Polyps Using Computer-Aided Analysis. , 2017, Gastroenterology.

[14]  L. Peyrin-Biroulet,et al.  Clinical implications of mucosal healing for the management of IBD , 2010, Nature Reviews Gastroenterology &Hepatology.

[15]  D. Altman,et al.  Outcome measurement in clinical trials for Ulcerative Colitis: towards standardisation , 2007, Trials.

[16]  P. Rutgeerts,et al.  Early mucosal healing with infliximab is associated with improved long-term clinical outcomes in ulcerative colitis. , 2011, Gastroenterology.

[17]  D. Altman,et al.  Translational Gastroenterology , 2011 .

[18]  P. Rutgeerts,et al.  The role of centralized reading of endoscopy in a randomized controlled trial of mesalamine for ulcerative colitis. , 2013, Gastroenterology.

[19]  Jaime S. Cardoso,et al.  Learning to Classify Ordinal Data: The Data Replication Method , 2007, J. Mach. Learn. Res..

[20]  M. Vatn,et al.  Mucosal healing in inflammatory bowel disease: results from a Norwegian population-based cohort. , 2007, Gastroenterology.

[21]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[22]  B. Feagan,et al.  Histologic scoring indices for evaluation of disease activity in ulcerative colitis. , 2017, The Cochrane database of systematic reviews.