CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning

We develop an algorithm that can detect pneumonia from chest X-rays at a level exceeding practicing radiologists. Our algorithm, CheXNet, is a 121-layer convolutional neural network trained on ChestX-ray14, currently the largest publicly available chest X-ray dataset, containing over 100,000 frontal-view X-ray images with 14 diseases. Four practicing academic radiologists annotate a test set, on which we compare the performance of CheXNet to that of radiologists. We find that CheXNet exceeds average radiologist performance on the F1 metric. We extend CheXNet to detect all 14 diseases in ChestX-ray14 and achieve state of the art results on all 14 diseases.

[1]  S. Osajima.  [VIRAL PNEUMONIA]. , 1963, Naika. Internal medicine.

[2]  K. Berbaum,et al.  The effect of comparison films upon resident interpretation of pediatric chest radiographs. , 1985, Investigative radiology.

[3]  H. Davies,et al.  Reliability of the chest radiograph in the diagnosis of lower respiratory infections in young children. , 1996, The Pediatric infectious disease journal.

[4]  T. Franquet.  Imaging of pneumonia: trends and algorithms. , 2001, The European respiratory journal.

[5]  R. Hopstaken,et al.  Inter-observer variation in the interpretation of chest radiographs for pneumonia in community-acquired lower respiratory tract infections. , 2004, Clinical radiology.

[6]  J. Carlin,et al.  Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. , 2005, Bulletin of the World Health Organization.

[7]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[8]  M. Aydoğdu,et al.  Mortality prediction in community-acquired pneumonia requiring mechanical ventilation; values of pneumonia and intensive care unit severity scores. , 2010, Tuberkuloz ve toraks.

[9]  B. Garra,et al.  White Paper Report of the RAD-AID Conference on International Radiology for Developing Countries: identifying challenges, opportunities, and strategies for imaging services in the developing world. , 2010, Journal of the American College of Radiology : JACR.

[10]  Samir S. Shah,et al.  Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children. , 2012, Journal of hospital medicine.

[11]  S. Raoof,et al.  Interpretation of plain chest roentgenogram. , 2012, Chest.

[12]  R. Lodha,et al.  Antibiotics for community-acquired pneumonia in children. , 2010, The Cochrane database of systematic reviews.

[13]  J. Gonçalves-Pereira,et al.  Community-acquired pneumonia: identification and evaluation of nonresponders , 2013, Therapeutic advances in infectious disease.

[14]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Clement J. McDonald,et al.  Preparing a collection of radiology examinations for distribution and retrieval , 2015, J. Am. Medical Informatics Assoc..

[17]  Bram van Ginneken,et al.  Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images , 2016, IEEE Transactions on Medical Imaging.

[18]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  H. Otero,et al.  2015 RAD-AID Conference on International Radiology for Developing Countries: The Evolving Global Radiology Landscape , 2016, Journal of the American College of Radiology.

[20]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[21]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[22]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[23]  Khalid Ashraf,et al.  Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networks , 2017, ArXiv.

[24]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[26]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[28]  Andrew Y. Ng,et al.  Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks , 2017, ArXiv.

[29]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[30]  Li Yao,et al.  Learning to diagnose from scratch by exploiting dependencies among labels , 2017, ArXiv.

[31]  Srikrishna Varadarajan,et al.  RADnet: Radiologist level accuracy using deep learning for hemorrhage detection in CT scans , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[32]  P. Huang,et al.  Added Value of Computer-aided CT Image Features for Early Lung Cancer Diagnosis with Small Pulmonary Nodules: A Matched Case-Control Study. , 2018, Radiology.

[33]  Wei Wei,et al.  Thoracic Disease Identification and Localization with Limited Supervision , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[35]  Ronald M. Summers,et al.  TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-Rays , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[36]  Fang Jin,et al.  A Multi-variable Stacked Long-Short Term Memory Network for Wind Speed Forecasting , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[37]  Zhou Yang,et al.  Spatial-temporal Multi-Task Learning for Within-field Cotton Yield Prediction , 2018, PAKDD.

[38]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).