Automated triaging of head MRI examinations using convolutional neural networks

The growing demand for head magnetic resonance imaging (MRI) examinations, along with a global shortage of radiologists, has led to an increase in the time taken to report head MRI scans around the world. For many neurological conditions, this delay can result in increased morbidity and mortality. An automated triaging tool could reduce reporting times for abnormal examinations by identifying abnormalities at the time of imaging and prioritizing the reporting of these scans. In this work, we present a convolutional neural network for detecting clinically-relevant abnormalities in T2-weighted head MRI scans. Using a validated neuroradiology report classifier, we generated a labelled dataset of 43,754 scans from two large UK hospitals for model training, and demonstrate accurate classification (area under the receiver operating curve (AUC) = 0.943) on a test set of 800 scans labelled by a team of neuroradiologists. Importantly, when trained on scans from only a single hospital the model generalized to scans from the other hospital (∆AUC ≤ 0.02). A simulation study demonstrated that our model would reduce the mean reporting time for abnormal examinations from 28 days to 14 days and from 9 days to 5 days at the two hospitals, demonstrating feasibility for use in a clinical triage environment.

[1]  John A Butman,et al.  Comparison of MRI and CT for detection of acute intracerebral hemorrhage. , 2004, JAMA.

[2]  Robert Adams,et al.  Guidelines for the early management of patients with ischemic stroke: 2005 guidelines update a scientific statement from the Stroke Council of the American Heart Association/American Stroke Association. , 2005, Stroke.

[3]  M. LeMay,et al.  Radiologic changes of the aging brain and skull. , 1984, AJR. American journal of roentgenology.

[4]  Nassir Navab,et al.  Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images , 2018, BrainLes@MICCAI.

[5]  Klaus H. Maier-Hein,et al.  Unsupervised Anomaly Localization using Variational Auto-Encoders , 2019, MICCAI.

[6]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[9]  Konstantinos Kamnitsas,et al.  Unsupervised Lesion Detection in Brain CT using Bayesian Convolutional Autoencoders , 2018 .

[10]  Ender Konukoglu,et al.  Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoders , 2018, ArXiv.

[11]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[12]  Joan Bruna,et al.  Training Convolutional Networks with Noisy Labels , 2014, ICLR 2014.

[13]  M. Leon,et al.  Hippocampal atrophy in normal aging. An association with recent memory impairment. , 1993, Archives of neurology.

[14]  Klaus H. Maier-Hein,et al.  Context-encoding Variational Autoencoder for Unsupervised Anomaly Detection , 2018, ArXiv.

[15]  Shadi Albarqouni,et al.  SteGANomaly: Inhibiting CycleGAN Steganography for Unsupervised Anomaly Detection in Brain MRI , 2020, MICCAI.

[16]  James C. Gee,et al.  Subspecialty-Level Deep Gray Matter Differential Diagnoses with Deep Learning and Bayesian Networks on Clinical Brain MRI: A Pilot Study. , 2020, Radiology. Artificial intelligence.

[17]  T. Harada,et al.  Unsupervised Brain Abnormality Detection Using High Fidelity Image Reconstruction Networks , 2020, ArXiv.

[18]  Ender Konukoglu,et al.  Unsupervised Lesion Detection via Image Restoration with a Normative Prior , 2018, MIDL.

[19]  David A. Wood,et al.  Labelling imaging datasets on the basis of neuroradiology reports: a validation study , 2020, iMIMIC/MIL3iD/LABELS@MICCAI.

[20]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[21]  Mauro Annarumma,et al.  Automated Triaging of Adult Chest Radiographs with Deep Artificial Neural Networks. , 2019, Radiology.

[22]  Changhee Han,et al.  MADGAN: unsupervised medical anomaly detection GAN using multiple adjacent brain MRI slice reconstruction , 2020, BMC Bioinformatics.

[23]  Richard Nock,et al.  Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  J. Parikh,et al.  2019 ACR Commission on Human Resources Workforce Survey. , 2020, Journal of the American College of Radiology : JACR.

[25]  Jun Liu,et al.  Deep learning-based triage and analysis of lesion burden for COVID-19: a retrospective study with external validation , 2020, The Lancet Digital Health.

[26]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[27]  Suyash Mohan,et al.  Artificial Intelligence System Approaching Neuroradiologist-level Differential Diagnosis Accuracy at Brain MRI. , 2020, Radiology.

[28]  David A. Wood,et al.  Automated Labelling using an Attention model for Radiology reports of MRI scans (ALARM) , 2020, MIDL.

[29]  Andrea Mechelli,et al.  Using deep autoencoders to identify abnormal brain structural patterns in neuropsychiatric disorders: A large‐scale multi‐sample study , 2018, Human brain mapping.

[30]  J M Wardlaw,et al.  Prevalence of cerebral white matter lesions in elderly people: a population based magnetic resonance imaging study: the Rotterdam Scan Study , 2001, Journal of neurology, neurosurgery, and psychiatry.

[31]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[32]  A. Alavi,et al.  MR signal abnormalities at 1.5 T in Alzheimer's dementia and normal aging. , 1987, AJR. American journal of roentgenology.

[33]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Marcus A. Badgeley,et al.  Automated deep-neural-network surveillance of cranial images for acute neurologic events , 2018, Nature Medicine.

[35]  Simon K. Warfield,et al.  Deep learning with noisy labels: exploring techniques and remedies in medical image analysis , 2020, Medical Image Anal..

[36]  Shadi Albarqouni,et al.  Scale-Space Autoencoders for Unsupervised Anomaly Segmentation in Brain MRI , 2020, MICCAI.

[37]  S. Baum,et al.  The Effects of Aspirin on Gastric Prostaglandins , 1994, Annals of Internal Medicine.

[38]  Samy Bengio,et al.  Understanding deep learning requires rethinking generalization , 2016, ICLR.