DeepDicomSort: An Automatic Sorting Algorithm for Brain Magnetic Resonance Imaging Data

With the increasing size of datasets used in medical imaging research, the need for automated data curation is arising. One important data curation task is the structured organization of a dataset for preserving integrity and ensuring reusability. Therefore, we investigated whether this data organization step can be automated. To this end, we designed a convolutional neural network (CNN) that automatically recognizes eight different brain magnetic resonance imaging (MRI) scan types based on visual appearance. Thus, our method is unaffected by inconsistent or missing scan metadata. It can recognize pre-contrast T1-weighted (T1w),post-contrast T1-weighted (T1wC), T2-weighted (T2w), proton density-weighted (PDw) and derived maps (e.g. apparent diffusion coefficient and cerebral blood flow). In a first experiment,we used scans of subjects with brain tumors: 11065 scans of 719 subjects for training, and 2369 scans of 192 subjects for testing. The CNN achieved an overall accuracy of 98.7%. In a second experiment, we trained the CNN on all 13434 scans from the first experiment and tested it on 7227 scans of 1318 Alzheimer’s subjects. Here, the CNN achieved an overall accuracy of 98.5%. In conclusion, our method can accurately predict scan type, and can quickly and automatically sort a brain MRI dataset virtually without the need for manual verification. In this way, our method can assist with properly organizing a dataset, which maximizes the shareability and integrity of the data.

[1]  Ole Solheim,et al.  Glioblastoma Segmentation: Comparison of Three Different Software Packages , 2016, PloS one.

[2]  Daiki Tamada,et al.  Motion Artifact Reduction Using a Convolutional Neural Network for Dynamic Contrast Enhanced MR Imaging of the Liver , 2018, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[3]  Dinggang Shen,et al.  Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis , 2014, MICCAI.

[4]  José A. Gámez,et al.  Medical images modality classification using discrete Bayesian Networks , 2016 .

[5]  David R. Maffitt,et al.  De-identification of Medical Images with Retention of Scientific Research Value. , 2015, Radiographics : a review publication of the Radiological Society of North America, Inc.

[6]  Christopher Rorden,et al.  The first step for neuroimaging data analysis: DICOM to NIfTI conversion , 2016, Journal of Neuroscience Methods.

[7]  Norbert Schuff,et al.  The Parkinson's progression markers initiative (PPMI) – establishing a PD biomarker cohort , 2018, Annals of clinical and translational neurology.

[8]  Satrajit S. Ghosh,et al.  The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments , 2016, Scientific Data.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[11]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[12]  Ingerid Reinertsen,et al.  REtroSpective Evaluation of Cerebral Tumors (RESECT): A clinical database of pre-operative MRI and intra-operative ultrasound in low-grade glioma surgeries. , 2017, Medical physics.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Krzysztof J. Gorgolewski,et al.  OpenNeuro – a free online platform for sharing and analysis of neuroimaging data , 2017 .

[16]  Peter M. A. van Ooijen,et al.  Quality and Curation of Medical Images and Data , 2019, Artificial Intelligence in Medical Imaging.

[17]  Krzysztof J. Gorgolewski,et al.  MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites , 2016, bioRxiv.

[18]  Jong Chul Ye,et al.  CollaGAN: Collaborative GAN for Missing Image Data Imputation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[20]  Hongfei Lin,et al.  Modality Classification for Medical Images Using Multiple Deep Convolutional Neural Networks , 2015 .

[21]  Dinggang Shen,et al.  3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients , 2016, MICCAI.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  C. Krishna Mohan,et al.  Medical images modality classification using multi-scale dictionary learning , 2014, 2014 19th International Conference on Digital Signal Processing.

[24]  Jirí Sedlár,et al.  Predicting Deletion of Chromosomal Arms 1p/19q in Low-Grade Gliomas from MR Images Using Machine Intelligence , 2017, Journal of Digital Imaging.

[25]  Daniel S. Marcus,et al.  OASIS-3: LONGITUDINAL NEUROIMAGING, CLINICAL, AND COGNITIVE DATASET FOR NORMAL AGING AND ALZHEIMER’S DISEASE , 2018, Alzheimer's & Dementia.

[26]  Snehashis Roy,et al.  Classifying magnetic resonance image modalities with convolutional neural networks , 2018, Medical Imaging.

[27]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[28]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[29]  Jeffrey D. Hirsch,et al.  We Built This House; It’s Time to Move in: Leveraging Existing DICOM Structure to More Completely Utilize Readily Available Detailed Contrast Administration Information , 2015, Journal of Digital Imaging.

[30]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[31]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[32]  Daniel S. Marcus,et al.  OASIS-3: LONGITUDINAL NEUROIMAGING, CLINICAL, AND COGNITIVE DATASET FOR NORMAL AGING AND ALZHEIMER’S DISEASE , 2018, Alzheimer's & Dementia.

[33]  Graham W. Taylor,et al.  Learning Confidence for Out-of-Distribution Detection in Neural Networks , 2018, ArXiv.

[34]  Sašo Džeroski,et al.  Improved medical image modality classification using a combination of visual and textual features , 2015, Comput. Medical Imaging Graph..

[35]  Victor Alves,et al.  Deep Convolutional Neural Networks for the Segmentation of Gliomas in Multi-sequence MRI , 2015, Brainles@MICCAI.

[36]  Martín Prieto,et al.  Randomized prospective study evaluating tenofovir disoproxil fumarate prophylaxis against hepatitis B virus reactivation in anti-HBc-positive patients with rituximab-based regimens to treat hematologic malignancies: The Preblin study , 2017, PloS one.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  P. Lambin,et al.  Radiomics: the bridge between medical imaging and personalized medicine , 2017, Nature Reviews Clinical Oncology.

[39]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[40]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[41]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[42]  Daniel P. Kennedy,et al.  Enhancing studies of the connectome in autism using the autism brain imaging data exchange II , 2017, Scientific Data.

[43]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[44]  Alexandre Cadrin-Chênevert,et al.  Deep learning workflow in radiology: a primer , 2020, Insights into Imaging.

[45]  D. Collins,et al.  Online database of clinical MR and ultrasound images of brain tumors. , 2012, Medical physics.

[46]  David B. Keator,et al.  Infrastructure for sharing standardized clinical brain scans across hospitals , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[47]  George Shih,et al.  Challenges Related to Artificial Intelligence Research in Medical Imaging and the Importance of Image Analysis Competitions. , 2019, Radiology. Artificial intelligence.

[48]  Shanshan Wang,et al.  An Automated DICOM Database Capable of Arbitrary Data Mining (Including Radiation Dose Indicators) for Quality Monitoring , 2011, Journal of Digital Imaging.

[49]  Wei Cao,et al.  Deep Learning based Radiomics (DLR) and its usage in noninvasive IDH1 prediction for low grade glioma , 2017, Scientific Reports.