Deep neural networks allow expert-level brain meningioma detection, segmentation and improvement of current clinical practice Deep learning for brain meningioma segmentation

Background . Accurate brain meningioma detection, segmentation and volumetric assessment are critical for serial patient follow-up, surgical planning and monitoring response to treatment. Current gold standard of manual labeling is a time-consuming process, subject to inter-user variability. Fully-automated algorithms for meningioma detection and segmentation have the potential to bring volumetric analysis into clinical and research workflows by increasing accuracy and efficiency, reducing inter-user variability and saving time. Previous research has focused solely on segmentation tasks without assessment of impact and usability of deep learning solutions in clinical practice. Methods . We developed a three-dimensional convolutional neural network (3D-CNN) to perform expert-level, automated meningioma segmentation and volume estimation on MRI scans. A 3D-CNN was initially trained by segmenting entire brain volumes using a dataset of 10,099 healthy brain MRIs. Using transfer learning, the network was then specifically trained on meningioma segmentation using 806 expert-labeled MRIs. The algorithm tumor-labeling performance was assessed with standard metrics of tumor segmentation performance (i.e., Dice score). To evaluate clinical applicability, we compared volume estimation accuracy and segmentation time based on current practice versus the use of our automated algorithm. Findings . The final model achieved a median performance of 88.2% reaching the spectrum of current inter-expert variability (82.6% - 91.6%). Compared to current workflows, the use of the algorithm reduced processing time by 99% and produced tumor volume calculations with an almost perfect correlation with the expert manual segmentations (r=0.98, p<0.001), significantly more accurate compared to volume estimation techniques used in practice. Conclusions . We demonstrate through a prospective trial conducted in a simulated setting that a deep learning approach to meningioma segmentation is feasible, highly accurate and can substantially improve current clinical practice.

[1]  Kai Zhang,et al.  Deep Learning Model for the Automated Detection and Histopathological Prediction of Meningioma , 2020, Neuroinformatics.

[2]  D. Dong,et al.  A deep learning radiomics model for preoperative grading in meningioma. , 2019, European journal of radiology.

[3]  A. della Puppa,et al.  Accuracy of deep learning to differentiate the histopathological grading of meningiomas on MR images: A preliminary study , 2019, Journal of magnetic resonance imaging : JMRI.

[4]  N. Srikandarajah,et al.  Incidental intracranial meningiomas: a systematic review and meta-analysis of prognostic factors and outcomes , 2019, Journal of Neuro-Oncology.

[5]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[6]  Jie Xu,et al.  The practical implementation of artificial intelligence technologies in medicine , 2019, Nature Medicine.

[7]  Raymond Y Huang,et al.  Response assessment of meningioma: 1D, 2D, and volumetric criteria for treatment response and tumor progression , 2018, Neuro-oncology.

[8]  Osamu Abe,et al.  Deep learning and artificial intelligence in radiology: Current applications and future directions , 2018, PLoS medicine.

[9]  Isaac S Kohane,et al.  Artificial Intelligence in Healthcare , 2019, Artificial Intelligence and Machine Learning for Business for Non-Engineers.

[10]  Jill S Barnholtz-Sloan,et al.  CBTRUS Statistical Report: Primary Brain and Other Central Nervous System Tumors Diagnosed in the United States in 2011-2015. , 2018, Neuro-oncology.

[11]  D. Maintz,et al.  Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric MRI , 2018, European Radiology.

[12]  C. Benner,et al.  Non-operative meningiomas: long-term follow-up of 136 patients , 2018, Acta Neurochirurgica.

[13]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[14]  M. McDermott,et al.  Presenting Symptoms and Prognostic Factors for Symptomatic Outcomes Following Resection of Meningioma. , 2017, World neurosurgery.

[15]  C. Pal,et al.  Deep Learning: A Primer for Radiologists. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[16]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[17]  Cam-CAN Group,et al.  The Cambridge Centre for Ageing and Neuroscience (Cam-CAN) data repository: Structural and functional MRI, MEG, and cognitive data from a cross-sectional adult lifespan sample , 2017, NeuroImage.

[18]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[19]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[20]  Joeky T Senders,et al.  REVIEWARTICLE-NEUROSURGICALTECHNIQUES An introduction and overview of machine learning in neurosurgical care , 2017 .

[21]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[22]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[23]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[24]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[25]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[28]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[29]  A. Laakso,et al.  Lateral supraorbital approach applied to tuberculum sellae meningiomas: experience with 52 consecutive patients. , 2012, Neurosurgery.

[30]  Thomas Backer-Grøndahl,et al.  The histopathological spectrum of human meningiomas. , 2012, International journal of clinical and experimental pathology.

[31]  Jau-Min Wong,et al.  Automatic segmentation of meningioma from non-contrasted brain MRI integrating fuzzy clustering and region growing , 2011, BMC Medical Informatics Decis. Mak..

[32]  E. Claus,et al.  Treatment and survival of patients with nonmalignant intracranial meningioma: results from the Surveillance, Epidemiology, and End Results Program of the National Cancer Institute. Clinical article. , 2011, Journal of neurosurgery.

[33]  M. Lehecka,et al.  Lateral Supraorbital Approach Applied to Anterior Clinoidal Meningiomas: Experience With 73 Consecutive Patients , 2011, Neurosurgery.

[34]  S. Oya,et al.  The natural history of intracranial meningiomas. , 2011, Journal of neurosurgery.

[35]  N. Vick,et al.  Growth rate of non-operated meningiomas , 2008, Journal of Neurology.