A CADe System for Gliomas in Brain MRI using Convolutional Neural Networks

Inspired by the success of Convolutional Neural Networks (CNN), we develop a novel Computer Aided Detection (CADe) system using CNN for Glioblastoma Multiforme (GBM) detection and segmentation from multi channel MRI data. A two-stage approach first identifies the presence of GBM. This is followed by a GBM localization in each "abnormal" MR slice. As part of the CADe system, two CNN architectures viz. Classification CNN (C-CNN) and Detection CNN (D-CNN) are employed. The CADe system considers MRI data consisting of four sequences ($T_1$, $T_{1c},$ $T_2$, and $T_{2FLAIR}$) as input, and automatically generates the bounding boxes encompassing the tumor regions in each slice which is deemed abnormal. Experimental results demonstrate that the proposed CADe system, when used as a preliminary step before segmentation, can allow improved delineation of tumor region while reducing false positives arising in normal areas of the brain. The GrowCut method, employed for tumor segmentation, typically requires a foreground and background seed region for initialization. Here the algorithm is initialized with seeds automatically generated from the output of the proposed CADe system, thereby resulting in improved performance as compared to that using random seeds.

[1]  Nikos Paragios,et al.  Joint Tumor Segmentation and Dense Deformable Registration of Brain MR Images , 2012, MICCAI.

[2]  Guido Gerig,et al.  A brain tumor segmentation framework based on outlier detection , 2004, Medical Image Anal..

[3]  Atiq Islam,et al.  Multifractal Texture Estimation for Detection and Segmentation of Brain Tumors , 2013, IEEE Transactions on Biomedical Engineering.

[4]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[5]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[6]  Nicholas Ayache,et al.  A Generative Model for Brain Tumor Segmentation in Multi-Modal Images , 2010, MICCAI.

[7]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[10]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[11]  Yaroslav Bulatov,et al.  Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks , 2013, ICLR.

[12]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Subhashis Banerjee,et al.  A Novel GBM Saliency Detection Model Using Multi-Channel MRI , 2016, PloS one.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[16]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[17]  Claudio Pollo,et al.  Atlas-based segmentation of pathological MR brain images using a model of lesion growth , 2004, IEEE Transactions on Medical Imaging.

[18]  R R Edelman,et al.  Magnetic resonance imaging (1). , 1993, The New England journal of medicine.

[19]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[20]  B. Scheithauer,et al.  The 2007 WHO classification of tumours of the central nervous system , 2007, Acta Neuropathologica.

[21]  D. Louis Collins,et al.  Hierarchical Probabilistic Gabor and MRF Segmentation of Brain Tumours in MRI Volumes , 2013, MICCAI.

[22]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[23]  Subhashis Banerjee,et al.  ROI Segmentation from Brain MR Images with a Fast Multilevel Thresholding , 2016, CVIP.

[24]  M. Mohammed Thaha,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2019, Journal of Medical Systems.

[25]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[26]  Subhashis Banerjee,et al.  Single seed delineation of brain tumor using multi-thresholding , 2016, Inf. Sci..

[27]  Ben Glocker,et al.  Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR , 2012, MICCAI.

[28]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[29]  Dorin Comaniciu,et al.  Marginal Space Deep Learning: Efficient Architecture for Volumetric Image Parsing , 2016, IEEE Transactions on Medical Imaging.

[30]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[31]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[32]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[33]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[34]  Sushmita Mitra,et al.  Medical image analysis for cancer management in natural computing framework , 2015, Inf. Sci..

[35]  Guang Yang,et al.  Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI , 2016, International Journal of Computer Assisted Radiology and Surgery.

[36]  Fred A. Hamprecht,et al.  Multi-modal Brain Tumor Segmentation using Deep Convolutional Neural Networks , 2014 .

[37]  Antonio Criminisi,et al.  Segmentation of Brain Tumor Tissues with Convolutional Neural Networks , 2014 .

[38]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[39]  Wei Wu,et al.  Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features , 2013, International Journal of Computer Assisted Radiology and Surgery.

[40]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[41]  Anam Mustaqeem,et al.  An Efficient Brain Tumor Detection Algorithm Using Watershed & Thresholding Based Segmentation , 2012 .

[42]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[43]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[44]  Konstantinos Kamnitsas,et al.  DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[45]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[46]  Dinggang Shen,et al.  ORBIT: A Multiresolution Framework for Deformable Registration of Brain Tumor Images , 2008, IEEE Transactions on Medical Imaging.

[47]  Isabelle Bloch,et al.  3D brain tumor segmentation in MRI using fuzzy classification, symmetry analysis and spatially constrained deformable models , 2009, Fuzzy Sets Syst..

[48]  Russell Greiner,et al.  Quick detection of brain tumors and edemas: A bounding box method using symmetry , 2012, Comput. Medical Imaging Graph..

[49]  Yogesh K. Meghrajani,et al.  Brain tumor extraction from MRI image using mathematical morphological reconstruction , 2014, 2014 2nd International Conference on Emerging Technology Trends in Electronics, Communication and Networking.

[50]  Sushmita Mitra,et al.  Integrating Radio Imaging With Gene Expressions Toward a Personalized Management of Cancer , 2014, IEEE Transactions on Human-Machine Systems.

[51]  L. Deangelis,et al.  Brain Tumors , 2019, Imaging Gliomas After Treatment.

[52]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[53]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.