Objective Detection of Eloquent Axonal Pathways to Minimize Postoperative Deficits in Pediatric Epilepsy Surgery Using Diffusion Tractography and Convolutional Neural Networks

Convolutional neural networks (CNNs) have recently been used in biomedical imaging applications with great success. In this paper, we investigated the classification performance of CNN models on diffusion weighted imaging (DWI) streamlines defined by functional MRI (fMRI) and electrical stimulation mapping (ESM). To learn a set of discriminative and interpretable features from the extremely unbalanced dataset, we evaluated different CNN architectures with multiple loss functions (e.g., focal loss and center loss) and a soft attention mechanism and compared our models with current state-of-the-art methods. Through extensive experiments on streamlines collected from 70 healthy children and 70 children with focal epilepsy, we demonstrated that our deep CNN model with focal and central losses and soft attention outperforms all existing models in the literature and provides clinically acceptable accuracy (73%–100%) for the objective detection of functionally important white matter pathways, including ESM determined eloquent areas such as primary motors, aphasia, speech arrest, auditory, and visual functions. The findings of this paper encourage further investigations to determine if DWI-CNN analysis can serve as a noninvasive diagnostic tool during pediatric presurgical planning by estimating not only the location of essential cortices at the gyral level but also the underlying fibers connecting these cortical areas to minimize or predict postsurgical functional deficits. This paper translates an advanced CNN model to clinical practice in the pediatric population where currently available approaches (e.g., ESM and fMRI) are suboptimal. The implementation will be released at https://github.com/HaotianMXu/Brain-fiber-classification-using-CNNs.

[1]  Michael H Kohrman,et al.  ECoG gamma activity during a language task: differentiating expressive and receptive speech areas. , 2008, Brain : a journal of neurology.

[2]  Yogesh Rathi,et al.  An anatomically curated fiber clustering white matter atlas for consistent white matter tract parcellation across the lifespan , 2018, NeuroImage.

[3]  L. M. Auer,et al.  Fiber Tracking from DTI Using Linear State Space Models: Detectability of the Pyramidal Tract , 2002, NeuroImage.

[4]  R. Freeman,et al.  Neurometabolic coupling in cerebral cortex reflects synaptic more than spiking activity , 2007, Nature Neuroscience.

[5]  D. Tuch Q‐ball imaging , 2004, Magnetic resonance in medicine.

[6]  Eishi Asano,et al.  Young patients with focal seizures may have the primary motor area for the hand in the postcentral gyrus , 2007, Epilepsy Research.

[7]  Ming Dong,et al.  Coupled End-to-End Transfer Learning with Generalized Fisher Information , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Paolo Avesani,et al.  Tractome: a visual data mining tool for brain connectivity analysis , 2015, Data Mining and Knowledge Discovery.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  R. Kuzniecky,et al.  A developmental and genetic classification for malformations of cortical development: update 2012 , 2012, Brain : a journal of neurology.

[12]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[13]  David K. Yu,et al.  Superficial white matter fiber systems impede detection of long-range cortical connections in diffusion MR tractography , 2015, Proceedings of the National Academy of Sciences.

[14]  Stamatios N. Sotiropoulos,et al.  An integrated approach to correction for off-resonance effects and subject movement in diffusion MR imaging , 2016, NeuroImage.

[15]  D. Leopold,et al.  Anatomical accuracy of brain connections derived from diffusion MRI tractography is inherently limited , 2014, Proceedings of the National Academy of Sciences.

[16]  Alan Connelly,et al.  SIFT: Spherical-deconvolution informed filtering of tractograms , 2013, NeuroImage.

[17]  Vijay N. Tiwari,et al.  Automatic detection of primary motor areas using diffusion MRI tractography: Comparison with functional MRI and electrical stimulation mapping , 2013, Epilepsia.

[18]  Carl-Fredrik Westin,et al.  Automatic Tractography Segmentation Using a High-Dimensional White Matter Atlas , 2007, IEEE Transactions on Medical Imaging.

[19]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Martin Styner,et al.  TRAFIC: fiber tract classification using deep learning , 2018, Medical Imaging.

[21]  Jeong-Won Jeong,et al.  Localization of specific language pathways using diffusion‐weighted imaging tractography for presurgical planning of children with intractable epilepsy , 2015, Epilepsia.

[22]  Eishi Asano,et al.  Clinical significance and developmental changes of auditory-language-related gamma activity , 2013, Clinical Neurophysiology.

[23]  Byron Bernal,et al.  Seizure disorders: functional MR imaging for diagnostic evaluation and surgical treatment--prospective study. , 2005, Radiology.

[24]  Ming Dong,et al.  Generating synthetic CTs from magnetic resonance images using generative adversarial networks , 2018, Medical physics.

[25]  A. Anderson,et al.  Classification and quantification of neuronal fiber pathways using diffusion tensor MRI , 2003, Magnetic resonance in medicine.

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[28]  Alan Connelly,et al.  Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution , 2007, NeuroImage.

[29]  Gustavo Rey,et al.  Different features of histopathological subtypes of pediatric focal cortical dysplasia , 2008, Annals of neurology.

[30]  David H. Laidlaw,et al.  Exploring 3D DTI Fiber Tracts with Linked 2D Representations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[31]  L. Hertz-Pannier,et al.  Presurgical language mapping in children with epilepsy: Clinical usefulness of functional magnetic resonance imaging for the planning of cortical stimulation , 2012, Epilepsia.

[32]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[33]  R. Kuzniecky Epilepsy and malformations of cortical development: new developments. , 2015, Current opinion in neurology.

[34]  Nathan E. Crone,et al.  Subdural electrodes , 2010, Clinical Neurophysiology.

[35]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[36]  P. Glees,et al.  Somatotopic analysis of fibre and terminal distribution in the primate corticospinal pathway. , 1986, Brain research.

[37]  A. Connelly,et al.  Improved probabilistic streamlines tractography by 2 nd order integration over fibre orientation distributions , 2009 .

[38]  Alan Connelly,et al.  Direct estimation of the fiber orientation density function from diffusion-weighted MRI data using spherical deconvolution , 2004, NeuroImage.

[39]  Ming Dong,et al.  Automatic detection of eloquent axonal pathways in diffusion tractography using intracanial electrical stimulation mapping and convolutional neural networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[40]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[41]  Paul M. Thompson,et al.  FiberNET: An ensemble deep learning framework for clustering white matter fibers , 2017, bioRxiv.

[42]  Alan Connelly,et al.  Anatomically-constrained tractography: Improved diffusion MRI streamlines tractography through effective use of anatomical information , 2012, NeuroImage.

[43]  Guy B. Williams,et al.  QuickBundles, a Method for Tractography Simplification , 2012, Front. Neurosci..

[44]  Eva K Ritzl,et al.  The fMRI success rate of children and adolescents: Typical development, epilepsy, attention deficit/hyperactivity disorder, and autism spectrum disorders , 2009, Human brain mapping.

[45]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[46]  P. Hagmann,et al.  Mapping complex tissue architecture with diffusion spectrum magnetic resonance imaging , 2005, Magnetic resonance in medicine.

[47]  G. Pearlson,et al.  In vivo visualization of human neural pathways by magnetic resonance imaging , 2000, Annals of neurology.

[48]  Nadia Colombo,et al.  Focal cortical dysplasias: MR imaging, histopathologic, and clinical correlations in surgically treated patients with epilepsy. , 2003, AJNR. American journal of neuroradiology.

[49]  Andrea Bernasconi,et al.  Small focal cortical dysplasia lesions are located at the bottom of a deep sulcus. , 2008, Brain : a journal of neurology.

[50]  N. Makris,et al.  High angular resolution diffusion imaging reveals intravoxel white matter fiber heterogeneity , 2002, Magnetic resonance in medicine.

[51]  G. Bertrand,et al.  The position and organization of motor fibers in the internal capsule found during stereotactic surgery. , 1979, Applied neurophysiology.

[52]  C. Westin,et al.  Automated white matter fiber tract identification in patients with brain tumors , 2016, NeuroImage: Clinical.

[53]  W. Eric L. Grimson,et al.  Automated Atlas-Based Clustering of White Matter Fiber Tracts from DTMRI , 2005, MICCAI.

[54]  Fang-Cheng Yeh,et al.  Generalized ${ q}$-Sampling Imaging , 2010, IEEE Transactions on Medical Imaging.

[55]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Jean-Francois Mangin,et al.  Automatic fiber bundle segmentation in massive tractography datasets using a multi-subject bundle atlas , 2012, NeuroImage.

[57]  Maxime Descoteaux,et al.  Recognition of white matter bundles using local and global streamline-based registration and clustering , 2017, NeuroImage.

[58]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[59]  Eishi Asano,et al.  Three- and four-dimensional mapping of speech and language in patients with epilepsy , 2017, Brain : a journal of neurology.