Deep white matter analysis (DeepWMA): Fast and consistent tractography segmentation

White matter tract segmentation, i.e. identifying tractography fibers (streamline trajectories) belonging to anatomically meaningful fiber tracts, is an essential step to enable tract quantification and visualization. In this study, we present a deep learning tractography segmentation method (DeepWMA) that allows fast and consistent identification of 54 major deep white matter fiber tracts from the whole brain. We create a large-scale training tractography dataset of 1 million labeled fiber samples, and we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a convolutional neural network (CNN) fiber classification model based on FiberMap and obtain a high fiber classification accuracy of 90.99% on the training tractography data with ground truth fiber labels. Then, the method is evaluated on a test dataset of 597 diffusion MRI scans from six independently acquired populations across genders, the lifespan (1 day - 82 years), and different health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art tract segmentation methods. Experimental results show that our method obtains a highly consistent tract segmentation result, where on average over 99% of the fiber tracts are successfully identified across all subjects under study, most importantly, including neonates and patients with space-occupying brain tumors. We also demonstrate good generalization of the method to tractography data from multiple different fiber tracking methods. The proposed method leverages deep learning techniques and provides a fast and efficient tool for brain white matter segmentation in large diffusion MRI tractography datasets.

[1]  Anders M. Dale,et al.  The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites , 2018, Developmental Cognitive Neuroscience.

[2]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[3]  Felix C. Morency,et al.  A test-retest study on Parkinson's PPMI dataset yields statistically significant white matter fascicles , 2017, NeuroImage: Clinical.

[4]  Alex R. Smith,et al.  Sex differences in the structural connectome of the human brain , 2013, Proceedings of the National Academy of Sciences.

[5]  Carl-Fredrik Westin,et al.  SlicerDMRI: Open Source Diffusion MRI Software for Brain Cancer Research. , 2017, Cancer research.

[6]  Yogesh Rathi,et al.  White matter abnormalities across the lifespan of schizophrenia: a harmonized multi-site diffusion MRI study , 2019, Molecular Psychiatry.

[7]  Carl-Fredrik Westin,et al.  Processing and visualization for diffusion tensor MRI , 2002, Medical Image Anal..

[8]  Pew-Thian Yap,et al.  DeepBundle: Fiber Bundle Parcellation with Graph Convolution Neural Networks , 2019, GLMI@MICCAI.

[9]  Weidong Cai,et al.  Suprathreshold fiber cluster statistics: Leveraging white matter geometry to enhance tractography statistical analysis , 2018, NeuroImage.

[10]  Maxime Descoteaux,et al.  Recognition of white matter bundles using local and global streamline-based registration and clustering , 2017, NeuroImage.

[11]  Daniel P. Kennedy,et al.  Enhancing studies of the connectome in autism using the autism brain imaging data exchange II , 2017, Scientific Data.

[12]  Carl-Fredrik Westin,et al.  Unbiased Groupwise Registration of White Matter Tractography , 2012, MICCAI.

[13]  Jan K. Buitelaar,et al.  Partition-based mass clustering of tractography streamlines , 2011, NeuroImage.

[14]  Rory J. Piper,et al.  Application of diffusion tensor imaging and tractography of the optic radiation in anterior temporal lobe resection for epilepsy: A systematic review , 2014, Clinical Neurology and Neurosurgery.

[15]  Jean-Francois Mangin,et al.  Automatic fiber bundle segmentation in massive tractography datasets using a multi-subject bundle atlas , 2012, NeuroImage.

[16]  Anders M. Dale,et al.  ENIGMA and the individual: Predicting factors that affect the brain in 35 countries worldwide , 2017, NeuroImage.

[17]  Yogesh Rathi,et al.  Investigation into local white matter abnormality in emotional processing and sensorimotor areas using an automatically annotated fiber clustering in major depressive disorder , 2018, NeuroImage.

[18]  C. Westin,et al.  Automated white matter fiber tract identification in patients with brain tumors , 2016, NeuroImage: Clinical.

[19]  Carl-Fredrik Westin,et al.  The white matter query language: a novel approach for describing human white matter anatomy , 2015, Brain Structure and Function.

[20]  Peter F. Neher,et al.  Combined tract segmentation and orientation mapping for bundle-specific tractography , 2019, Medical Image Anal..

[21]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[22]  Martin Styner,et al.  TRAFIC: fiber tract classification using deep learning , 2018, Medical Imaging.

[23]  Waltz,et al.  Descriptor : An open resource for transdiagnostic research in pediatric mental health and learning disorders , 2019 .

[24]  Peter Savadjiev,et al.  Whole brain white matter connectivity analysis using machine learning: An application to autism , 2017, NeuroImage.

[25]  Kuldeep Kumar,et al.  Fiberprint: A subject fingerprint based on sparse code pooling for white matter fiber analysis , 2017, NeuroImage.

[26]  Bruce Fischl,et al.  AnatomiCuts: Hierarchical clustering of tractography streamlines based on anatomical similarity , 2016, NeuroImage.

[27]  Paul M. Thompson,et al.  Fibernet 2.0: An Automatic Neural Network Based Tool for Clustering White Matter Fibers in the Brain , 2017, bioRxiv.

[28]  Ming Dong,et al.  Objective Detection of Eloquent Axonal Pathways to Minimize Postoperative Deficits in Pediatric Epilepsy Surgery Using Diffusion Tractography and Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[29]  Volker A. Coenen,et al.  HAMLET: Hierarchical Harmonic Filters for Learning Tracts from Diffusion MRI , 2018, ArXiv.

[30]  Paul M. Thompson,et al.  FiberNET: An ensemble deep learning framework for clustering white matter fibers , 2017 .

[31]  Maxat Kulmanov,et al.  DeepGO: predicting protein functions from sequence and interactions using a deep ontology-aware classifier , 2017, Bioinform..

[32]  L. O'Donnell,et al.  White matter tractography for neurosurgical planning: A topography-based review of the current state of the art , 2017, NeuroImage: Clinical.

[33]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[34]  Paul M. Thompson,et al.  Automatic clustering of white matter fibers in brain diffusion MRI with an application to genetics , 2014, NeuroImage.

[35]  Kei Yamada,et al.  MR tractography: a review of its clinical applications. , 2009, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[36]  Cassandra D. Leonardo,et al.  Comparison of nine tractography algorithms for detecting abnormal structural brain networks in Alzheimer’s disease , 2015, Front. Aging Neurosci..

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  Martha Elizabeth Shenton,et al.  Filtered Multitensor Tractography , 2010, IEEE Transactions on Medical Imaging.

[39]  Daniel Rueckert,et al.  The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction , 2017, NeuroImage.

[40]  Alexandra J. Golby,et al.  Performance of unscented Kalman filter tractography in edema: Analysis of the two-tensor model , 2017, NeuroImage: Clinical.

[41]  Alexandra J. Golby,et al.  Free water modeling of peritumoral edema using multi-fiber tractography: Application to tracking the arcuate fasciculus for neurosurgical planning , 2018, PloS one.

[42]  Tushar Gupta,et al.  BrainSegNet : A Segmentation Network for Human Brain Fiber Tractography Data into Anatomically Meaningful Clusters , 2017, ArXiv.

[43]  Gabriel Girard,et al.  Tractostorm: The what, why, and how of tractography dissection reproducibility , 2020, Human brain mapping.

[44]  Carl-Fredrik Westin,et al.  Automatic Tractography Segmentation Using a High-Dimensional White Matter Atlas , 2007, IEEE Transactions on Medical Imaging.

[45]  Fang-Cheng Yeh,et al.  Connectometry: A statistical approach harnessing the analytical potential of the local connectome , 2016, NeuroImage.

[46]  L. O'Donnell,et al.  Reconstruction of the arcuate fasciculus for surgical planning in the setting of peritumoral edema using two-tensor unscented Kalman filter tractography , 2015, NeuroImage: Clinical.

[47]  Yogesh Rathi,et al.  An anatomically curated fiber clustering white matter atlas for consistent white matter tract parcellation across the lifespan , 2018, NeuroImage.

[48]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[49]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[50]  A. Singleton,et al.  The Parkinson Progression Marker Initiative (PPMI) , 2011, Progress in Neurobiology.

[51]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[52]  Carl-Fredrik Westin,et al.  SlicerDMRI: Diffusion MRI and Tractography Research Software for Brain Cancer Surgery Planning and Visualization , 2020, JCO clinical cancer informatics.

[53]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[54]  M. Catani,et al.  Diffusion-based tractography in neurological disorders: concepts, applications, and future developments , 2008, The Lancet Neurology.

[55]  Rachid Deriche,et al.  Unsupervised white matter fiber clustering and tract probability map generation: Applications of a Gaussian process framework for white matter fibers , 2010, NeuroImage.

[56]  Fan Zhang,et al.  Creation of a novel trigeminal tractography atlas for automated trigeminal nerve identification , 2020, NeuroImage.

[57]  Chun-Hung Yeh,et al.  Connectomes from streamlines tractography: Assigning streamlines to brain parcellations is not trivial but highly consequential , 2019, NeuroImage.

[58]  Ye Wu,et al.  Test–retest reproducibility of white matter parcellation using diffusion MRI tractography fiber clustering , 2019, Human brain mapping.

[59]  A. Anderson,et al.  Classification and quantification of neuronal fiber pathways using diffusion tensor MRI , 2003, Magnetic resonance in medicine.

[60]  Peter F. Neher,et al.  The challenge of mapping the human connectome based on diffusion tractography , 2017, Nature Communications.

[61]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[62]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[63]  Nadim Joni Shah,et al.  Human cortical connectome reconstruction from diffusion weighted MRI: The effect of tractography algorithm , 2012, NeuroImage.

[64]  Krzysztof J. Gorgolewski,et al.  A phenome-wide examination of neural and cognitive function , 2016, Scientific Data.

[65]  Edward T. Bullmore,et al.  Connectivity differences in brain networks , 2012, NeuroImage.

[66]  Kerstin Pannek,et al.  Magnetic resonance diffusion tractography of the preterm infant brain: a systematic review , 2014, Developmental medicine and child neurology.

[67]  Maxime Descoteaux,et al.  Tractography and machine learning: Current state and open challenges , 2019, Magnetic resonance imaging.

[68]  Susumu Mori,et al.  Fiber tracking: principles and strategies – a technical review , 2002, NMR in biomedicine.

[69]  Luke Macyszyn,et al.  Individualized Map of White Matter Pathways: Connectivity-Based Paradigm for Neurosurgical Planning. , 2016, Neurosurgery.

[70]  Alexandra J. Golby,et al.  Deep White Matter Analysis: Fast, Consistent Tractography Segmentation Across Populations and dMRI Acquisitions , 2019, MICCAI.

[71]  Christophe Lenglet,et al.  Automatic clustering and population analysis of white matter tracts using maximum density paths , 2014, NeuroImage.

[72]  Edward T. Bullmore,et al.  Small-World Brain Networks Revisited , 2016, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[73]  Thomas E. Nichols,et al.  Extending the Human Connectome Project across ages: Imaging protocols for the Lifespan Development and Aging projects , 2018, NeuroImage.

[74]  M. Catani,et al.  A diffusion tensor imaging tractography atlas for virtual in vivo dissections , 2008, Cortex.

[75]  Alan C. Evans,et al.  Mapping anatomical connectivity patterns of human cerebral cortex using in vivo diffusion tensor imaging tractography. , 2009, Cerebral cortex.