Tractography filtering using autoencoders

Current brain white matter fiber tracking techniques show a number of problems, including: generating large proportions of streamlines that do not accurately describe the underlying anatomy; extracting streamlines that are not supported by the underlying diffusion signal; and under-representing some fiber populations, among others. In this paper, we describe a novel unsupervised learning method to filter streamlines from diffusion MRI tractography, and hence, to obtain more reliable tractograms. We show that a convolutional neural network autoencoder provides a straightforward and elegant way to learn a robust representation of brain streamlines, which can be used to filter undesired samples with a nearest neighbor algorithm. Our method, dubbed FINTA (Filtering in Tractography using Autoencoders) comes with several key advantages: training does not need labeled data, as it uses raw tractograms, it is fast and easily reproducible, it does not rely on the input diffusion MRI data, and thus, does not suffer from domain adaptation issues. We demonstrate the ability of FINTA to discriminate between "plausible" and "implausible" streamlines as well as to recover individual streamline group instances from a raw tractogram, from both synthetic and real human brain diffusion arXiv:2010.04007v1 [eess.IV] 7 Oct 2020 PREPRINT. PAPER UNDER REVIEW-OCTOBER 9, 2020 MRI tractography data, including partial tractograms. Results reveal that FINTA has a superior filtering performance compared to state-of-the-art methods. Together, this work brings forward a new deep learning framework in tractography based on autoen-coders, and shows how it can be applied for filtering purposes. It sets the foundations for opening up new prospects towards more accurate and robust tractometry and connectivity diffusion MRI analyses, which may ultimately lead to improve the imaging of the white matter anatomy.

[1]  Christophe Lenglet,et al.  Advances in computational and statistical diffusion MRI , 2019, NMR in biomedicine.

[2]  Walter Schneider,et al.  3D Convolutional Neural Network Segmentation of White Matter Tract Masks from MR Diffusion Anisotropy Maps , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[3]  L. Petit,et al.  New insights in the homotopic and heterotopic connectivity of the frontal portion of the human corpus callosum revealed by microdissection and diffusion tractography , 2016, Human brain mapping.

[4]  Bruce Fischl,et al.  AnatomiCuts: Hierarchical clustering of tractography streamlines based on anatomical similarity , 2016, NeuroImage.

[5]  Maxime Descoteaux,et al.  Surface-enhanced tractography (SET) , 2017, NeuroImage.

[6]  Rachid Deriche,et al.  Unsupervised white matter fiber clustering and tract probability map generation: Applications of a Gaussian process framework for white matter fibers , 2010, NeuroImage.

[7]  Chun-Hung Yeh,et al.  Connectomes from streamlines tractography: Assigning streamlines to brain parcellations is not trivial but highly consequential , 2019, NeuroImage.

[8]  Alan Connelly,et al.  SIFT2: Enabling dense quantitative assessment of brain white matter connectivity using streamlines tractography , 2015, NeuroImage.

[9]  M. Ptito,et al.  Uncovering the inferior fronto-occipital fascicle and its topological organization in non-human primates: the missing connection for language evolution , 2019, Brain Structure and Function.

[10]  D. Bullock,et al.  Associative white matter connecting the dorsal and ventral posterior human cortex , 2019, Brain Structure and Function.

[11]  Jean-Philippe Thiran,et al.  COMMIT: Convex Optimization Modeling for Microstructure Informed Tractography , 2015, IEEE Transactions on Medical Imaging.

[12]  Francois Rheault,et al.  Common misconceptions, hidden biases and modern challenges of dMRI tractography , 2020, Journal of neural engineering.

[13]  Daniel Bullock,et al.  Classifyber, a robust streamline-based linear classifier for white matter bundle segmentation , 2020, NeuroImage.

[14]  Kuldeep Kumar,et al.  White matter fiber analysis using kernel dictionary learning and sparsity priors , 2018, Pattern Recognit..

[15]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Bernard Mazoyer,et al.  BIL&GIN: A neuroimaging, cognitive, behavioral, and genetic database for the study of human brain lateralization , 2016, NeuroImage.

[18]  Stephen T. C. Wong,et al.  A hybrid approach to automatic clustering of white matter fibers , 2010, NeuroImage.

[19]  Oeslle Alexandre Soares de Lucena Deep learning for brain analysis in MR imaging : Aprendizado profundo para análise do cérebro em imagens de ressonância magnética , 2018 .

[20]  Maxime Descoteaux,et al.  Quantitative evaluation of 10 tractography algorithms on a realistic diffusion MR phantom , 2011, NeuroImage.

[21]  Paul M. Thompson,et al.  Automatic clustering of white matter fibers in brain diffusion MRI with an application to genetics , 2014, NeuroImage.

[22]  Bram Stieltjes,et al.  Fiberfox: Facilitating the creation of realistic white matter software phantoms , 2014, Magnetic resonance in medicine.

[23]  Martin Styner,et al.  TRAFIC: fiber tract classification using deep learning , 2018, Medical Imaging.

[24]  Franco Pestilli,et al.  Occipital white matter tracts in human and macaque , 2016, bioRxiv.

[25]  Chun-Hung Yeh,et al.  Correction for diffusion MRI fibre tracking biases: The consequences for structural connectomic metrics , 2016, NeuroImage.

[26]  Paul M. Thompson,et al.  Fibernet 2.0: An Automatic Neural Network Based Tool for Clustering White Matter Fibers in the Brain , 2017, bioRxiv.

[27]  Maxime Descoteaux,et al.  Robust clustering of massive tractography datasets , 2011, NeuroImage.

[28]  Paolo Avesani,et al.  White Matter Tract Segmentation as Multiple Linear Assignment Problems , 2018, Front. Neurosci..

[29]  Gabriel Girard,et al.  Tractostorm: The what, why, and how of tractography dissection reproducibility , 2020, Human brain mapping.

[30]  Carl-Fredrik Westin,et al.  Automatic Tractography Segmentation Using a High-Dimensional White Matter Atlas , 2007, IEEE Transactions on Medical Imaging.

[31]  Yonggang Shi,et al.  GIFE: Efficient and Robust Group-Wise Isometric Fiber Embedding , 2018, CNI@MICCAI.

[32]  Arthur W. Toga,et al.  Modeling topographic regularity in structural brain connectivity with application to tractogram filtering , 2018, NeuroImage.

[33]  Gaël Varoquaux,et al.  A Comparison of Metrics and Algorithms for Fiber Clustering , 2013, 2013 International Workshop on Pattern Recognition in Neuroimaging.

[34]  Andrew Zalesky,et al.  Building connectomes using diffusion MRI: why, how and but , 2017, NMR in biomedicine.

[35]  Olivier Bernard,et al.  Cardiac MRI Segmentation with Strong Anatomical Guarantees , 2019, MICCAI.

[36]  Peter F. Neher,et al.  The challenge of mapping the human connectome based on diffusion tractography , 2017, Nature Communications.

[37]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[38]  Klaus H. Maier-Hein,et al.  Bundle-specific tractography with incorporated anatomical and orientational priors , 2019, NeuroImage.

[39]  Maxime Descoteaux,et al.  A new compression format for fiber tracking datasets , 2015, NeuroImage.

[40]  Francois Rheault,et al.  Analyse et reconstruction de faisceaux de la matière blanche , 2020 .

[41]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[42]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[43]  Alexandra J. Golby,et al.  Deep white matter analysis (DeepWMA): Fast and consistent tractography segmentation , 2020, Medical Image Anal..

[44]  Chiranjoy Chattopadhyay,et al.  Siamese LSTM based Fiber Structural Similarity Network (FS2Net) for Rotation Invariant Brain Tractography Segmentation , 2017, ArXiv.

[45]  Carlo Pierpaoli,et al.  Brain connections derived from diffusion MRI tractography can be highly anatomically accurate—if we know where white matter pathways start, where they end, and where they do not go , 2020, Brain Structure and Function.

[46]  Chun-Hung Yeh,et al.  Mapping Structural Connectivity Using Diffusion MRI: Challenges and Opportunities , 2020, Journal of magnetic resonance imaging : JMRI.

[47]  Rachid Deriche,et al.  Towards quantitative connectivity analysis: reducing tractography biases , 2014, NeuroImage.

[48]  W. Eric L. Grimson,et al.  A unified framework for clustering and quantitative analysis of white matter fiber tracts , 2008, Medical Image Anal..

[49]  D. Louis Collins,et al.  Unbiased average age-appropriate atlases for pediatric studies , 2011, NeuroImage.

[50]  Devran Ugurlu,et al.  Correction to: Supervised Classification of White Matter Fibers Based on Neighborhood Fiber Orientation Distributions Using an Ensemble of Neural Networks , 2019, Computational Diffusion MRI.

[51]  Ben Jeurissen,et al.  Diffusion MRI fiber tractography of the brain , 2019, NMR in biomedicine.

[52]  Arthur W. Toga,et al.  Atlas-guided tract reconstruction for automated and comprehensive examination of the white matter anatomy , 2010, NeuroImage.

[53]  Leonardo L. Gollo,et al.  Connectome sensitivity or specificity: which is more important? , 2016, NeuroImage.

[54]  Paul M. Thompson,et al.  FiberNET: An ensemble deep learning framework for clustering white matter fibers , 2017, bioRxiv.

[55]  Maxime Descoteaux,et al.  Recognition of white matter bundles using local and global streamline-based registration and clustering , 2017, NeuroImage.

[56]  Maxime Descoteaux,et al.  Tractometer: Towards validation of tractography pipelines , 2013, Medical Image Anal..

[57]  Carl-Fredrik Westin,et al.  Clustering Fiber Traces Using Normalized Cuts , 2004, MICCAI.

[58]  Alan Connelly,et al.  Anatomically-constrained tractography: Improved diffusion MRI streamlines tractography through effective use of anatomical information , 2012, NeuroImage.

[59]  Guy B. Williams,et al.  QuickBundles, a Method for Tractography Simplification , 2012, Front. Neurosci..

[60]  Carl-Fredrik Westin,et al.  The white matter query language: a novel approach for describing human white matter anatomy , 2015, Brain Structure and Function.

[61]  Vittorio Murino,et al.  Unsupervised Detection of White Matter Fiber Bundles with Stochastic Neural Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[62]  Jean-Philippe Thiran,et al.  A new method for accurate in vivo mapping of human brain connections using microstructural and anatomical information , 2020, Science Advances.

[63]  Alan Connelly,et al.  Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution , 2007, NeuroImage.

[64]  Wiro J. Niessen,et al.  Neuro4Neuro: A neural network approach for neural tract segmentation using large-scale population-based diffusion imaging , 2020, NeuroImage.

[65]  Marc Joliot,et al.  A population-based atlas of the human pyramidal tract in 410 healthy participants , 2018, Brain Structure and Function.

[66]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[67]  Christian S. Perone,et al.  Unsupervised domain adaptation for medical imaging segmentation with self-ensembling , 2018, NeuroImage.

[68]  Alan Connelly,et al.  SIFT: Spherical-deconvolution informed filtering of tractograms , 2013, NeuroImage.