Using convolution neural networks to learn enhanced fiber orientation distribution models from commercially available diffusion magnetic resonance imaging

Accurate local fiber orientation distribution (FOD) modeling based on diffusion magnetic resonance imaging (dMRI) capable of resolving complex fiber configurations benefit from specific acquisition protocols that impose a high number of gradient directions (b-vecs), a high maximum b-value (b-vals) and multiple b-values (multi-shell). However, acquisition time is limited in a clinical setting and commercial scanners may not provide robust state-of-the-art dMRI sequences. Therefore, dMRI is often acquired as single-shell (SS) (single b-value). Here, we learn improved FODs for commercially acquired dMRI. We evaluate the use of 3D convolutional neural networks (CNNs) to regress multi-shell FOS representations from single-shell representations, using the spherical harmonics basis obtained from constrained spherical deconvolution (CSD) to model FODs. We use U-Net and HighResNet 3D CNN architectures and data from the publicly available Human Connectome Dataset and a dataset acquired at National Hospital For Neurology and Neurosurgery Queen Square. We evaluate how well the CNN models can resolve local fiber orientation 1) when training and testing on datasets with same dMRI acquisition protocol; 2) when testing on dataset with a different dMRI acquisition protocol than used training the CNN models; and 3) when testing on datasets with a fewer number dMRI gradient directions than used training the CNN models. Our approach may enable robust CSD model estimation on dMRI acquisition protocols which are single shell and with a few gradient directions, reducing acquisition times, and thus, facilitating translation to time-limited clinical environments.

[1]  Sjoerd B. Vos,et al.  Automated fiber tract reconstruction for surgery planning: Extensive validation in language-related white matter tracts , 2019, NeuroImage: Clinical.

[2]  Flavio Dell'Acqua,et al.  Modelling white matter with spherical deconvolution: How and why? , 2018, NMR in biomedicine.

[3]  Thomas R. Knösche,et al.  White matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI , 2013, NeuroImage.

[4]  D. Tuch Q‐ball imaging , 2004, Magnetic resonance in medicine.

[5]  Max A. Viergever,et al.  Trade-off between angular and spatial resolutions in in vivo fiber tractography , 2016, NeuroImage.

[6]  Steen Moeller,et al.  Advances in diffusion MRI acquisition and processing in the Human Connectome Project , 2013, NeuroImage.

[7]  Sebastien Ourselin,et al.  Clinical Applications for Diffusion MRI and Tractography of Cranial Nerves Within the Posterior Fossa: A Systematic Review , 2019, Front. Neurosci..

[8]  Daniel Rueckert,et al.  Geodesic Information Flows: Spatially-Variant Graphs and Their Application to Segmentation and Fusion , 2015, IEEE Transactions on Medical Imaging.

[9]  Jason M. Johnson,et al.  Identification of Preoperative Language Tracts for Intrinsic Frontotemporal Diseases: A Pilot Reconstruction Algorithm in a Middle-Income Country. , 2019, World neurosurgery.

[10]  P. Basser,et al.  Axcaliber: A method for measuring axon diameter distribution from diffusion MRI , 2008, Magnetic resonance in medicine.

[11]  J. E. Tanner,et al.  Self diffusion of water in frog muscle. , 1979, Biophysical journal.

[12]  Sébastien Ourselin,et al.  On the Compactness, Efficiency, and Representation of 3D Convolutional Networks: Brain Parcellation as a Pretext Task , 2017, IPMI.

[13]  Ben Jeurissen,et al.  Diffusion MRI fiber tractography of the brain , 2019, NMR in biomedicine.

[14]  Dorit Merhof,et al.  Diffusion MRI Signal Augmentation: From Single Shell to Multi Shell with Deep Learning , 2016, MICCAI 2016.

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[17]  Bennett A. Landman,et al.  Histological validation of diffusion MRI fiber orientation distributions and dispersion , 2018, NeuroImage.

[18]  M. Wieczorek,et al.  SHTools: Tools for Working with Spherical Harmonics , 2018, Geochemistry, Geophysics, Geosystems.

[19]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  A. Connelly,et al.  Determination of the appropriate b value and number of gradient directions for high‐angular‐resolution diffusion‐weighted imaging , 2013, NMR in biomedicine.

[21]  Colin B. Hansen,et al.  Deep learning reveals untapped information for local white-matter fiber reconstruction in diffusion-weighted MRI. , 2019, Magnetic resonance imaging.

[22]  Kalvis M. Jansons,et al.  Persistent angular structure: new insights from diffusion magnetic resonance imaging data , 2003 .

[23]  F. Kruggel,et al.  Quantitative mapping of the per‐axon diffusion coefficients in brain white matter , 2015, Magnetic resonance in medicine.

[24]  M. Descoteaux High Angular Resolution Diffusion Imaging (HARDI) , 2015 .

[25]  J. Berman,et al.  Diffusion MR tractography as a tool for surgical planning. , 2009, Magnetic resonance imaging clinics of North America.

[26]  Daniel C. Alexander,et al.  NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain , 2012, NeuroImage.

[27]  Chun-Hung Yeh,et al.  MRtrix3: A fast, flexible and open software framework for medical image processing and visualisation , 2019, NeuroImage.

[28]  Antonio Criminisi,et al.  Image quality transfer and applications in diffusion MRI , 2017, NeuroImage.

[29]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[30]  J. Helpern,et al.  Three‐dimensional characterization of non‐gaussian water diffusion in humans using diffusion kurtosis imaging , 2006, NMR in biomedicine.

[31]  C. Westin,et al.  Automated white matter fiber tract identification in patients with brain tumors , 2016, NeuroImage: Clinical.

[32]  Alan Connelly,et al.  Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution , 2007, NeuroImage.

[33]  Antonio Criminisi,et al.  Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution , 2017, MICCAI.

[34]  Rachid Deriche,et al.  Quantitative Comparison of Reconstruction Methods for Intra-Voxel Fiber Recovery From Diffusion MRI , 2014, IEEE Transactions on Medical Imaging.

[35]  Gabriel Girard,et al.  Sparse wars: A survey and comparative study of spherical deconvolution algorithms for diffusion MRI , 2019, NeuroImage.

[36]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[37]  L. O'Donnell,et al.  White matter tractography for neurosurgical planning: A topography-based review of the current state of the art , 2017, NeuroImage: Clinical.

[38]  Parashkev Nachev,et al.  Computer Methods and Programs in Biomedicine NiftyNet: a deep-learning platform for medical imaging , 2022 .

[39]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[40]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[41]  Alan Connelly,et al.  Anatomically-constrained tractography: Improved diffusion MRI streamlines tractography through effective use of anatomical information , 2012, NeuroImage.

[42]  Mark W. Woolrich,et al.  Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? , 2007, NeuroImage.

[43]  A. Anderson Measurement of fiber orientation distributions using high angular resolution diffusion imaging , 2005, Magnetic resonance in medicine.

[44]  Daniel Cremers,et al.  q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans , 2016, IEEE Transactions on Medical Imaging.

[45]  P. Batchelor,et al.  International Society for Magnetic Resonance in Medicine , 1997 .

[46]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[47]  Julien Cohen-Adad,et al.  Pushing the limits of in vivo diffusion MRI for the Human Connectome Project , 2013, NeuroImage.

[48]  Bennett A. Landman,et al.  Comparison of 3D orientation distribution functions measured with confocal microscopy and diffusion MRI , 2016, NeuroImage.

[49]  Jan Sijbers,et al.  Multi-tissue constrained spherical deconvolution for improved analysis of multi-shell diffusion MRI data , 2014, NeuroImage.

[50]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).