Fast learning of fiber orientation distribution function for MR tractography using convolutional neural network.

PURPOSE In diffusion-weighted magnetic resonance imaging (DW-MRI), the fiber orientation distribution function (fODF) is of great importance for solving complex fiber configurations to achieve reliable tractography throughout the brain, which ultimately facilitates the understanding of brain connectivity and exploration of neurological dysfunction. Recently, multi-shell multi-tissue constrained spherical deconvolution (MSMT-CSD) method has been explored for reconstructing full fODFs. To achieve a reliable fitting, similar to other model-based approaches, a large number of diffusion measurements is typically required for MSMT-CSD method. The prolonged acquisition is, however, not feasible in practical clinical routine and is prone to motion artifacts. To accelerate the acquisition, we proposed a method to reconstruct the fODF from downsampled diffusion-weighted images (DWIs) by leveraging the strong inference ability of the deep convolutional neural network (CNN). METHODS The method treats spherical harmonics (SH)-represented DWI signals and fODF coefficients as inputs and outputs, respectively. To compensate for the reduced gradient directions with reduced number of DWIs in acquisition in each voxel, its surrounding voxels are incorporated by the network for exploiting their spatial continuity. The resulting fODF coefficients are fitted with applying the CNN in a multi-target regression model. The network is composed of two convolutional layers and three fully connected layers. To obtain an initial evaluation of the method, we quantitatively measured its performance on a simulated dataset. Then, for in vivo tests, we employed data from 24 subjects from the Human Connectome Project (HCP) as training set and six subjects as test set. The performance of the proposed method was primarily compared to the super-resolved MSMT-CSD with the decreasing number of DWIs. The fODFs reconstructed by MSMT-CSD from all available 288 DWIs were used as training labels and the reference standard. The performance was quantitatively measured by the angular correlation coefficient (ACC) and the mean angular error (MAE). RESULTS For the simulated dataset, the proposed method exhibited the potential advantage over the model reconstruction. For the in vivo dataset, it achieved superior results over the MSMT-CSD in all the investigated cases, with its advantage more obvious when a limited number of DWIs were used. As the number of DWIs was reduced from 95 to 25, the median ACC ranged from 0.96 to 0.91 for the CNN, but 0.93 to 0.77 for the MSMT-CSD (with perfect score of 1). The angular error in the typical regions of interest (ROIs) was also much lower, especially in multi-fiber regions. The average MAE for the CNN method in regions containing one, two, three fibers was, respectively, 1.09°, 2.75°, and 8.35° smaller than the MSMT-CSD method. The visual inception of the fODF further confirmed this superiority. Moreover, the tractography results validated the effectiveness of the learned fODF, in preserving known major branching fibers with only 25 DWIs. CONCLUSION Experiments on HCP datasets demonstrated the feasibility of the proposed method in recovering fODFs from up to 11-fold reduced number of DWIs. The proposed method offers a new streamlined reconstruction procedure and exhibits promising potential in acquisition acceleration for the reconstruction of fODFs with good accuracy.

[1]  Lutz Prechelt,et al.  Early Stopping - But When? , 2012, Neural Networks: Tricks of the Trade.

[2]  Dinggang Shen,et al.  Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis , 2014, MICCAI.

[3]  Dennis M. Healy,et al.  Spherical Deconvolution , 1998 .

[4]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[5]  Alan Julian Izenman,et al.  Modern Multivariate Statistical Techniques , 2008 .

[6]  Steen Moeller,et al.  The Human Connectome Project's neuroimaging approach , 2016, Nature Neuroscience.

[7]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[8]  Timothy D. Verstynen,et al.  Deterministic Diffusion Fiber Tracking Improved by Quantitative Anisotropy , 2013, PloS one.

[9]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[10]  M. P. van den Heuvel,et al.  Deep learning predictions of survival based on MRI in amyotrophic lateral sclerosis , 2016, NeuroImage: Clinical.

[11]  J. Fernandez-Miranda,et al.  Advanced diffusion MRI fiber tracking in neurosurgical and neurodegenerative disorders and neuroanatomical studies: A review. , 2014, Biochimica et biophysica acta.

[12]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[13]  Dinggang Shen,et al.  Hierarchical Reconstruction of 7T-like Images from 3T MRI Using Multi-level CCA and Group Sparsity , 2015, MICCAI.

[14]  Alan Connelly,et al.  Direct estimation of the fiber orientation density function from diffusion-weighted MRI data using spherical deconvolution , 2004, NeuroImage.

[15]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[16]  Jan Sijbers,et al.  Probabilistic fiber tracking using the residual bootstrap with constrained spherical deconvolution , 2011, Human brain mapping.

[17]  A. Anderson Measurement of fiber orientation distributions using high angular resolution diffusion imaging , 2005, Magnetic resonance in medicine.

[18]  B W Kreher,et al.  Multitensor approach for analysis and tracking of complex fiber configurations , 2005, Magnetic resonance in medicine.

[19]  Paul Suetens,et al.  Global tractography of multi-shell diffusion-weighted imaging data using a multi-tissue model , 2015, NeuroImage.

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  Daniel Cremers,et al.  q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans , 2016, IEEE Transactions on Medical Imaging.

[22]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[23]  D. Parker,et al.  Analysis of partial volume effects in diffusion‐tensor MRI , 2001, Magnetic resonance in medicine.

[24]  M. Catani,et al.  Diffusion-based tractography in neurological disorders: concepts, applications, and future developments , 2008, The Lancet Neurology.

[25]  Carl-Fredrik Westin,et al.  Multi-Diffusion-Tensor Fitting via Spherical Deconvolution: A Unifying Framework , 2010, MICCAI.

[26]  Jan Sijbers,et al.  Multi-tissue constrained spherical deconvolution for improved analysis of multi-shell diffusion MRI data , 2014, NeuroImage.

[27]  J. Havel,et al.  Artificial neural networks in medical diagnosis , 2013 .

[28]  Steen Moeller,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[29]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[30]  A. Connelly,et al.  Determination of the appropriate b value and number of gradient directions for high‐angular‐resolution diffusion‐weighted imaging , 2013, NMR in biomedicine.

[31]  R. Deriche,et al.  Regularized, fast, and robust analytical Q‐ball imaging , 2007, Magnetic resonance in medicine.

[32]  D. Tuch Q‐ball imaging , 2004, Magnetic resonance in medicine.

[33]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[34]  Julien Cohen-Adad,et al.  Improving diffusion MRI using simultaneous multi-slice echo planar imaging , 2012, NeuroImage.

[35]  J. I. Minnix Fault tolerance of the backpropagation neural network trained on noisy inputs , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[36]  Natasha Lepore,et al.  Fiber estimation and tractography in diffusion MRI: Development of simulated brain images and comparison of multi-fiber analysis methods at clinical b-values , 2015, NeuroImage.

[37]  Yi-Hsin Weng,et al.  Parkinson disease: diagnostic utility of diffusion kurtosis imaging. , 2011, Radiology.

[38]  M. Chou,et al.  Principles and Limitations of Computational Algorithms in Clinical Diffusion Tensor MR Tractography , 2010, American Journal of Neuroradiology.

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[40]  Thomas Schultz,et al.  Learning a Reliable Estimate of the Number of Fiber Directions in Diffusion MRI , 2012, MICCAI.

[41]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[42]  N. Makris,et al.  High angular resolution diffusion imaging reveals intravoxel white matter fiber heterogeneity , 2002, Magnetic resonance in medicine.

[43]  M. Kringelbach,et al.  Great Expectations: Using Whole-Brain Computational Connectomics for Understanding Neuropsychiatric Disorders , 2014, Neuron.

[44]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[45]  Susumu Mori,et al.  Fiber tracking: principles and strategies – a technical review , 2002, NMR in biomedicine.

[46]  Dorin Comaniciu,et al.  Marginal Space Deep Learning: Efficient Architecture for Volumetric Image Parsing , 2016, IEEE Transactions on Medical Imaging.

[47]  Dorit Merhof,et al.  Direct Estimation of Fiber Orientations Using Deep Learning in Diffusion Imaging , 2016, MLMI@MICCAI.

[48]  P. Basser,et al.  Estimation of the effective self-diffusion tensor from the NMR spin echo. , 1994, Journal of magnetic resonance. Series B.

[49]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[50]  Wen Qin,et al.  Diffusion tensor tractography in patients with cerebral tumors: a helpful technique for neurosurgical planning and postoperative assessment. , 2005, European journal of radiology.

[51]  P. Basser Relationships between diffusion tensor and q‐space MRI † , 2002, Magnetic resonance in medicine.

[52]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[53]  Stephen M. Smith,et al.  Crossing fibres in tract-based spatial statistics , 2010, NeuroImage.

[54]  Antonio Criminisi,et al.  Image Quality Transfer via Random Forest Regression: Applications in Diffusion MRI , 2014, MICCAI.

[55]  Eyke Hüllermeier,et al.  On label dependence and loss minimization in multi-label classification , 2012, Machine Learning.

[56]  Alan Connelly,et al.  Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution , 2007, NeuroImage.

[57]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[58]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[59]  Stuart Crozier,et al.  Apparent Fibre Density: A novel measure for the analysis of diffusion-weighted magnetic resonance images , 2012, NeuroImage.