Tissue microstructure estimation using a deep network inspired by a dictionary‐based framework

HighlightsWe have proposed a deep network for NODDI microstructure estimation.The network structure is motivated by a dictionary‐based estimation framework.The network comprises two cascaded stages, where weights are jointly learned.We have also extended the network to allow incorporation of neighbor information.Qualitative and quantitative evaluation was performed on real brain data. Graphical abstract Figure. No caption available. ABSTRACT Diffusion magnetic resonance imaging (dMRI) captures the anisotropic pattern of water displacement in the neuronal tissue and allows noninvasive investigation of the complex tissue microstructure. A number of biophysical models have been proposed to relate the tissue organization with the observed diffusion signals, so that the tissue microstructure can be inferred. The Neurite Orientation Dispersion and Density Imaging (NODDI) model has been a popular choice and has been widely used for many neuroscientific studies. It models the diffusion signal with three compartments that are characterized by distinct diffusion properties, and the parameters in the model describe tissue microstructure. In NODDI, these parameters are estimated in a maximum likelihood framework, where the nonlinear model fitting is computationally intensive. Therefore, efforts have been made to develop efficient and accurate algorithms for NODDI microstructure estimation, which is still an open problem. In this work, we propose a deep network based approach that performs end‐to‐end estimation of NODDI microstructure, which is named Microstructure Estimation using a Deep Network (MEDN). MEDN comprises two cascaded stages and is motivated by the AMICO algorithm, where the NODDI microstructure estimation is formulated in a dictionary‐based framework. The first stage computes the coefficients of the dictionary. It resembles the solution to a sparse reconstruction problem, where the iterative process in conventional estimation approaches is unfolded and truncated, and the weights are learned instead of predetermined by the dictionary. In the second stage, microstructure properties are computed from the output of the first stage, which resembles the weighted sum of normalized dictionary coefficients in AMICO, and the weights are also learned. Because spatial consistency of diffusion signals can be used to reduce the effect of noise, we also propose MEDN+, which is an extended version of MEDN. MEDN+ allows incorporation of neighborhood information by inserting a stage with learned weights before the MEDN structure, where the diffusion signals in the neighborhood of a voxel are processed. The weights in MEDN or MEDN+ are jointly learned from training samples that are acquired with diffusion gradients densely sampling the q‐space. We performed MEDN and MEDN+ on brain dMRI scans, where two shells each with 30 gradient directions were used, and measured their accuracy with respect to the gold standard. Results demonstrate that the proposed networks outperform the competing methods.

[1]  Jonathan Le Roux,et al.  Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures , 2014, ArXiv.

[2]  Cheng Guan Koay,et al.  Simple Harmonic Oscillator Based Reconstruction and Estimation for One-Dimensional q-Space Magnetic Resonance (1D-SHORE) , 2013 .

[3]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[4]  Emily C. Collins,et al.  Application of neurite orientation dispersion and density imaging (NODDI) to a tau pathology model of Alzheimer's disease , 2016, NeuroImage.

[5]  Roland Memisevic,et al.  Zero-bias autoencoders and the benefits of co-adapting features , 2014, ICLR.

[6]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Dinggang Shen,et al.  Spatio‐angular consistent construction of neonatal diffusion MRI atlases , 2017, Human brain mapping.

[8]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[9]  Justin Domke,et al.  Generic Methods for Optimization-Based Modeling , 2012, AISTATS.

[10]  Jean-Philippe Thiran,et al.  Connectivity and tissue microstructural alterations in right and left temporal lobe epilepsy revealed by diffusion spectrum imaging , 2014, NeuroImage: Clinical.

[11]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[12]  B. Jacobs,et al.  Life‐span dendritic and spine changes in areas 10 and 18 of human cortex: A quantitative golgi study , 1997, The Journal of comparative neurology.

[13]  Daniel C. Alexander,et al.  Accelerated microstructure imaging via convex optimisation for regions with multiple fibres (AMICOx) , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[14]  P. Basser Diffusion MRI: From Quantitative Measurement to In vivo Neuroanatomy , 2009 .

[15]  Jerry L. Prince,et al.  Estimation of fiber orientations using neighborhood information , 2016, Medical Image Anal..

[16]  Wen Gao,et al.  Maximal Sparsity with Deep Networks? , 2016, NIPS.

[17]  Bailey A. Box,et al.  Application and evaluation of NODDI in the cervical spinal cord of multiple sclerosis patients , 2017, NeuroImage: Clinical.

[18]  Qing Ling,et al.  Learning Deep $\ell_0$ Encoders , 2015, 1509.00153.

[19]  Susan M. Chang,et al.  Clinically feasible NODDI characterization of glioma using multiband EPI at 7 T , 2015, NeuroImage: Clinical.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Markus Nilsson,et al.  Neurite density imaging versus imaging of microscopic anisotropy in diffusion MRI: A model comparison using spherical tensor encoding , 2017, NeuroImage.

[22]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[23]  Yaniv Assaf,et al.  Composite hindered and restricted model of diffusion (CHARMED) MR imaging of the human brain , 2005, NeuroImage.

[24]  Qing Ling,et al.  Learning deep l0 encoders , 2016, AAAI 2016.

[25]  P. Matthews,et al.  Multimodal population brain imaging in the UK Biobank prospective epidemiological study , 2016, Nature Neuroscience.

[26]  Qing Ling,et al.  Learning A Deep ℓ∞ Encoder for Hashing , 2016, IJCAI.

[27]  Jerry L. Prince,et al.  Resolution of crossing fibers with constrained compressed sensing using diffusion tensor MRI , 2012, NeuroImage.

[28]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Chuyang Ye Estimation of Tissue Microstructure Using a Deep Network Inspired by a Sparse Reconstruction Framework , 2017, IPMI.

[31]  Osamu Abe,et al.  Neurite orientation dispersion and density imaging in the substantia nigra in idiopathic Parkinson disease , 2016, European Radiology.

[32]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[33]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[34]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[35]  Jean Ponce,et al.  Learning a convolutional neural network for non-uniform motion blur removal , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Scott Holland,et al.  Neurite density index is sensitive to age related differences in the developing brain , 2017, NeuroImage.

[37]  Gene H. Golub,et al.  The differentiation of pseudo-inverses and non-linear least squares problems whose variables separate , 1972, Milestones in Matrix Computation.

[38]  Dinggang Shen,et al.  XQ-NLM: Denoising Diffusion MRI Data via x-q Space Non-local Patch Matching , 2016, MICCAI.

[39]  Deanne K. Thompson,et al.  Axon density and axon orientation dispersion in children born preterm , 2016, Human brain mapping.

[40]  P. Ellen Grant,et al.  Multi-shell diffusion signal recovery from sparse measurements , 2014, Medical Image Anal..

[41]  Tim B. Dyrby,et al.  Orientationally invariant indices of axon diameter and density from diffusion MRI , 2010, NeuroImage.

[42]  P. L. Williams,et al.  Postvaccinial Perivenous Encephalitis , 1960, Neurology.

[43]  Rachid Deriche,et al.  Continuous diffusion signal, EAP and ODF estimation via Compressive Sensing in diffusion MRI , 2013, Medical Image Anal..

[44]  Nikos Evangelou,et al.  Quantitative pathological evidence for axonal loss in normal appearing white matter in multiple sclerosis , 2000, Annals of neurology.

[45]  Hui Zhang,et al.  Advanced diffusion imaging sequences could aid assessing patients with focal cortical dysplasia and epilepsy☆ , 2014, Epilepsy Research.

[46]  Jean-Philippe Thiran,et al.  Sparse regularization for fiber ODF reconstruction: from the suboptimality of $\ell_2$ and $\ell_1$ priors to $\ell_0$ , 2012, 1208.2247.

[47]  Chiara Nosarti,et al.  Early development of structural networks and the impact of prematurity on brain connectivity , 2017, NeuroImage.

[48]  J. Gore,et al.  Theoretical Model for Water Diffusion in Tissues , 1995, Magnetic resonance in medicine.

[49]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[50]  Jelle Veraart,et al.  One diffusion acquisition and different white matter models: How does microstructure change in human early development based on WMTI and NODDI? , 2015, NeuroImage.

[51]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[52]  Qing Ling,et al.  Learning a deep l ∞ encoder for hashing , 2016, IJCAI 2016.

[53]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[54]  Daniel Cremers,et al.  q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans , 2016, IEEE Transactions on Medical Imaging.

[55]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[56]  T. Georgiou,et al.  Microstructure Imaging of Crossing (MIX) White Matter Fibers from diffusion MRI , 2016, Scientific Reports.

[57]  Daniel C. Alexander,et al.  Bingham–NODDI: Mapping anisotropic orientation dispersion of neurites using diffusion MRI , 2016, NeuroImage.

[58]  P. Basser,et al.  Axcaliber: A method for measuring axon diameter distribution from diffusion MRI , 2008, Magnetic resonance in medicine.

[59]  Kristen M Harris,et al.  Dendritic Spine Pathology: Cause or Consequence of Neurological Disorders? , 2002, Brain Research Reviews.

[60]  Hui Zhang,et al.  Assessing white matter microstructure of the newborn with multi-shell diffusion MRI and biophysical compartment models , 2014, NeuroImage.

[61]  Keith L. March,et al.  Corrigendum: Adipose-derived Stem Cell Conditioned Media Extends Survival time of a mouse model of Amyotrophic Lateral Sclerosis , 2016, Scientific Reports.

[62]  Daniel C. Alexander,et al.  NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain , 2012, NeuroImage.

[63]  Jean-Philippe Thiran,et al.  Accelerated Microstructure Imaging via Convex Optimization (AMICO) from diffusion MRI data , 2015, NeuroImage.

[64]  M. Paula-Barbosa,et al.  Dendritic degeneration and regrowth in the cerebral cortex of patients with Alzheimer's disease , 1980, Journal of the Neurological Sciences.

[65]  Guillermo Sapiro,et al.  Learning Efficient Sparse and Low Rank Models , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.