Q-space Conditioned Translation Networks for Directional Synthesis of Diffusion Weighted Images from Multi-modal Structural MRI

Current deep learning approaches for diffusion MRI modeling circumvent the need for densely-sampled diffusion-weighted images (DWIs) by directly predicting microstructural indices from sparselysampled DWIs. However, they implicitly make unrealistic assumptions of static q-space sampling during training and reconstruction. Further, such approaches can restrict downstream usage of variably sampled DWIs for usages including the estimation of microstructural indices or tractography. We propose a generative adversarial translation framework for high-quality DWI synthesis with arbitrary q-space sampling given commonly acquired structural images (e.g., B0, T1, T2). Our translation network linearly modulates its internal representations conditioned on continuous q-space information, thus removing the need for fixed sampling schemes. Moreover, this approach enables downstream estimation of high-quality microstructural maps from arbitrarily subsampled DWIs, which may be particularly important in cases with sparsely sampled DWIs. Across several recent methodologies, the proposed approach yields improved DWI synthesis accuracy and fidelity with enhanced downstream utility as quantified by the accuracy of scalar microstructure indices estimated from the synthesized images. Code is available at https: //github.com/mengweiren/q-space-conditioned-dwi-synthesis.

[1]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[2]  Daniel C. Alexander,et al.  NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain , 2012, NeuroImage.

[3]  Tomas Akenine-Möller,et al.  Understanding SSIM , 2020, ArXiv.

[4]  J. Helpern,et al.  Diffusional kurtosis imaging: The quantification of non‐gaussian water diffusion by means of magnetic resonance imaging , 2005, Magnetic resonance in medicine.

[5]  Ole Winther,et al.  Autoencoding beyond pixels using a learned similarity metric , 2015, ICML.

[6]  Bernt Schiele,et al.  A U-Net Based Discriminator for Generative Adversarial Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Aaron C. Courville,et al.  FiLM: Visual Reasoning with a General Conditioning Layer , 2017, AAAI.

[8]  Maxime Descoteaux,et al.  Dipy, a library for the analysis of diffusion MRI data , 2014, Front. Neuroinform..

[9]  Kawin Setsompop,et al.  DeepDTI: High-fidelity six-direction diffusion tensor imaging using deep learning , 2020, NeuroImage.

[10]  C. Jack,et al.  Effectiveness of regional DTI measures in distinguishing Alzheimer's disease, MCI, and normal aging☆ , 2013, NeuroImage: Clinical.

[11]  Zhiwei Li,et al.  Fast learning of fiber orientation distribution function for MR tractography using convolutional neural network. , 2019, Medical physics.

[12]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Takeru Miyato,et al.  cGANs with Projection Discriminator , 2018, ICLR.

[14]  Jaeil Kim,et al.  Estimating Tissue Microstructure with Undersampled Diffusion Data via Graph Convolutional Neural Networks , 2020, MICCAI.

[15]  Antonio Criminisi,et al.  Image quality transfer and applications in diffusion MRI , 2017, NeuroImage.

[16]  P. J. Basser,et al.  Simple harmonic oscillator based estimation and reconstruction for one-dimensional q-space MR , 2007 .

[17]  Sotirios A. Tsaftaris,et al.  INSIDE: Steering Spatial Attention with Non-Imaging Information in CNNs , 2020, MICCAI.

[18]  Hans Knutsson,et al.  Generating Diffusion MRI scalar maps from T1 weighted images using generative adversarial networks , 2018, SCIA.

[19]  Zhen Wang,et al.  Multi-class Generative Adversarial Networks with the L2 Loss Function , 2016, ArXiv.

[20]  Hangyi Jiang,et al.  DtiStudio: Resource program for diffusion tensor computation and fiber bundle tracking , 2006, Comput. Methods Programs Biomed..

[21]  Rainer Goebel,et al.  Robust and fast nonlinear optimization of diffusion MRI microstructure models , 2017, NeuroImage.

[22]  Ganesh Adluru,et al.  Simultaneous NODDI and GFA parameter map generation from subsampled q‐space imaging using deep learning , 2018, Magnetic resonance in medicine.

[23]  Stamatios N. Sotiropoulos,et al.  Non-parametric representation and prediction of single- and multi-shell diffusion-weighted MRI data using Gaussian processes , 2015, NeuroImage.

[24]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Guido Gerig,et al.  Segmentation-Renormalized Deep Feature Modulation for Unpaired Image Harmonization , 2021, IEEE Transactions on Medical Imaging.

[27]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[28]  Daniel Cremers,et al.  q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans , 2016, IEEE Transactions on Medical Imaging.

[29]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[30]  Dinggang Shen,et al.  XQ-SR: Joint x-q space super-resolution with application to infant diffusion MRI , 2019, Medical Image Anal..

[31]  Kyoungseob Byeon,et al.  Synthesizing diffusion tensor imaging from functional MRI using fully convolutional networks , 2019, Comput. Biol. Medicine.

[32]  Yuankai Huo,et al.  Synthesized b0 for diffusion distortion correction (Synb0-DisCo). , 2019, Magnetic resonance imaging.

[33]  Jan Sijbers,et al.  Weighted linear least squares estimation of diffusion MRI parameters: Strengths, limitations, and pitfalls , 2013, NeuroImage.

[34]  Christian Desrosiers,et al.  Manifold-Aware CycleGAN for High Resolution Structural-to-DTI Synthesis , 2020, Computational Diffusion MRI.