Generation of Structural MR Images from Amyloid PET: Application to MR-Less Quantification

Structural MR images concomitantly acquired with PET images can provide crucial anatomic information for precise quantitative analysis. However, in the clinical setting, not all the subjects have corresponding MR images. Here, we developed a model to generate structural MR images from amyloid PET using deep generative networks. We applied our model to quantification of cortical amyloid load without structural MR. Methods: We used florbetapir PET and structural MR data from the Alzheimer Disease Neuroimaging Initiative database. The generative network was trained to generate realistic structural MR images from florbetapir PET images. After the training, the model was applied to the quantification of cortical amyloid load. PET images were spatially normalized to the template space using the generated MR, and then SUV ratio (SUVR) of the target regions was measured by predefined regions of interest. A real MR-based quantification was used as the gold standard to measure the accuracy of our approach. Other MR-less methods—a normal PET template–based, a multiatlas PET template–based, and a PET segmentation–based normalization/quantification—were also tested. We compared the performance of quantification methods using generated MR with that of MR-based and MR-less quantification methods. Results: Generated MR images from florbetapir PET showed signal patterns that were visually similar to the real MR. The structural similarity index between real and generated MR was 0.91 ± 0.04. The mean absolute error of SUVR of cortical composite regions estimated by the generated MR-based method was 0.04 ± 0.03, which was significantly smaller than other MR-less methods (0.29 ± 0.12 for the normal PET template, 0.12 ± 0.07 for the multiatlas PET template, and 0.08 ± 0.06 for the PET segmentation–based methods). Bland–Altman plots revealed that the generated MR-based SUVR quantification was the closest to the SUVRs estimated by the real MR-based method. Conclusion: Structural MR images were successfully generated from amyloid PET images using deep generative networks. Generated MR images could be used as templates for accurate and precise amyloid quantification. This generative method might be used to generate multimodal images of various organs for further quantitative analyses.

[1]  C. Jack,et al.  11C PiB and structural MRI provide complementary information in imaging of Alzheimer's disease and amnestic mild cognitive impairment. , 2008, Brain : a journal of neurology.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Heinz-Peter Schlemmer,et al.  PET/MRI: Paving the Way for the Next Generation of Clinical Multimodality Imaging Applications , 2010, Journal of Nuclear Medicine.

[4]  C. Rowe,et al.  Comparison of MR-less PiB SUVR quantification methods , 2015, Neurobiology of Aging.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  Habib Zaidi,et al.  Partial Volume Correction Strategies in PET. , 2007, PET clinics.

[7]  Yann Cointepas,et al.  Validation of a Standardized Normalization Template for Statistical Parametric Mapping Analysis of 123I-FP-CIT Images , 2007, Journal of Nuclear Medicine.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Hanna Cho,et al.  Feasibility of Computed Tomography-Guided Methods for Spatial Normalization of Dopamine Transporter Positron Emission Tomography Image , 2015, PloS one.

[10]  I. Buvat,et al.  Partial-Volume Effect in PET Tumor Imaging* , 2007, Journal of Nuclear Medicine.

[11]  Olivier Salvado,et al.  MR-Less Surface-Based Amyloid Assessment Based on 11C PiB PET , 2014, PloS one.

[12]  R. Coleman,et al.  Use of florbetapir-PET for imaging beta-amyloid pathology. , 2011, JAMA.

[13]  R. Coleman,et al.  Use of Florbetapir-PET for Imaging-Amyloid Pathology , 2011 .

[14]  W. Jagust,et al.  The Alzheimer's Disease Neuroimaging Initiative 2 PET Core: 2015 , 2015, Alzheimer's & Dementia.

[15]  M. Mintun,et al.  Amyloid-β Imaging with Pittsburgh Compound B and Florbetapir: Comparing Radiotracers and Quantification Methods , 2013, The Journal of Nuclear Medicine.

[16]  D. Hill,et al.  Non-rigid image registration: theory and practice. , 2004, The British journal of radiology.

[17]  Paul Edison,et al.  Comparison of MRI based and PET template based approaches in the quantitative analysis of amyloid imaging with PIB-PET , 2013, NeuroImage.

[18]  Nick C Fox,et al.  The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease , 2011 .

[19]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  S. DeKosky,et al.  Simplified quantification of Pittsburgh Compound B amyloid imaging PET studies: a comparative analysis. , 2005, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[21]  Kewei Chen,et al.  Using positron emission tomography and florbetapir F18 to image cortical amyloid in patients with mild cognitive impairment or dementia due to Alzheimer disease. , 2011, Archives of neurology.

[22]  A. Drzezga,et al.  Current status and future role of brain PET/MRI in clinical and research settings , 2015, European Journal of Nuclear Medicine and Molecular Imaging.

[23]  Jyrki Lötjönen,et al.  Implementation and Validation of an Adaptive Template Registration Method for 18F-Flutemetamol Imaging Data , 2013, The Journal of Nuclear Medicine.

[24]  B. Schölkopf,et al.  Towards quantitative PET/MRI: a review of MR-based attenuation correction techniques , 2009, European Journal of Nuclear Medicine and Molecular Imaging.

[25]  Keith A. Johnson,et al.  Appropriate Use Criteria for Amyloid PET: A Report of the Amyloid Imaging Task Force, the Society of Nuclear Medicine and Molecular Imaging, and the Alzheimer’s Association , 2013, The Journal of Nuclear Medicine.