MR-Based Attenuation Correction for Brain PET Using 3-D Cycle-Consistent Adversarial Network

Attenuation correction (AC) is important for the quantitative merits of positron emission tomography (PET). However, attenuation coefficients cannot be derived from magnetic resonance (MR) images directly for PET/MR systems. In this work, we aimed to derive continuous AC maps from Dixon MR images without the requirement of MR and computed tomography (CT) image registration. To achieve this, a 3-D generative adversarial network with both discriminative and cycle-consistency loss (Cycle-GAN) was developed. The modified 3-D U-net was employed as the structure of the generative networks to generate the pseudo-CT/MR images. The 3-D patch-based discriminative networks were used to distinguish the generated pseudo-CT/MR images from the true CT/MR images. To evaluate its performance, datasets from 32 patients were used in the experiment. The Dixon segmentation and atlas methods provided by the vendor and the convolutional neural network (CNN) method which utilized registered MR and CT images were employed as the reference methods. Dice coefficients of the pseudo-CT images and the regional quantification in the reconstructed PET images were compared. Results show that the Cycle-GAN framework can generate better AC compared to the Dixon segmentation and atlas methods, and shows comparable performance compared to the CNN method.

[1]  Alan C. Evans,et al.  Enhancement of MR Images Using Registration for Signal Averaging , 1998, Journal of Computer Assisted Tomography.

[2]  A Boudraa,et al.  Fuzzy clustering-based segmented attenuation correction in whole-body PET imaging. , 2002, Physics in medicine and biology.

[3]  D. Townsend,et al.  Method for transforming CT images for attenuation correction in PET/CT imaging. , 2006, Medical physics.

[4]  C. Almli,et al.  Unbiased nonlinear average age-appropriate brain templates from birth to adulthood , 2009, NeuroImage.

[5]  Nassir Navab,et al.  Tissue Classification as a Potential Approach for Attenuation Correction in Whole-Body PET/MRI: Evaluation with PET/CT Data , 2009, Journal of Nuclear Medicine.

[6]  S. Vandenberghe,et al.  MRI-Based Attenuation Correction for PET/MRI Using Ultrashort Echo Time Sequences , 2010, Journal of Nuclear Medicine.

[7]  Adam Johansson,et al.  CT substitute derived from MRI sequences with ultrashort echo time. , 2011, Medical physics.

[8]  C. Kuhl,et al.  MRI-Based Attenuation Correction for Hybrid PET/MRI Systems: A 4-Class Tissue Segmentation Technique Using a Combined Ultrashort-Echo-Time/Dixon MRI Sequence , 2012, The Journal of Nuclear Medicine.

[9]  Simultaneous Reconstruction of Activity and Attenuation in Time-of-Flight PET , 2012, IEEE Transactions on Medical Imaging.

[10]  M. Defrise,et al.  Time-of-flight PET data determine the attenuation sinogram up to a constant , 2012, Physics in medicine and biology.

[11]  G. Delso,et al.  Evaluation of an Atlas-Based PET Head Attenuation Correction Using PET/CT & MR Patient Data , 2012, IEEE Transactions on Nuclear Science.

[12]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[13]  Kevin T. Chen,et al.  An SPM8-Based Approach for Attenuation Correction Combining Segmentation and Nonrigid Template Formation: Application to Simultaneous PET/MR Brain Imaging , 2014, The Journal of Nuclear Medicine.

[14]  Ninon Burgos,et al.  Attenuation Correction Synthesis for Hybrid PET-MR Scanners: Application to Brain Studies , 2014, IEEE Transactions on Medical Imaging.

[15]  S. Holm,et al.  Region specific optimization of continuous linear attenuation coefficients based on UTE (RESOLUTE): application to PET/MR brain imaging , 2015, Physics in medicine and biology.

[16]  Habib Zaidi,et al.  Joint Estimation of Activity and Attenuation in Whole-Body TOF PET/MRI Using Constrained Gaussian Mixture Models , 2015, IEEE Transactions on Medical Imaging.

[17]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[18]  A. Buck,et al.  Clinical Evaluation of Zero-Echo-Time Attenuation Correction for Brain 18F-FDG PET/MRI: Comparison with Atlas Attenuation Correction , 2016, The Journal of Nuclear Medicine.

[19]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[20]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[21]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[22]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  D. Vigneron,et al.  Quantitative Evaluation of Atlas-based Attenuation Correction for Brain PET in an Integrated Time-of-Flight PET/MR Imaging System. , 2017, Radiology.

[25]  Andrew P. Leynes,et al.  Hybrid ZTE/Dixon MR‐based attenuation correction for quantitative uptake estimation of pelvic lesions in PET/MRI , 2017, Medical physics.

[26]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[27]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[28]  Kyungsang Kim,et al.  Joint estimation of activity image and attenuation sinogram using time-of-flight positron emission tomography data consistency condition filtering , 2017, Journal of medical imaging.

[29]  M. Soussan,et al.  Subject-specific bone attenuation correction for brain PET/MR: can ZTE-MRI substitute CT scan accurately? , 2017, Physics in medicine and biology.

[30]  Christine DeLorenzo,et al.  Synthesis of Patient-Specific Transmission Data for PET Attenuation Correction for PET/MRI Neuroimaging Using a Convolutional Neural Network , 2018, The Journal of Nuclear Medicine.

[31]  Quanzheng Li,et al.  Attenuation correction for brain PET imaging using deep neural network based on Dixon and ZTE MR images , 2017, Physics in medicine and biology.

[32]  Fang Liu,et al.  Technical Note: Deep learning based MRAC using rapid ultrashort echo time imaging , 2018, Medical physics.

[33]  A. Soricelli,et al.  Dixon-VIBE Deep Learning (DIVIDE) Pseudo-CT Synthesis for Pelvis PET/MR Attenuation Correction , 2018, The Journal of Nuclear Medicine.

[34]  Johan Nuyts,et al.  The Validation Problem of Joint Emission/Transmission Reconstruction From TOF-PET Projections , 2018 .

[35]  Josef A. Lundman,et al.  Zero TE‐based pseudo‐CT image conversion in the head and its application in PET/MR attenuation correction and MR‐guided radiation therapy planning , 2018, Magnetic resonance in medicine.

[36]  G. Searle,et al.  PET-MR Attenuation Correction in Dynamic Brain PET Using [11C]Cimbi-36: A Direct Comparison With PET-CT , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[37]  E. Larsson,et al.  Evaluation of zero-echo-time attenuation correction for integrated PET/MR brain imaging—comparison to head atlas and 68Ge-transmission-based attenuation correction , 2018, EJNMMI Physics.

[38]  A. McMillan,et al.  Deep learning Mr imaging–based attenuation correction for PeT/Mr imaging 1 , 2017 .

[39]  Richard Kijowski,et al.  A deep learning approach for 18F-FDG PET attenuation correction , 2018, EJNMMI Physics.

[40]  Jae Sung Lee,et al.  Improving the Accuracy of Simultaneously Reconstructed Activity and Attenuation Maps Using Deep Learning , 2018, The Journal of Nuclear Medicine.

[41]  G. Delso,et al.  Clinical Evaluation of 11C-Met-Avid Pituitary Lesions Using a ZTE-Based AC Method , 2019, IEEE Transactions on Radiation and Plasma Medical Sciences.

[42]  Guoyan Zheng,et al.  Novel adversarial semantic structure deep learning for MRI-guided attenuation correction in brain PET/MRI , 2019, European Journal of Nuclear Medicine and Molecular Imaging.

[43]  Yang Lei,et al.  Deep learning-based attenuation correction in the absence of structural information for whole-body positron emission tomography imaging , 2019, Physics in medicine and biology.

[44]  Kevin H. Leung,et al.  Direct attenuation correction of brain PET images using only emission data via a deep convolutional encoder-decoder (Deep-DAC) , 2019, European Radiology.

[45]  H. Okazawa,et al.  No significant difference found in PET/MRI CBF values reconstructed with CT-atlas-based and ZTE MR attenuation correction , 2019, EJNMMI Research.

[46]  Florian Wiesinger,et al.  Attenuation correction using 3D deep convolutional neural network for brain 18F-FDG PET/MR: Comparison with Atlas, ZTE and CT based attenuation correction , 2019, PloS one.

[47]  Maike E Lindemann,et al.  Impact of improved attenuation correction on 18F-FDG PET/MR hybrid imaging of the heart , 2019, PloS one.

[48]  M. Tosetti,et al.  An Aristotelian View on MR-Based Attenuation Correction (ARISTOMRAC): Combining the Four Elements , 2019, IEEE Transactions on Radiation and Plasma Medical Sciences.

[49]  Jae Sung Lee,et al.  Generation of PET Attenuation Map for Whole-Body Time-of-Flight 18F-FDG PET/MRI Using a Deep Neural Network Trained with Simultaneously Reconstructed Activity and Attenuation Maps , 2019, The Journal of Nuclear Medicine.

[50]  K. Nikolaou,et al.  Independent brain F-FDG PET attenuation correction using a deep learning approach with Generative Adversarial Networks , 2019 .

[51]  L. Marner,et al.  Deep Learning Based Attenuation Correction of PET/MRI in Pediatric Brain Tumor Patients: Evaluation in a Clinical Setting , 2019, Front. Neurosci..

[52]  M. Vangel,et al.  Intrascanner Reproducibility of an SPM-Based Head MR-Based Attenuation Correction Method , 2019, IEEE Transactions on Radiation and Plasma Medical Sciences.

[53]  Keith A. Johnson,et al.  MR-Based PET Attenuation Correction using a Combined Ultrashort Echo Time/Multi-Echo Dixon Acquisition. , 2020, Medical physics.

[54]  Simon R. Cherry,et al.  Machine Learning in PET: From Photon Detection to Quantitative Image Reconstruction , 2020, Proceedings of the IEEE.