PURPOSE
Our goal was to use a generative adversarial network (GAN) with feature matching and task-specific perceptual loss to synthesize standard-dose amyloid Positron emission tomography (PET) images of high quality and including accurate pathological features from ultra-low-dose PET images only.
METHODS
Forty PET datasets from 39 participants were acquired with a simultaneous PET/MRI scanner following injection of 330 ± 30 MBq of the amyloid radiotracer 18F-florbetaben. The raw list-mode PET data were reconstructed as the standard-dose ground truth and were randomly undersampled by a factor of 100 to reconstruct 1% low-dose PET scans. A 2D encoder-decoder network was implemented as the generator to synthesize a standard-dose image and a discriminator was used to evaluate them. The two networks contested with each other to achieve high-visual quality PET from the ultra-low-dose PET. Multi-slice inputs were used to reduce noise by providing the network with 2.5D information. Feature matching was applied to reduce hallucinated structures. Task-specific perceptual loss was designed to maintain the correct pathological features. The image quality was evaluated by peak signal-to-noise ratio (PSNR), structural similarity (SSIM), and root mean square error (RMSE) metrics with and without each of these modules. Two expert radiologists were asked to score image quality on a 5-point scale and identified the amyloid status (positive or negative).
RESULTS
With only low-dose PET as input, the proposed method significantly outperformed Chen et al.'s method (Chen et al. Radiology. 2018;290:649-656) (which shows the best performance in this task) with the same input (PET-only model) by 1.87 dB in PSNR, 2.04% in SSIM, and 24.75% in RMSE. It also achieved comparable results to Chen et al.'s method which used additional magnetic resonance imaging (MRI) inputs (PET-MR model). Experts' reading results showed that the proposed method could achieve better overall image quality and maintain better pathological features indicating amyloid status than both PET-only and PET-MR models proposed by Chen et al. CONCLUSION: Standard-dose amyloid PET images can be synthesized from ultra-low-dose images using GAN. Applying adversarial learning, feature matching, and task-specific perceptual loss are essential to ensure image quality and the preservation of pathological features.
[1]
Andrew Zisserman,et al.
Very Deep Convolutional Networks for Large-Scale Image Recognition
,
2014,
ICLR.
[2]
Alberto Pupi,et al.
PET/CT in diagnosis of dementia
,
2011,
Annals of the New York Academy of Sciences.
[3]
Kanjar De,et al.
Image Sharpness Measure for Blurred Images in Frequency Domain
,
2013
.
[4]
Alexei A. Efros,et al.
Image-to-Image Translation with Conditional Adversarial Networks
,
2016,
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[5]
John M Pauly,et al.
Ultra-Low-Dose 18F-Florbetaben Amyloid PET Imaging Using Deep Learning with Multi-Contrast MRI Inputs.
,
2019,
Radiology.
[6]
Konstantin Nikolaou,et al.
Towards tracer dose reduction in PET studies: Simulation of dose reduction by retrospective randomized undersampling of list-mode data.
,
2016,
Hellenic journal of nuclear medicine.
[7]
Dinggang Shen,et al.
Medical Image Synthesis with Deep Convolutional Adversarial Networks
,
2018,
IEEE Transactions on Biomedical Engineering.
[8]
et al.,et al.
Discrimination between Alzheimer Dementia and Controls by Automated Analysis of Multicenter FDG PET
,
2002,
NeuroImage.
[9]
Xuanqin Mou,et al.
Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss
,
2017,
IEEE Transactions on Medical Imaging.
[10]
Hisashi Kobayashi,et al.
The detection rates and tumor clinical/pathological stages of whole-body FDG-PET cancer screening
,
2007,
Annals of nuclear medicine.
[11]
L. Squire,et al.
The medial temporal lobe memory system
,
1991,
Science.
[12]
K. Rhodes,et al.
The antibody aducanumab reduces Aβ plaques in Alzheimer’s disease
,
2016,
Nature.
[13]
Xin Wang,et al.
Blind Image Quality Assessment for Measuring Image Blur
,
2008,
2008 Congress on Image and Signal Processing.