3D conditional generative adversarial networks for high-quality PET image estimation at low dose

ABSTRACT Positron emission tomography (PET) is a widely used imaging modality, providing insight into both the biochemical and physiological processes of human body. Usually, a full dose radioactive tracer is required to obtain high‐quality PET images for clinical needs. This inevitably raises concerns about potential health hazards. On the other hand, dose reduction may cause the increased noise in the reconstructed PET images, which impacts the image quality to a certain extent. In this paper, in order to reduce the radiation exposure while maintaining the high quality of PET images, we propose a novel method based on 3D conditional generative adversarial networks (3D c‐GANs) to estimate the high‐quality full‐dose PET images from low‐dose ones. Generative adversarial networks (GANs) include a generator network and a discriminator network which are trained simultaneously with the goal of one beating the other. Similar to GANs, in the proposed 3D c‐GANs, we condition the model on an input low‐dose PET image and generate a corresponding output full‐dose PET image. Specifically, to render the same underlying information between the low‐dose and full‐dose PET images, a 3D U‐net‐like deep architecture which can combine hierarchical features by using skip connection is designed as the generator network to synthesize the full‐dose image. In order to guarantee the synthesized PET image to be close to the real one, we take into account of the estimation error loss in addition to the discriminator feedback to train the generator network. Furthermore, a concatenated 3D c‐GANs based progressive refinement scheme is also proposed to further improve the quality of estimated images. Validation was done on a real human brain dataset including both the normal subjects and the subjects diagnosed as mild cognitive impairment (MCI). Experimental results show that our proposed 3D c‐GANs method outperforms the benchmark methods and achieves much better performance than the state‐of‐the‐art methods in both qualitative and quantitative measures. HIGHLIGHTSTo render the same underlying information between the low‐dose and full‐dose PET images, a 3D U‐net‐like deep architecture which can combine hierarchical features by using skip connections is designed as the generator network to synthesize the full‐dose image.To guarantee the synthesized PET image to be close to the real one, we take into account of the estimation error loss in addition to the discriminator feedback to train the generator network.A concatenated 3D c‐GANs based progressive refinement scheme is also proposed to further improve the quality of estimated images.