Motion correction of respiratory-gated PET images using deep learning based image registration framework

PURPOSE Artifacts caused by patient breathing and movement during PET data acquisition affect image quality. Respiratory gating is commonly used to gate the list-mode PET data into multiple bins over a respiratory cycle. Non-rigid registration of respiratory-gated PET images can reduce motion artifacts and preserve count statistics, but it is time consuming. In this work, we propose an unsupervised non-rigid image registration framework using deep learning for motion correction. METHODS Our network uses a differentiable spatial transformer layer to warp the moving image to the fixed image and use a stacked structure for deformation field refinement. Estimated deformation fields were incorporated into an iterative image reconstruction algorithm to perform motion compensated PET image reconstruction. We validated the proposed method using simulation and clinical data and implemented an iterative image registration for comparison. Motion compensated reconstructions were compared with ungated images. RESULTS Our simulation study showed that the motion compensated methods can generate images with sharp boundaries and reveal more details in the heart region compared with the ungated image. The resulting normalized root mean square error (NRMS) was 24.3±1.7% for the deep learning based motion correction, 31.1±1.4% for the iterative registration based motion correction, and 41.9±2.0% for ungated reconstruction. The proposed deep learning based motion correction reduced the bias compared with the ungated image without increasing the noise level and outperformed the iterative registration based method. In the real data study, both motion compensated images provided higher lesion contrast and sharper liver boundary than the ungated image and had lower noise than the reference gate image. The contrast of the proposed method based on the deep neural network was higher than the ungated image and iterative registration method at any matched noise level. CONCLUSIONS In this work, we proposed a motion correction method for respiratory-gated PET images using deep learning based image registration framework. It does not require the knowledge of the true deformation field for training the network, which makes it very convenient to implement. We validated the proposed method using simulation and clinical data and showed its ability to reduce motion artifacts while utilizing all gated PET data.

[1]  O. Schober,et al.  List Mode–Driven Cardiac and Respiratory Gating in PET , 2009, Journal of Nuclear Medicine.

[2]  A J Reader,et al.  List-mode-based reconstruction for respiratory motion correction in PET using non-rigid body transformations , 2007, Physics in medicine and biology.

[3]  Jeffrey A. Fessler,et al.  Joint image reconstruction and nonrigid motion estimation with a simple penalty that encourages local invertibility , 2009, Medical Imaging.

[4]  Yong Fan,et al.  Non-rigid image registration using self-supervised fully convolutional networks without training data , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[5]  Jeffrey A. Fessler,et al.  A Simple Regularizer for B-spline Nonrigid Image Registration That Encourages Local Invertibility , 2009, IEEE Journal of Selected Topics in Signal Processing.

[6]  Tim Mulnix,et al.  Respiratory Motion Compensation for PET/CT with Motion Information Derived from Matched Attenuation-Corrected Gated PET Data , 2018, The Journal of Nuclear Medicine.

[7]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[8]  Jing Wang,et al.  Respiratory motion correction in 4D-PET by simultaneous motion estimation and image reconstruction (SMEIR). , 2016, Physics in medicine and biology.

[9]  Simon R. Cherry,et al.  Feasibility study of micro-dose total-body dynamic PET imaging using the EXPLORER scanner , 2014 .

[10]  C. Ling,et al.  Effect of respiratory gating on reducing lung motion artifacts in PET imaging of lung cancer. , 2002, Medical physics.

[11]  Paul Kinahan,et al.  Cine CT for Attenuation Correction in Cardiac PET/CT , 2007, Journal of Nuclear Medicine.

[12]  Claus Belka,et al.  Technical evaluation of different respiratory monitoring systems used for 4D CT acquisition under free breathing , 2015, Journal of applied clinical medical physics.

[13]  Holger Schmidt,et al.  Reconstruction-Incorporated Respiratory Motion Correction in Clinical Simultaneous PET/MR Imaging for Oncology Applications , 2015, The Journal of Nuclear Medicine.

[14]  C. Ling,et al.  Effect of respiratory gating on quantifying PET images of lung cancer. , 2002, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[15]  Guobao Wang,et al.  A monotonie image-space algorithm for joint PET image reconstruction and motion estimation , 2015, 2015 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC).

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Lei Xing,et al.  Model-based image reconstruction for four-dimensional PET. , 2006, Medical physics.

[18]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.

[19]  Chung Chan,et al.  Non-Rigid Event-by-Event Continuous Respiratory Motion Compensated List-Mode Reconstruction for PET , 2018, IEEE Transactions on Medical Imaging.