GroupRegNet: a groupwise one-shot deep learning-based 4D image registration method

Accurate deformable 4-dimensional (4D) (3-dimensional in space and time) medical images registration is essential in a variety of medical applications. Deep learning-based methods have recently gained popularity in this area for the significantly lower inference time. However, they suffer from drawbacks of non-optimal accuracy and the requirement of a large amount of training data. A new method named GroupRegNet is proposed to address both limitations. The deformation fields to warp all images in the group into a common template is obtained through one-shot learning. The use of the implicit template reduces bias and accumulated error associated with the specified reference image. The one-shot learning strategy is similar to the conventional iterative optimization method but the motion model and parameters are replaced with a convolutional neural network (CNN) and the weights of the network. GroupRegNet also features a simpler network design and a more straightforward registration process, which eliminates the need to break up the input image into patches. The proposed method was quantitatively evaluated on two public respiratory-binned 4D-CT datasets. The results suggest that GroupRegNet outperforms the latest published deep learning-based methods and is comparable to the top conventional method pTVreg. To facilitate future research, the source code is available at https://github.com/vincentme/GroupRegNet.

[1]  Patrick Clarysse,et al.  Spatiotemporal motion estimation for respiratory-correlated imaging of the lungs. , 2010, Medical physics.

[2]  Tobias Gass,et al.  Isotropic Total Variation Regularization of Displacements in Parametric Image Registration , 2017, IEEE Transactions on Medical Imaging.

[3]  Dimos Baltas,et al.  One-Shot Learning for Deformable Medical Image Registration and Periodic Motion Tracking , 2019, IEEE Transactions on Medical Imaging.

[4]  Ying Tai,et al.  Learning by Analogy: Reliable Supervision From Transformations for Unsupervised Optical Flow Estimation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[6]  Fang-Fang Yin,et al.  A multi-scale framework with unsupervised joint training of convolutional neural networks for pulmonary deformable image registration , 2019, Physics in medicine and biology.

[7]  Weiguo Lu,et al.  A simple fixed-point approach to invert a deformation field. , 2007, Medical physics.

[8]  Deshan Yang,et al.  An adaptive motion regularization technique to support sliding motion in deformable image registration , 2018, Medical physics.

[9]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[10]  René Werner,et al.  GDL-FIRE ^\text 4D : Deep Learning-Based Fast 4D CT Image Registration , 2018, MICCAI.

[11]  Michael Brady,et al.  Fast Groupwise 4D Deformable Image Registration for Irregular Breathing Motion Estimation , 2018, WBIR.

[12]  Xue Wu,et al.  Automatic large quantity landmark pairs detection in 4DCT lung images. , 2019, Medical physics.

[13]  Yang Lei,et al.  LungRegNet: an unsupervised deformable image registration method for 4D-CT lung. , 2020, Medical physics.

[14]  Dinggang Shen,et al.  Estimating the 4D respiratory lung motion by spatiotemporal registration and super-resolution image reconstruction. , 2013, Medical physics.