Fluid Registration Between Lung CT and Stationary Chest Tomosynthesis Images

Registration is widely used in image-guided therapy and image-guided surgery to estimate spatial correspondences between organs of interest between planning and treatment images. However, while high-quality computed tomography (CT) images are often available at planning time, limited angle acquisitions are frequently used during treatment because of radiation concerns or imaging time constraints. This requires algorithms to register CT images based on limited angle acquisitions. We, therefore, formulate a 3D/2D registration approach which infers a 3D deformation based on measured projections and digitally reconstructed radiographs of the CT. Most 3D/2D registration approaches use simple transformation models or require complex mathematical derivations to formulate the underlying optimization problem. Instead, our approach entirely relies on differentiable operations which can be combined with modern computational toolboxes supporting automatic differentiation. This then allows for rapid prototyping, integration with deep neural networks, and to support a variety of transformation models including fluid flow models. We demonstrate our approach for the registration between CT and stationary chest tomosynthesis (sDCT) images and show how it naturally leads to an iterative image reconstruction approach.

[1]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[2]  Eldad Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2006, MICCAI.

[3]  B G Fallone,et al.  3D interfractional patient position verification using 2D-3D registration of orthogonal images. , 2006, Medical physics.

[4]  G. Kuduvalli,et al.  A fast, accurate, and automatic 2D-3D image registration for image-guided cranial radiosurgery. , 2008, Medical physics.

[5]  Otto Zhou,et al.  Adapted fan-beam volume reconstruction for stationary digital breast tomosynthesis , 2015, Medical Imaging.

[6]  Joachim Hornegger,et al.  Multi-modal 2D-3D non-rigid registration , 2006, SPIE Medical Imaging.

[7]  Laurent Sarry,et al.  Accurate and precise 2D-3D registration based on X-ray intensity , 2008, Comput. Vis. Image Underst..

[8]  Andreas Griewank,et al.  Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition , 2000, Frontiers in applied mathematics.

[9]  Slavica Jonic,et al.  Multiresolution-based registration of a volume to a set of its projections , 2003, SPIE Medical Imaging.

[10]  D. Jaffray,et al.  Review of image-guided radiation therapy , 2007, Expert review of anticancer therapy.

[11]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[12]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[13]  P. Thomas Fletcher,et al.  A vector momenta formulation of diffeomorphisms for improved geodesic regression and atlas construction , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[14]  Daniel Rueckert,et al.  Simultaneous Fine and Coarse Diffeomorphic Registration: Application to Atrophy Measurement in Alzheimer's Disease , 2010, MICCAI.

[15]  Otto Zhou,et al.  Stationary chest tomosynthesis using a carbon nanotube x-ray source array: a feasibility study , 2015, Physics in medicine and biology.

[16]  Marc Niethammer,et al.  Region-specific Diffeomorphic Metric Mapping , 2019, NeurIPS.

[17]  Daniel Rueckert,et al.  Diffeomorphic 3D Image Registration via Geodesic Shooting Using an Efficient Adjoint Calculation , 2011, International Journal of Computer Vision.

[18]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[19]  L. Younes,et al.  On the metrics and euler-lagrange equations of computational anatomy. , 2002, Annual review of biomedical engineering.

[20]  Bostjan Likar,et al.  3-D/2-D registration by integrating 2-D information in 3-D , 2006, IEEE Transactions on Medical Imaging.

[21]  Barbara Flach,et al.  Deformable 3D–2D registration for CT and its application to low dose tomographic fluoroscopy , 2014, Physics in medicine and biology.

[22]  Tobias Gass,et al.  Isotropic Total Variation Regularization of Displacements in Parametric Image Registration , 2017, IEEE Transactions on Medical Imaging.

[23]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[24]  Nassir Navab,et al.  Deformable registration of 3D vessel structures to a single projection image , 2008, SPIE Medical Imaging.