Preliminary Feasibility Study of Imaging Registration Between Supine and Prone Breast CT in Breast Cancer Radiotherapy Using Residual Recursive Cascaded Networks

Breast cancer is one of the most common malignancies in women. The prone position in Partial Breast Irradiation (PBI) can better protect the heart and lung during radiotherapy. Supine position is used for CT imaging during treatment planning. The posture change in these two different positions may cause large deformation of breast, which make breast registration become a great challenge. Existing registration approaches for supine and prone breast images mainly use biomechanical modeling and iterative deformable images registration methods. However, the ability of these methods to capture such large deformations is limited. To tackle these problems, we propose an end-to-end residual recursive cascade network (RRCN) for supine and prone breast images registration. Unlike traditional deep learning networks, an affine subnetwork and several deformable subnetworks are trained together, enabling cooperation between subnetworks. Moreover, by using residual network connection, we can accelerate registration speed and reduce radiation dose. Registration accuracy is evaluated by visualizing registered images and computing normalized cross correlation (NCC). The experiment results show that RRCN with an average NCC of 0.982 ± 0.010 outperform VoxelMorph with an average NCC of 0.769 ± 0.070 and Recursive Cascaded Networks (RCN) with an average NCC of 0.914 ± 0.063, demonstrating the superior performance of the proposed method for supine and prone breast image registration. Because accurate deformable registration for this large-scale deformation is of great importance to the success of breast cancer radiotherapy, RRCN method has a strong potential to be a promising tool for future clinical practice in breast cancer radiotherapy.

[1]  María J. Ledesma-Carbayo,et al.  Prone to Supine Surface Based Registration Workflow for Breast Tumor Localization in Surgical Planning , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[2]  J. Sarvaiya,et al.  Image Registration by Template Matching Using Normalized Cross-Correlation , 2009, 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies.

[3]  Marc Niethammer,et al.  DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation , 2019, MICCAI.

[4]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  D Sarrut,et al.  Registration of sliding objects using direction dependent B-splines decomposition , 2013, Physics in medicine and biology.

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Sébastien Ourselin,et al.  A Nonlinear Biomechanical Model Based Registration Method for Aligning Prone and Supine MR Breast Images , 2014, IEEE Transactions on Medical Imaging.

[8]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[9]  Yue Dong,et al.  Recursive Cascaded Networks for Unsupervised Medical Image Registration , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[10]  Peng Wen Medical Image Registration Based-on Points, Contour and Curves , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[11]  Dinggang Shen,et al.  Synthesis and Inpainting-Based MR-CT Registration for Image-Guided Thermal Ablation of Liver Tumors , 2019, MICCAI.

[12]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[13]  Yaoqin Xie,et al.  Deformable image registration of liver with consideration of lung sliding motion. , 2011, Medical physics.

[14]  Dinggang Shen,et al.  BIRNet: Brain image registration using dual‐supervised fully convolutional networks , 2018, Medical Image Anal..

[15]  David J. Hawkes,et al.  MR Navigated Breast Surgery: Method and Initial Clinical Experience , 2008, MICCAI.

[16]  Yu-Dong Yao,et al.  Unsupervised 3D PET-CT Image Registration Method Using a Metabolic Constraint Function and a Multi-Domain Similarity Measure , 2020, IEEE Access.

[17]  Patrick Clarysse,et al.  Automated segmentation of a motion mask to preserve sliding motion in deformable registration of thoracic CT. , 2012, Medical physics.

[18]  Wiro Niessen,et al.  A hybrid deep learning framework for integrated segmentation and registration: evaluation on longitudinal white matter tract changes , 2019, MICCAI.

[19]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[20]  Martyn P. Nash,et al.  Breast Image Registration by Combining Finite Elements and Free-Form Deformations , 2010, Digital Mammography / IWDM.

[21]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[22]  Yuemin Zhu,et al.  ADMIR–Affine and Deformable Medical Image Registration for Drug-Addicted Brain Images , 2020, IEEE Access.

[23]  Zeike A. Taylor,et al.  Application of Biomechanical Modelling to Image-Guided Breast Surgery , 2012 .

[24]  Patrik Kamencay,et al.  3D registration of the point cloud data using ICP algorithm in medical image analysis , 2018, 2018 ELEKTRO.

[25]  James D. Mitchell,et al.  Accelerated intensity-modulated radiotherapy to breast in prone position: dosimetric results. , 2007, International journal of radiation oncology, biology, physics.

[26]  Wen Yan,et al.  Unsupervised End-to-end Learning for Deformable Medical Image Registration , 2017, ArXiv.

[27]  Nanning Zheng,et al.  Affine iterative closest point algorithm for point set registration , 2010, Pattern Recognit. Lett..

[28]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[29]  Ji Luo,et al.  Unsupervised 3D End-to-End Medical Image Registration With Volume Tweening Network , 2019, IEEE Journal of Biomedical and Health Informatics.

[30]  D. Shen,et al.  An Auto-Context Deformable Registration Network for Infant Brain MRI , 2020, ArXiv.

[31]  Dinggang Shen,et al.  Deformable Image Registration Using a Cue-Aware Deep Regression Network , 2018, IEEE Transactions on Biomedical Engineering.

[32]  Yang Lei,et al.  LungRegNet: an unsupervised deformable image registration method for 4D-CT lung. , 2020, Medical physics.

[33]  Fang-Fang Yin,et al.  A multi-scale framework with unsupervised joint training of convolutional neural networks for pulmonary deformable image registration , 2019, Physics in medicine and biology.

[34]  David J. Hawkes,et al.  A Framework for Image-Guided Breast Surgery , 2006, MIAR.

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  Sébastien Ourselin,et al.  Weakly-supervised convolutional neural networks for multimodal image registration , 2018, Medical Image Anal..

[37]  Max A. Viergever,et al.  A deep learning framework for unsupervised affine and deformable image registration , 2018, Medical Image Anal..

[38]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[39]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[40]  Martyn P. Nash,et al.  Modelling Prone to Supine Breast Deformation Under Gravity Loading Using Heterogeneous Finite Element Models , 2012 .