Deformable MRI-CT liver image registration using convolutional neural network with modality independent neighborhood descriptors

In radiotherapy, liver CT images are routinely acquired for treatment planning since CT images can provide important electron density information for dose calculation in treatment planning system. Besides the CT images, MRI is often acquired for diagnosis since it has superior soft tissue contrast. Therefore, for accurate contouring of the target, liver CT and MRI image registration plays an important role. It is very challenging to register the CT and MRI liver images due to the distinct image intensities and liver motion. In this study, a deep learning-based network was proposed to directly predict the DVF for MRI-CT liver image registration. To overcome the challenge of multimodal registration, we propose to incorporate a modality independent descriptor into the deep learning network to explore the correlations between the MRI and CT images. Our results show that the proposed network could accurately align MRI to CT liver images. The average Dice increased from 0.89±0.04 before registration to 0.93±0.02 after registration.

[1]  Tian Liu,et al.  MRI-based Treatment Planning for Proton Radiotherapy: Dosimetric Validation of a Deep Learning-based Liver Synthetic CT Generation Method , 2019, Physics in medicine and biology.

[2]  Jian Zheng,et al.  Non-rigid MR-TRUS image registration for image-guided prostate biopsy using correlation ratio-based mutual information , 2017, Biomedical engineering online.

[3]  Yang Lei,et al.  MRI-only based synthetic CT generation using dense cycle consistent generative adversarial networks. , 2019, Medical physics.

[4]  D. Louis Collins,et al.  Nonrigid Registration of Ultrasound and MRI Using Contextual Conditioned Mutual Information , 2014, IEEE Transactions on Medical Imaging.

[5]  Yang Lei,et al.  CT Prostate Segmentation Based on Synthetic MRI-aided Deep Attention Fully Convolution Network. , 2019, Medical physics.

[6]  W. Curran,et al.  Evaluation of a deep learning-based pelvic synthetic CT generation technique for MRI-based prostate proton treatment planning , 2019, Physics in medicine and biology.

[7]  Kemal Tuncali,et al.  Multimodality non-rigid image registration for planning, targeting and monitoring during CT-guided percutaneous liver tumor cryoablation. , 2010, Academic radiology.

[8]  Yang Lei,et al.  MRI-based treatment planning for liver stereotactic body radiotherapy: validation of a deep learning-based synthetic CT generation method. , 2019, The British journal of radiology.

[9]  Simon K. Warfield,et al.  Non-rigid Registration of Pre-procedural MR Images with Intra-procedural Unenhanced CT Images for Improved Targeting of Tumors During Liver Radiofrequency Ablations , 2007, MICCAI.

[10]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[11]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2010, IEEE Transactions on Medical Imaging.

[12]  Tian Liu,et al.  MRI-based pseudo CT synthesis using anatomical signature and alternating random forest with iterative refinement model , 2018, Journal of medical imaging.

[13]  Yabo Fu,et al.  Deep Learning in Medical Image Registration: A Review , 2020, Physics in medicine and biology.

[14]  Tian Liu,et al.  MRI-based synthetic CT generation using semantic random forest with iterative refinement , 2019, Physics in medicine and biology.

[15]  Yang Lei,et al.  4D-CT deformable image registration using multiscale unsupervised deep learning , 2020, Physics in medicine and biology.

[16]  Akif Durdu,et al.  Fusion of CT and MR Liver Images by SURF-Based Registration , 2019, International Journal of Intelligent Systems and Applications in Engineering.

[17]  Yang Lei,et al.  Dose evaluation of MRI-based synthetic CT generated using a machine learning method for prostate cancer radiotherapy. , 2019, Medical dosimetry : official journal of the American Association of Medical Dosimetrists.

[18]  Jon-Paul Voroney,et al.  Prospective comparison of computed tomography and magnetic resonance imaging for liver cancer delineation using deformable image registration. , 2006, International journal of radiation oncology, biology, physics.

[19]  Yang Lei,et al.  4D-CT Deformable Image Registration Using an Unsupervised Deep Convolutional Neural Network , 2019, AIRT@MICCAI.

[20]  Yang Lei,et al.  Synthetic MRI-aided multi-organ segmentation on male pelvic CT using cycle consistent deep attention network. , 2019, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[21]  Yang Lei,et al.  LungRegNet: an unsupervised deformable image registration method for 4D-CT lung. , 2020, Medical physics.

[22]  N. Ploquin,et al.  Structure guided deformable image registration for treatment planning CT and post stereotactic body radiation therapy (SBRT) Primovist® (Gd‐EOB‐DTPA) enhanced MRI , 2019, Journal of applied clinical medical physics.

[23]  Yang Lei,et al.  Head and Neck Multi-Organ Auto-Segmentation on CT Images Aided by Synthetic MRI. , 2020, Medical physics.

[24]  Piotr Wielopolski,et al.  Accurate CT∕MR vessel-guided nonrigid registration of largely deformed livers. , 2012, Medical physics.

[25]  Yang Lei,et al.  MRI-Based Proton Treatment Planning for Base of Skull Tumors. , 2019, International journal of particle therapy.

[26]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.