A cascade-network framework for integrated registration of liver DCE-MR images

Registration of hepatic dynamic contrast-enhanced magnetic resonance images (DCE-MRIs) is an important task for evaluation of transarterial chemoembolization (TACE) or radiofrequency ablation by quantifying enhancing viable residue tumor against necrosis. However, intensity changes due to contrast agents combined with spatial deformations render technical challenges for accurate registration of DCE-MRI, and traditional deformable registration methods using mutual information are often computationally intensive in order to tolerate such intensity enhancement and shape deformation variability. To address this problem, we propose a cascade network framework composed of a de-enhancement network (DE-Net) and a registration network (Reg-Net) to first remove contrast enhancement effects and then register the liver images in different phases. In experiments, we used DCE-MRI series of 97 patients from Renji Hospital of Shanghai Jiaotong University and registered the arterial phase and the portal venous phase images onto the pre-contrast phases. The performance of the cascade network framework was compared with that of the traditional registration method SyN in the ANTs toolkit and Reg-Net without DE-Net. The results showed that the proposed method achieved comparable registration performance with SyN but significantly improved the efficiency.

[1]  Mateusz Buda,et al.  Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[2]  Oğuz Dicle,et al.  The role of dynamic subtraction MRI in detection of hepatocellular carcinoma. , 2008, Diagnostic and interventional radiology.

[3]  Erlend Hodneland,et al.  Normalized gradient fields and mutual information for motion correction of DCE-MRI images , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[4]  Myeong-Jin Kim,et al.  Added value of subtraction imaging in detecting arterial enhancement in small (<3 cm) hepatic nodules on dynamic contrast-enhanced MRI in patients at high risk of hepatocellular carcinoma , 2013, European Radiology.

[5]  Max A. Viergever,et al.  A survey of medical image registration - under review , 2016, Medical Image Anal..

[6]  Zheng Liu,et al.  On the Use of Phase Congruency to Evaluate Image Similarity , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[7]  G. Low,et al.  Value of subtraction MRI in assessing treatment response following image-guided loco-regional therapies for hepatocellular carcinoma. , 2012, Clinical radiology.

[8]  J P W Pluim,et al.  Evaluation of motion correction for clinical dynamic contrast enhanced MRI of the liver. , 2017, Physics in medicine and biology.

[9]  David Atkinson,et al.  Respiratory motion correction in dynamic MRI using robust data decomposition registration - Application to DCE-MRI , 2014, Medical Image Anal..

[10]  Qianjin Feng,et al.  Correlation-Weighted Sparse Representation for Robust Liver DCE-MRI Decomposition Registration , 2019, IEEE Transactions on Medical Imaging.

[11]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[12]  Subtraction Images of Gadoxetic Acid-Enhanced MRI: Effect on the Diagnostic Performance for Focal Hepatic Lesions in Patients at Risk for Hepatocellular Carcinoma. , 2017, AJR. American journal of roentgenology.

[13]  Jeffrey H Maki,et al.  Evaluation of image registration in subtracted 3D dynamic contrast-enhanced MRI of treated hepatocellular carcinoma. , 2015, AJR. American journal of roentgenology.

[14]  Dinggang Shen,et al.  De-enhancing the Dynamic Contrast-Enhanced Breast MRI for Robust Registration , 2007, MICCAI.

[15]  Zhang Li,et al.  Improved registration of DCE-MR images of the liver using a prior segmentation of the region of interest , 2016, SPIE Medical Imaging.

[16]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[17]  Hyunjin Park,et al.  Prospects of deep learning for medical imaging , 2018, Precision and Future Medicine.

[18]  Erlend Hodneland,et al.  Segmentation-Driven Image Registration-Application to 4D DCE-MRI Recordings of the Moving Kidneys , 2014, IEEE Transactions on Image Processing.

[19]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[20]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[21]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[22]  Josien P. W. Pluim,et al.  Motion correction of dynamic contrast enhanced MRI of the liver , 2017, Medical Imaging.

[23]  Qianjin Feng,et al.  Liver DCE-MRI Registration in Manifold Space Based on Robust Principal Component Analysis , 2016, Scientific Reports.

[24]  E. Hecht,et al.  Hepatocellular carcinoma: Assessment of response to transarterial chemoembolization with image subtraction , 2010, Journal of magnetic resonance imaging : JMRI.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Sheng Xu,et al.  Learning deep similarity metric for 3D MR–TRUS image registration , 2018, International Journal of Computer Assisted Radiology and Surgery.

[27]  Joachim M. Buhmann,et al.  Joint segmentation and groupwise registration of cardiac DCE MRI using sparse data representations , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).