Position tracking of moving liver lesion based on real-time registration between 2D ultrasound and 3D preoperative images.

PURPOSE Registration between 2D ultrasound (US) and 3D preoperative magnetic resonance (MR) (or computed tomography, CT) images has been studied recently for US-guided intervention. However, the existing techniques have some limits, either in the registration speed or the performance. The purpose of this work is to develop a real-time and fully automatic registration system between two intermodal images of the liver, and subsequently an indirect lesion positioning/tracking algorithm based on the registration result, for image-guided interventions. METHODS The proposed position tracking system consists of three stages. In the preoperative stage, the authors acquire several 3D preoperative MR (or CT) images at different respiratory phases. Based on the transformations obtained from nonrigid registration of the acquired 3D images, they then generate a 4D preoperative image along the respiratory phase. In the intraoperative preparatory stage, they properly attach a 3D US transducer to the patient's body and fix its pose using a holding mechanism. They then acquire a couple of respiratory-controlled 3D US images. Via the rigid registration of these US images to the 3D preoperative images in the 4D image, the pose information of the fixed-pose 3D US transducer is determined with respect to the preoperative image coordinates. As feature(s) to use for the rigid registration, they may choose either internal liver vessels or the inferior vena cava. Since the latter is especially useful in patients with a diffuse liver disease, the authors newly propose using it. In the intraoperative real-time stage, they acquire 2D US images in real-time from the fixed-pose transducer. For each US image, they select candidates for its corresponding 2D preoperative slice from the 4D preoperative MR (or CT) image, based on the predetermined pose information of the transducer. The correct corresponding image is then found among those candidates via real-time 2D registration based on a gradient-based similarity measure. Finally, if needed, they obtain the position information of the liver lesion using the 3D preoperative image to which the registered 2D preoperative slice belongs. RESULTS The proposed method was applied to 23 clinical datasets and quantitative evaluations were conducted. With the exception of one clinical dataset that included US images of extremely low quality, 22 datasets of various liver status were successfully applied in the evaluation. Experimental results showed that the registration error between the anatomical features of US and preoperative MR images is less than 3 mm on average. The lesion tracking error was also found to be less than 5 mm at maximum. CONCLUSIONS A new system has been proposed for real-time registration between 2D US and successive multiple 3D preoperative MR/CT images of the liver and was applied for indirect lesion tracking for image-guided intervention. The system is fully automatic and robust even with images that had low quality due to patient status. Through visual examinations and quantitative evaluations, it was verified that the proposed system can provide high lesion tracking accuracy as well as high registration accuracy, at performance levels which were acceptable for various clinical applications.

[1]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[2]  Jong Beom Ra,et al.  Robust feature based pre-registration of 3D MR image to 3D B-mode ultrasound image of the liver , 2013 .

[3]  Nassir Navab,et al.  Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention , 2008, Medical Image Anal..

[4]  David J. Hawkes,et al.  Alignment of sparse freehand 3-D ultrasound with preoperative images of the liver using models of respiratory motion and deformation , 2005, IEEE Transactions on Medical Imaging.

[5]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[6]  Ingemar Ragnemalm,et al.  The Euclidean distance transform in arbitrary dimensions , 1992, Pattern Recognit. Lett..

[7]  Jayaram K. Udupa,et al.  Graph-based retrospective 4D image construction from free-breathing MRI slice acquisitions , 2014, Medical Imaging.

[8]  T. Peters Image-guidance for surgical procedures , 2006, Physics in medicine and biology.

[9]  N. Glossop,et al.  Advantages of optical compared with electromagnetic tracking. , 2009, The Journal of bone and joint surgery. American volume.

[10]  Nassir Navab,et al.  Manifold learning for image-based breathing gating in ultrasound and MRI , 2012, Medical Image Anal..

[11]  Anikó Ekárt,et al.  Pre-registration of arbitrarily oriented 3D surfaces using a genetic algorithm , 2006, Pattern Recognit. Lett..

[12]  David J. Hawkes,et al.  Overview of an ultrasound to CT or MR registration system for use in thermal ablation of liver metastases , 2001 .

[13]  David J. Hawkes,et al.  Registration of freehand 3D ultrasound and magnetic resonance liver images , 2004, Medical Image Anal..

[14]  Mark Schneider,et al.  Development and testing of a new magnetic-tracking device for image guidance , 2007, SPIE Medical Imaging.

[15]  Jong Beom Ra,et al.  Position estimation of moving liver lesion based on registration between 2D ultrasound and 4D MR images , 2012, ICIP.

[16]  Laurent Risser,et al.  Rigid Registration of Untracked Freehand 2D Ultrasound Sweeps to 3D CT of Liver Tumours , 2013, Abdominal Imaging.

[17]  Byung Il Kim,et al.  Motion-compensated PET image reconstruction with respiratory-matched attenuation correction using two low-dose inhale and exhale CT images , 2013, Physics in medicine and biology.

[18]  Carlo Bartolozzi,et al.  Targeting Liver Lesions for Radiofrequency Ablation: An Experimental Feasibility Study Using a CT–US Fusion Imaging System , 2008, Investigative radiology.

[19]  Jae Young Lee,et al.  Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching , 2012, Physics in medicine and biology.

[20]  Wolfgang Birkfellner,et al.  Calibration of tracking systems in a surgical environment , 1998, IEEE Transactions on Medical Imaging.

[21]  Jae Young Lee,et al.  Non-rigid registration between 3D ultrasound and CT images of the liver based on intensity and gradient information , 2011, Physics in medicine and biology.

[22]  Thomas Lange,et al.  3D ultrasound-CT registration of the liver using combined landmark-intensity information , 2008, International Journal of Computer Assisted Radiology and Surgery.