Ultrasound fusion image error correction using subject-specific liver motion model and automatic image registration

PURPOSE Ultrasound fusion imaging is an emerging tool and benefits a variety of clinical applications, such as image-guided diagnosis and treatment of hepatocellular carcinoma and unresectable liver metastases. However, respiratory liver motion-induced misalignment of multimodal images (i.e., fusion error) compromises the effectiveness and practicability of this method. The purpose of this paper is to develop a subject-specific liver motion model and automatic registration-based method to correct the fusion error. METHODS An online-built subject-specific motion model and automatic image registration method for 2D ultrasound-3D magnetic resonance (MR) images were combined to compensate for the respiratory liver motion. The key steps included: 1) Build a subject-specific liver motion model for current subject online and perform the initial registration of pre-acquired 3D MR and intra-operative ultrasound images; 2) During fusion imaging, compensate for liver motion first using the motion model, and then using an automatic registration method to further correct the respiratory fusion error. Evaluation experiments were conducted on liver phantom and five subjects. RESULTS In the phantom study, the fusion error (superior-inferior axis) was reduced from 13.90±2.38mm to 4.26±0.78mm by using the motion model only. The fusion error further decreased to 0.63±0.53mm by using the registration method. The registration method also decreased the rotation error from 7.06±0.21° to 1.18±0.66°. In the clinical study, the fusion error was reduced from 12.90±9.58mm to 6.12±2.90mm by using the motion model alone. Moreover, the fusion error decreased to 1.96±0.33mm by using the registration method. CONCLUSIONS The proposed method can effectively correct the respiration-induced fusion error to improve the fusion image quality. This method can also reduce the error correction dependency on the initial registration of ultrasound and MR images. Overall, the proposed method can improve the clinical practicability of ultrasound fusion imaging.

[1]  Calvin R. Maurer,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[2]  Pai-Chi Li,et al.  An Efficient Speckle Tracking Algorithm for Ultrasonic Imaging , 2002, Ultrasonic imaging.

[3]  Lei Zhu,et al.  Local structure orientation descriptor based on intra-image similarity for multimodal registration of liver ultrasound and MR images , 2016, Comput. Biol. Medicine.

[4]  Golnoosh Samei,et al.  Review on 4D models for organ motion compensation. , 2012, Critical reviews in biomedical engineering.

[5]  Philippe C. Cattin,et al.  A Bayesian Framework for Estimating Respiratory Liver Motion from Sparse Measurements , 2011, Abdominal Imaging.

[6]  Ding Hui Wang Xiao-dong Wang Guang-zhi Yang Ming-lei Analysis of respiration-induced liver motion mode , 2014 .

[7]  S. Kalnicki,et al.  Abdominal organ motion measured using 4D CT. , 2006, International journal of radiation oncology, biology, physics.

[8]  Anne Auperin,et al.  Clinical Evaluation of Spatial Accuracy of a Fusion Imaging Technique Combining Previously Acquired Computed Tomography and Real-Time Ultrasound for Imaging of Liver Metastases , 2011, CardioVascular and Interventional Radiology.

[9]  W. O'Dell,et al.  Modeling liver motion and deformation during the respiratory cycle using intensity-based nonrigid registration of gated MR images. , 2004, Medical physics.

[10]  David J. Hawkes,et al.  Alignment of sparse freehand 3-D ultrasound with preoperative images of the liver using models of respiratory motion and deformation , 2005, IEEE Transactions on Medical Imaging.

[11]  Lei Zhu,et al.  Subject-specific real-time respiratory liver motion compensation method for ultrasound-MRI/CT fusion imaging , 2015, International Journal of Computer Assisted Radiology and Surgery.

[12]  P. Siarry,et al.  Gradient descent method for optimizing various fuzzy rule bases , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[13]  Caroline Ewertsen,et al.  Real-time image fusion involving diagnostic ultrasound. , 2013, AJR. American journal of roentgenology.

[14]  Philippe C. Cattin,et al.  Inter-subject Modelling of Liver Deformation During Radiation Therapy , 2007, MICCAI.

[15]  Philippe C. Cattin,et al.  3D Organ Motion Prediction for MR-Guided High Intensity Focused Ultrasound , 2011, MICCAI.

[16]  Gábor Székely,et al.  Predicting Liver Motion Using Exemplar Models , 2012, Abdominal Imaging.

[17]  Robert J. Maciunas,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[18]  Josien P W Pluim,et al.  Subject-specific four-dimensional liver motion modeling based on registration of dynamic MRI , 2016, Journal of medical imaging.

[19]  David J. Hawkes,et al.  A Statistical Model of Respiratory Motion and Deformation of the Liver , 2001, MICCAI.

[20]  K. Brock,et al.  Adapting liver motion models using a navigator channel technique. , 2009, Medical physics.

[21]  Jacob Sosna,et al.  Evaluation of an electromagnetic image-fusion navigation system for biopsy of small lesions: assessment of accuracy in an in vivo swine model. , 2013, Academic radiology.

[22]  M. Lee,et al.  Fusion imaging of real-time ultrasonography with CT or MRI for hepatic intervention , 2014, Ultrasonography.