Intensity-based visual servoing for non-rigid motion compensation of soft tissue structures due to physiological motion using 4D ultrasound

This paper presents a visual-servoing method for compensating motion of soft tissue structures using 4D ultra-sound. The motion of soft tissue structures caused by physiological and external motion makes it difficult to investigate them for diagnostic and therapeutic purposes. The main goal is to track non-rigidly moving soft tissue structures and compensate the motion in order to keep a lesion on its target position during a treatment. We define a 3D non-rigid motion model by extending the Thin-Plate Spline (TPS) algorithm. The motion parameters are estimated with intensity-value changes of a points set in a tracking soft tissue structure. Finally, the global rigid motion is compensated with a 6-DOF robot according to the motion parameters of the tracking structure. Simulation experiments are performed with recorded 3D US images of in-vivo soft tissue structures and validate the effectiveness of the non-rigid motion tracking method. Robotic experiments demonstrated the success of our method with a deformable phantom.

[1]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Richard James Housden,et al.  Sensorless freehand 3D ultrasound in real tissue: Speckle decorrelation without fully developed speckle , 2006, Medical Image Anal..

[4]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[5]  Rafik Mebarki,et al.  2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments , 2010, IEEE Transactions on Robotics.

[6]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Gregory D. Hager,et al.  Real-time Motion Stabilization with B-mode Ultrasound Using Image Speckle Information and Visual Servoing , 2009, Int. J. Robotics Res..

[8]  Chao Liu,et al.  Three-dimensional Motion Tracking for Beating Heart Surgery Using a Thin-plate Spline Deformable Model , 2010, Int. J. Robotics Res..

[9]  Alexandre Krupa,et al.  A multi-plane approach for ultrasound visual servoing: Application to a registration task , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  P. Evans,et al.  Speckle tracking in a phantom and feature-based tracking in liver in the presence of respiratory motion using 4D ultrasound , 2010, Physics in medicine and biology.

[11]  Ming-Hsuan Yang,et al.  A direct method for modeling non-rigid motion with thin plate spline , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..