Strain estimation of moving tissue based on automatic motion compensation by ultrasound visual servoing

This paper presents a robot-assisted system to obtain elastic information of a moving tissue using a 2-D ultrasound probe actuated by a 6 degrees of freedom robotic arm. The proposed method combines ultrasound image-based visual servoing, force control and non-rigid motion estimation. We present how the motion estimation, while the force control and visual sevoing are enabled, is useful to compute the strain map of the tissue. Ex-vivo experiments performed on a moving abdominal phantom demonstrate the efficiency and robustness of this methodology to compute the strain information of a tissue in motion.

[1]  Peter Kazanzides,et al.  Enabling technologies for natural orifice transluminal endoscopic surgery (N.O.T.E.S) using robotically guided elasticity imaging , 2012, Medical Imaging.

[2]  Florent Brunet,et al.  Feature-Driven Direct Non-Rigid Image Registration , 2010, International Journal of Computer Vision.

[3]  Alexandre Krupa,et al.  Robotized Tele-Echography: An Assisting Visibility Tool to Support Expert Diagnostic , 2016, IEEE Systems Journal.

[4]  Russell H. Taylor,et al.  Visual tracking using the sum of conditional variance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[6]  Gregory D. Hager,et al.  Real-Time Tissue Tracking with B-Mode Ultrasound Using Speckle and Visual Servoing , 2007, MICCAI.

[7]  Alexandre Krupa,et al.  Automatic palpation for quantitative ultrasound elastography by visual servoing and force control , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Alexandre Krupa,et al.  Intensity-based visual servoing for non-rigid motion compensation of soft tissue structures due to physiological motion using 4D ultrasound , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Maud Marchal,et al.  Real‐time target tracking of soft tissues in 3D ultrasound images based on robust visual information and mechanical simulation , 2017, Medical Image Anal..

[10]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[11]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[12]  Alexandre Krupa,et al.  Intensity-based direct visual servoing of an ultrasound probe , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Russell H. Taylor,et al.  System for robot-assisted real-time laparoscopic ultrasound elastography , 2012, Medical Imaging.

[14]  Chao Liu,et al.  Three-dimensional Motion Tracking for Beating Heart Surgery Using a Thin-plate Spline Deformable Model , 2010, Int. J. Robotics Res..

[15]  Éric Marchand,et al.  Dense non-rigid visual tracking with a robust similarity function , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Robert Rohling,et al.  Remote Ultrasound Palpation for Robotic Interventions Using Absolute Elastography , 2012, MICCAI.

[17]  J. Ophir,et al.  Elastography: A Quantitative Method for Imaging the Elasticity of Biological Tissues , 1991, Ultrasonic imaging.

[18]  F. Kallel,et al.  A Least-Squares Strain Estimator for Elastography , 1997, Ultrasonic imaging.