2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments

This paper presents a visual-servoing method that is based on 2-D ultrasound (US) images. The main goal is to guide a robot actuating a 2-D US probe in order to reach a desired cross-section image of an object of interest. The method we propose allows the control of both in-plane and out-of-plane probe motions. Its feedback visual features are combinations of moments extracted from the observed image. The exact analytical form of the interaction matrix that relates the image-moments time variation to the probe velocity is developed, and six independent visual features are proposed to control the six degrees of freedom of the robot. In order to endow the system with the capability of automatically interacting with objects of unknown shape, a model-free visual servoing is developed. For that, we propose an efficient online estimation method to identify the parameters involved in the interaction matrix. Results obtained in both simulations and experiments validate the methods presented in this paper and show their robustness to different errors and perturbations, especially those inherent to the noisy US images.

[1]  Andrew M. Gleason,et al.  Calculus (2nd ed.) , 1998 .

[2]  Rafik Mebarki,et al.  Automatic guidance of robotized 2D ultrasound probes with visual servoing based on image moments. , 2010 .

[3]  Philippe Poignet,et al.  Ultrasound Image-Based Visual Servoing of a Surgical Instrument Through Nonlinear Model Predictive Control , 2008, Int. J. Robotics Res..

[4]  Richard J. Prokop,et al.  A survey of moment-based techniques for unoccluded object representation and recognition , 1992, CVGIP Graph. Model. Image Process..

[5]  Alexander G. Mamistvalov n-Dimensional Moment Invariants and Conceptual Mathematical Theory of Recognition n-Dimensional Solids , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Robert D. Howe,et al.  Real-Time Visual Servoing of a Robot Using Three-Dimensional Ultrasound , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[8]  Wen-Hong Zhu,et al.  Image-guided control of a robot for medical ultrasound , 2002, IEEE Trans. Robotics Autom..

[9]  Cheng-Shang Chang Calculus , 2020, Bicycle or Unicycle?.

[10]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[11]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[12]  R. Mukundan,et al.  Moment Functions in Image Analysis: Theory and Applications , 1998 .

[13]  François Chaumette,et al.  Point-based and region-based image moments for visual servoing of planar objects , 2005, IEEE Transactions on Robotics.

[14]  Rafik Mebarki,et al.  Modeling and 3D local estimation for in-plane and out-of-plane motion guidance by 2D ultrasound-based visual servoing , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[16]  Rafik Mebarki,et al.  Image moments-based ultrasound visual servoing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[17]  François Chaumette,et al.  Image moments: a general and useful set of features for visual servoing , 2004, IEEE Transactions on Robotics.

[18]  Guillaume Morel,et al.  Robust Ultrasound-Based Visual Servoing for Beating Heart Intracardiac Surgery , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[20]  G. Kreisselmeier Stabilized least-squares type adaptive identifiers , 1990 .

[21]  Christophe Collewet,et al.  Polar snakes: A fast and robust parametric active contour model , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[22]  J. Hong,et al.  An ultrasound-driven needle-insertion robot for percutaneous cholecystostomy. , 2004, Physics in medicine and biology.

[23]  Etienne Dombre,et al.  Hippocrate: a safe robot arm for medical applications with force feedback , 1999, Medical Image Anal..

[24]  Gregory D. Hager,et al.  Real-time Motion Stabilization with B-mode Ultrasound Using Image Speckle Information and Visual Servoing , 2009, Int. J. Robotics Res..