Towards Ultrasound-based visual servoing using shearlet coefficients

This paper deals with the development of a new 6 degrees-of-freedom (DOF) vision-based controller for robot-assisted medical applications. The main objective is to use visual information extracted from Ultrasounds (US) images to control an US probe held by a robot. Instead of the conventional use of visual features e.g., geometric features (points, lines, moments, etc.) in the visual control law design, the described method uses the shearlet coefficients. More precisely, the time-variation of the coarsest level of shearlet decomposition coefficients are linked to the US probe (respectively to the robot) spatial velocity and then related to the task-function control law. The proposed control law was experimentally tested and validated using a realistic abdominal phantom. The obtained results demonstrated promising performances in terms of accuracy, repeatability, robustness and convergence behavior.

[1]  Koichiro Deguchi,et al.  A Direct Interpretation of Dynamic Images with Camera and Object Motions for Vision Guided Robot Control , 2000, International Journal of Computer Vision.

[2]  R. S. Anand,et al.  Enhancement of Medical Ultrasound Images Using Multiscale Discrete Shearlet Transform Based Thresholding , 2012, 2012 International Symposium on Electronic System Design (ISED).

[3]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[4]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[5]  J. Hong,et al.  An ultrasound-driven needle-insertion robot for percutaneous cholecystostomy. , 2004, Physics in medicine and biology.

[6]  Rafik Mebarki,et al.  2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments , 2010, IEEE Transactions on Robotics.

[7]  Alexandre Krupa,et al.  Robotized Tele-Echography: An Assisting Visibility Tool to Support Expert Diagnostic , 2016, IEEE Systems Journal.

[8]  Wen-Hong Zhu,et al.  Image-guided control of a robot for medical ultrasound , 2002, IEEE Trans. Robotics Autom..

[9]  Gitta Kutyniok,et al.  Introduction to Shearlets , 2012 .

[10]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[11]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[12]  Alexandre Krupa,et al.  Intensity-Based Ultrasound Visual Servoing: Modeling and Validation With 2-D and 3-D Probes , 2013, IEEE Transactions on Robotics.

[13]  R. Istepanian,et al.  Clinical trials and evaluation of a mobile, robotic tele-ultrasound system , 2005, Journal of telemedicine and telecare.

[14]  Brahim Tamadazte,et al.  A Direct Visual Servoing Scheme for Automatic Nanopositioning , 2012, IEEE/ASME Transactions on Mechatronics.

[15]  Wang-Q Lim,et al.  Image inpainting: theoretical analysis and comparison of algorithms , 2013, Optics & Photonics - Optical Engineering + Applications.