Shearlet-based vs. photometric-based visual servoing for robot-assisted medical applications

This paper deals with the development of a vision-based controller for robot-assisted medical applications. It concerns the use of shearlet coefficients in case of ultrasounds (US) images as visual signal inputs and the design of the associated interaction matrix. The proposed controller was validated in both simulation and on an experimental test bench which consists of a robotic arm holding an US probe in contact with a realistic abdominal phantom. Also, the proposed control scheme was compared to the photometry-based visual servoing approach in order to evaluate its efficiency in different conditions of use (nominal and unfavorable conditions).

[1]  R. S. Anand,et al.  Enhancement of Medical Ultrasound Images Using Multiscale Discrete Shearlet Transform Based Thresholding , 2012, 2012 International Symposium on Electronic System Design (ISED).

[2]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[3]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[4]  Hamid Krim,et al.  Edge detection and processing using shearlets , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Nicolas Andreff,et al.  Wavelets-based 6 DOF visual servoing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Alexandre Krupa,et al.  Towards Ultrasound-based visual servoing using shearlet coefficients , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Wang-Q Lim,et al.  Sparse multidimensional representation using shearlets , 2005, SPIE Optics + Photonics.

[8]  Brahim Tamadazte,et al.  A Direct Visual Servoing Scheme for Automatic Nanopositioning , 2012, IEEE/ASME Transactions on Mechatronics.

[9]  Wang-Q Lim,et al.  Image inpainting: theoretical analysis and comparison of algorithms , 2013, Optics & Photonics - Optical Engineering + Applications.

[10]  Christophe Collewet,et al.  Photometric Visual Servoing , 2011, IEEE Transactions on Robotics.

[11]  Rafik Mebarki,et al.  2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments , 2010, IEEE Transactions on Robotics.

[12]  Alexandre Krupa,et al.  Robotized Tele-Echography: An Assisting Visibility Tool to Support Expert Diagnostic , 2016, IEEE Systems Journal.

[13]  Wang-Q Lim,et al.  ShearLab 3D , 2014, 1402.5670.

[14]  Wen-Hong Zhu,et al.  Image-guided control of a robot for medical ultrasound , 2002, IEEE Trans. Robotics Autom..

[15]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[16]  Gitta Kutyniok,et al.  Introduction to Shearlets , 2012 .

[17]  Alexandre Krupa,et al.  Intensity-Based Ultrasound Visual Servoing: Modeling and Validation With 2-D and 3-D Probes , 2013, IEEE Transactions on Robotics.