Maintaining visibility constraints during tele-echography with ultrasound visual servoing

This paper presents a multi-task control method to maintain the visibility of an anatomic element of interest while the doctor tele-operates a 2D ultrasound probe held by a medical robot. The prior task consists in automatically maintaining several visual constraints that guarantee an inter-section between the ultrasound image plane and the anatomic object of interest and the second task allows the medical expert to manually apply probe motion through tele-operation. Unlike classical visual servoing technique which continually regulate the current visual features to desired values, our control approach gradually activates the regulation of one or several ultrasound visual features that go close to fixed limits in such a way to keep them in a safe domain. The main advantage of this approach is to give to the clinician the control of all the degrees of freedom of the probe to examine the patient while automatically preserving the visibility of the element of interest if required. Both simulations and experiments performed on an abdominal phantom demonstrate the efficiency of the visibility assistance task.

[1]  Christophe Collewet,et al.  Polar snakes: A fast and robust parametric active contour model , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[3]  Alexandre Krupa,et al.  Intensity-based direct visual servoing of an ultrasound probe , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Rafik Mebarki,et al.  2-D Ultrasound Probe Complete Guidance by Visual Servoing Using Image Moments , 2010, IEEE Transactions on Robotics.

[5]  Philippe Cinquin,et al.  A new robot architecture for tele-echography , 2003, IEEE Trans. Robotics Autom..

[6]  Oussama Khatib,et al.  A Unified Approach to Integrate Unilateral Constraints in the Stack of Tasks , 2009, IEEE Transactions on Robotics.

[7]  Tao Li,et al.  A robust parametric active contour based on fourier descriptors , 2011, 2011 18th IEEE International Conference on Image Processing.

[8]  Natalie Smith-Guerin,et al.  Optimization of a 4 dof tele-echography robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Nicolas Mansard,et al.  Continuity of Varying-Feature-Set Control Laws , 2009, IEEE Transactions on Automatic Control.

[10]  Olivier Kermorgant,et al.  Combining IBVS and PBVS to ensure the visibility constraint , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Wen-Hong Zhu,et al.  Image-guided control of a robot for medical ultrasound , 2002, IEEE Trans. Robotics Autom..

[12]  Robert O. Rainer,et al.  Architecture for a high-performance tele-ultrasound system , 1996, Medical Imaging.

[13]  Etienne Dombre,et al.  HIPPOCRATE: an intrinsically safe robot for medical applications , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[14]  Eizen Kimura,et al.  Three dimensional motion mechanism of ultrasound probe and its application for tele-echography system , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[15]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[16]  J. Ayoub,et al.  Realtime tele-operated abdominal and fetal echography in 4 medical centres, from one expert center, using a robotic arm & ISDN or satellite link , 2008, 2008 IEEE International Conference on Automation, Quality and Testing, Robotics.