Visual servoing of a robotic endoscope holder based on surgical instrument tracking

We propose an image-based control for a robotic endoscope holder during laparoscopic surgery. Our aim is to provide more comfort to the practitioner during surgery by automatically positioning the endoscope at his request. To do so, we propose to maintain one or more instruments roughly at the center of the laparoscopic image through different command modes. The originality of this method relies on the direct use of the endoscopic image and the absence of artificial markers added to the instruments. The application is validated on a test bench with a commercial robotic endoscope holder.

[1]  Luc Soler,et al.  Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing , 2003, IEEE Trans. Robotics Autom..

[2]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[3]  K Radermacher,et al.  An automatic camera-holding system for gynecologic laparoscopy. , 2001, The Journal of the American Association of Gynecologic Laparoscopists.

[4]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[5]  Philippe Cinquin,et al.  Development of miniaturized light endoscope-holder robot for laparoscopic surgery , 2007, Journal of endourology.

[6]  J. M. Sackier,et al.  Robotically assisted laparoscopic surgery , 2008, Surgical Endoscopy.

[7]  Gerd Hirzinger,et al.  Motion Tracking for Minimally Invasive Robotic Surgery , 2008 .

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  Ivo A. M. J. Broeders,et al.  Robotics revolutionizing surgery: the Intuitive Surgical “Da Vinci” system , 2001 .

[10]  Nassir Navab,et al.  Statistical modeling and recognition of surgical workflow , 2012, Medical Image Anal..

[11]  Philippe Cinquin,et al.  3D Tracking of Laparoscopic Instruments Using Statistical and Geometric Modeling , 2011, MICCAI.

[12]  J. Dankelman,et al.  Peroperative analysis of the surgical procedure , 2001, Surgical Endoscopy And Other Interventional Techniques.

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Riaz Agha,et al.  Does Laparoscopic Surgery Spell the end of the Open Surgeon? , 2003 .

[15]  Philippe Cinquin,et al.  Automatic Localization of Laparoscopic Instruments for the Visual Servoing of an Endoscopic Camera Holder , 2006, MICCAI.

[16]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[17]  Dong-Soo Kwon,et al.  Intelligent interaction between surgeon and laparoscopic assistant robot system , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[18]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[19]  Josep Amat,et al.  Automatic guidance of an assistant robot in laparoscopic surgery , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[20]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .