Automatic Localization of Laparoscopic Instruments for the Visual Servoing of an Endoscopic Camera Holder

The use of a robotized camera holder in laparoscopic surgery allows a surgeon to control the endoscope without the intervention of an assistant. Today, the orders that the surgeon can give to robotized camera holders remain limited. In order to provide higher level interactions between the surgeon and a robotized camera holder, we have developed a new method for the automatic tracking of laparoscopic instruments which works in near real-time. The method is based on the measurement of the 3D positions of the insertion points of the instruments in the abdominal cavity and a simple shape model of the laparoscopic instruments. We present the results of our first experimentation on a cadaver.

[1]  Xiaoli Zhang,et al.  Application of visual tracking for robot-assisted laparoscopic surgery , 2002, J. Field Robotics.

[2]  Luc Soler,et al.  Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing , 2003, IEEE Trans. Robotics Autom..

[3]  Joan Climent,et al.  Automatic instrument localization in laparoscopic surgery , 2004 .

[4]  G. Hirzinger,et al.  Real time visual servoing for laparoscopic surgery. , 1997 .

[5]  P. Ballester,et al.  Comparison of task performance of robotic camera holders EndoAssist and Aesop , 2001, CARS.

[6]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  C. Abbou,et al.  Laparoscopic radical nephrectomy for T1 renal cancer: the gold standard? A comparison of laparoscopic vs open nephrectomy , 2004, BJU international.

[9]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[10]  Y F Wang,et al.  A new framework for vision-enabled and robotically assisted minimally invasive surgery. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[11]  Florent Nageotte,et al.  Detection of grey regions in color images : application to the segmentation of a surgical instrument in robotized laparoscopy , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Philippe Cinquin,et al.  Development of a Compact Cable-Driven Laparoscopic Endoscope Manipulator , 2002, MICCAI.

[13]  G. Hirzinger,et al.  Real-time visual servoing for laparoscopic surgery. Controlling robot motion with color image segmentation , 1997, IEEE Engineering in Medicine and Biology Magazine.

[14]  A W Partin,et al.  Comparison of robotic versus human laparoscopic camera control . , 1995, The Journal of urology.

[15]  Jean-Alexandre Long,et al.  Automatic detection of instruments in laparoscopic images: a first step towards high level command of robotized endoscopic holders , 2006 .

[16]  Ron Kikinis,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002 , 2002, Lecture Notes in Computer Science.