Automatic detection of instruments in laparoscopic images: a first step towards high level command of robotized endoscopic holders

The tracking of surgical instruments offers interesting possibilities for the development of high level commands for robotized camera holders in laparoscopic surgery. We present a new method to detect instruments in laparoscopic images which uses information on the 3D position of the insertion point of an instrument in the abdominal cavity. This information strongly constrains the search for the instrument in each endoscopic image. Hence, the instrument can be detected thanks to shape considerations, which would otherwise not be feasible in near real time. Early results show that the method is rapid and robust to partial occlusion and smoke

[1]  Josep Amat,et al.  Automatic guidance of an assistant robot in laparoscopic surgery , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[2]  C. Abbou,et al.  Laparoscopic radical nephrectomy for T1 renal cancer: the gold standard? A comparison of laparoscopic vs open nephrectomy , 2004, BJU international.

[3]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[4]  Luc Soler,et al.  Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing , 2003, IEEE Trans. Robotics Autom..

[5]  A W Partin,et al.  Comparison of robotic versus human laparoscopic camera control . , 1995, The Journal of urology.

[6]  Florent Nageotte,et al.  Segmentation and Guidance of Multiple Rigid Objects for Intra-operative Endoscopic Vision , 2006, WDV.

[7]  G. Hirzinger,et al.  Real time visual servoing for laparoscopic surgery. , 1997 .

[8]  Y F Wang,et al.  A new framework for vision-enabled and robotically assisted minimally invasive surgery. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[9]  Tobias Ortmaier,et al.  Reconstruction of Image Structure in Presence of Specular Reflections , 2001, DAGM-Symposium.

[10]  Philippe Cinquin,et al.  Development of a Compact Cable-Driven Laparoscopic Endoscope Manipulator , 2002, MICCAI.

[11]  G. Hirzinger,et al.  Real-time visual servoing for laparoscopic surgery. Controlling robot motion with color image segmentation , 1997, IEEE Engineering in Medicine and Biology Magazine.

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[14]  Dong-Soo Kwon,et al.  Intelligent interaction between surgeon and laparoscopic assistant robot system , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[15]  李幼升,et al.  Ph , 1989 .

[16]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[17]  Fumio Miyazaki,et al.  Real-Time Visual Tracking of the Surgeon's Face for Laparoscopic Surgery , 2001, MICCAI.

[18]  P. Ballester,et al.  Comparison of task performance of robotic camera holders EndoAssist and Aesop , 2001, CARS.