Laser-scan endoscope system for intraoperative geometry acquisition and surgical robot safety management

In laparoscopic surgery, surgeons find particular difficulties related to the operation technique. Due to restricted view, lack of depth information from the monocular endoscope and limited degree of freedom, surgeons find their movements impeded. A support system that provides improved laparoscopic vision would help to overcome the difficulties. If real-time visualization of abdominal structures were feasible, more accurate procedures and improved quantitative evaluations in laparoscopic surgery might be possible. In this study, a laser-scan endoscope system was developed to acquire and visualize the shape and texture of the area of interest instantaneously. The intraoperative geometric information of deformable organ could be applied for robotic safety management via geometric computation of robot position and organ shape. Results of in vivo experiments on a pig liver verified effectiveness of the proposed system.

[1]  Shyr Yu,et al.  Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery , 2000, IEEE Transactions on Medical Imaging.

[2]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Y F Wang,et al.  A new framework for vision-enabled and robotically assisted minimally invasive surgery. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[4]  Hanqi Zhuang,et al.  Simultaneous calibration of a robot and a hand-mounted camera , 1993, IEEE Trans. Robotics Autom..

[5]  Takayuki Okatani,et al.  Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center , 1997, Comput. Vis. Image Underst..

[6]  Luc Soler,et al.  Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing , 2003, IEEE Trans. Robotics Autom..

[7]  Naoki Suzuki,et al.  Intraoperative Fast 3D Shape Recovery of Abdominal Organs in Laparoscopy , 2002, MICCAI.

[8]  Yulun Wang,et al.  Robotic surgery - the transatlantic case , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  James S. Duncan,et al.  Medical Image Analysis , 1999, IEEE Pulse.

[10]  G. Hirzinger,et al.  Real time visual servoing for laparoscopic surgery. , 1997 .

[11]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[12]  G. S. Guthart,et al.  The Intuitive Telesurgery System , 2000 .

[13]  H. Haneishi,et al.  Profilometry of a gastrointestinal surface by an endoscope with laser beam projection. , 1994, Optics letters.

[14]  G. Hirzinger,et al.  Real-time visual servoing for laparoscopic surgery. Controlling robot motion with color image segmentation , 1997, IEEE Engineering in Medicine and Biology Magazine.

[15]  Guang-Zhong Yang,et al.  Dense 3D Depth Recovery for Soft Tissue Deformation During Robotically Assisted Laparoscopic Surgery , 2004, MICCAI.

[16]  Hideaki Haneishi,et al.  A new method for distortion correction of electronic endoscope images , 1995, IEEE Trans. Medical Imaging.

[17]  Dinesh Manocha,et al.  Fast Proximity Queries with Swept Sphere Volumes , 1999 .

[18]  Yoshihiko Nakamura,et al.  Laser-pointing endoscope system for intra-operative 3D geometric registration , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[19]  Yoshihiko Nakamura,et al.  Laser-Pointing Endoscope System for Intraoperative 3D Geometric Registration , 2003 .