Real-Time Visual Tracking of the Surgeon's Face for Laparoscopic Surgery

We have developed an image-based human-machine interface that tracks the surgeon's face robustly in real-time(30Hz) and does not require to use any body-contacted sensing devices. Based on this face tracker we have developed a new robotic laparoscope positioning system for solo surgery. Our system completely frees the surgeon's hands and feet from the laparoscope guiding task. To evaluate the performance of the proposed system and its applicability to clinical use, an in vivo experiment was carried out in which a surgeon used the system to perform a laparoscopic cholecystectomy on a pig.

[1]  P. Finlay,et al.  Controlling the Movement of a Surgical Laparoscope EndoSistq with four degrees of freedom, operates in concert with surgeon's intuitive head motions , 1995 .

[2]  P. A. Finlay,et al.  Controlling the movement of a surgical laparoscope , 1995 .

[3]  Russell H. Taylor,et al.  A telerobotic assistant for laparoscopic surgery , 1995 .

[4]  Juan Jesús Fernández Lozano,et al.  A medical robotic assistant for minimally invasive surgery , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Robert G. Moore,et al.  Laparoscopic visual field , 1998, Surgical Endoscopy.

[6]  G. Buess,et al.  A new remote-controlled endoscope positioning system for endoscopic solo surgery , 2000, Surgical Endoscopy.

[7]  N. J. Dowler,et al.  The evolutionary design of an endoscopic telemanipulator , 1996, IEEE Robotics Autom. Mag..

[8]  K Masamune,et al.  A new safe laparoscopic manipulator system with a five-bar linkage mechanism and an optical zoom. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[9]  B R Lee,et al.  Laparoscopic visual field. Voice vs foot pedal interfaces for control of the AESOP robot. , 1998, Surgical endoscopy.

[10]  Hurteau Hurteau,et al.  Laparoscopic surgery assisted by a robotic cameraman: concept and experimental results , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.