Towards a mouth gesture based laparoscope camera command

In this paper a method for the automatic command of three degrees of freedom of a robot using mouth gestures is presented. The method uses a normalized version of the a component from the CIELAB color space in order to detect the mouth region and to segment the mouth structures. A set of features extracted from the segmented regions serve to model a set of activation signals, who control the transitions between states in a state machine that translates gestures into actions. Results and conclusions of the behavior of the system are presented.

[1]  Ashok K. Hemal,et al.  Surgical techniques: robotic bladder diverticulectomy with the da Vinci-S surgical system , 2007, Journal of robotic surgery.

[2]  Josep Amat,et al.  Automatic guidance of an assistant robot in laparoscopic surgery , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[3]  G. Feuchtner,et al.  How to improve performance of robotic totally endoscopic coronary artery bypass grafting. , 2008, American journal of surgery.

[4]  Allison M. Okamura,et al.  Enhancing Transparency of a Position-Exchange Teleoperator , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[5]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  P. Dasgupta,et al.  Ablative and reconstructive robotic‐assisted laparoscopic renal surgery , 2008, International journal of clinical practice.

[7]  S. Bhayani.  da Vinci robotic partial nephrectomy for renal cell carcinoma: an atlas of the four-arm technique , 2008, Journal of robotic surgery.

[8]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[9]  Loi Wah Sun,et al.  Port placement and pose selection of the da Vinci surgical system for collision-free intervention based on performance optimization , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Tao Zhang,et al.  Gesture-based human-robot interaction using a knowledge-based software platform , 2006, Ind. Robot.

[11]  Arnold P. Advincula,et al.  Surgical techniques: robot-assisted laparoscopic myomectomy with the da Vinci® surgical system , 2007, Journal of robotic surgery.

[12]  Fumio Miyazaki,et al.  FAce MOUSe: A novel human-machine interface for controlling the position of a laparoscope , 2003, IEEE Trans. Robotics Autom..

[13]  Juan Jesús Fernández Lozano,et al.  A medical robotic assistant for minimally invasive surgery , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[14]  David B. Camarillo,et al.  Robotic technology in surgery: past, present, and future. , 2004, American journal of surgery.

[15]  Nurul Arif Setiawan,et al.  Real-Time Vision Based Gesture Recognition for Human-Robot Interaction , 2007, KES.

[16]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[17]  Alice Caplier,et al.  New color transformation for lips segmentation , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[18]  Shu Hung Leung,et al.  Automatic lip contour extraction from color images , 2004, Pattern Recognit..

[19]  Tanneguy Redarce,et al.  Real-Time Robot Manipulation Using Mouth Gestures in Facial Video Sequences , 2007, BVAI.

[20]  Alexander Zelinsky,et al.  Human-robot interaction using facial gesture recognition , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[21]  Jean-Philippe Thiran,et al.  Automatic Extraction of Geometric Lip Features with Application to Multi-Modal Speaker Identification , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[22]  Fernando Bello,et al.  ROVIMAS: a software package for assessing surgical skills using the da Vinci telemanipulator system , 2003, 4th International IEEE EMBS Special Topic Conference on Information Technology Applications in Biomedicine, 2003..

[23]  R. Fagin.  Da Vinci prostatectomy: athermal nerve sparing and effect of the technique on erectile recovery and negative margins , 2007, Journal of robotic surgery.

[24]  Thenkurussi Kesavadas,et al.  RoSS: Virtual Reality Robotic Surgical Simulator for the da Vinci Surgical System , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[25]  Patrice Delmas,et al.  Automatic lip tracking: Bayesian segmentation and active contours in a cooperative scheme , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[26]  Chung Kwong Yeung,et al.  Design and Development of a Da Vinci Surgical System Simulator , 2007, 2007 International Conference on Mechatronics and Automation.

[27]  D. Burschka,et al.  Dynamic Augmented Reality for Sensory Substitution in Robot-Assisted Surgical Systems , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Alan Wee-Chung Liew,et al.  Lip segmentation with the presence of beards , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.