A novel flag-language remote control design for a laparoscopic camera holder using image processing

Minimally invasive surgeries(MIS) possess obvious advantages for patients but require more specially trained personnel than common, open procedure. With modern advances in robotics, it becomes possible to ease these requirements by introducing robotized assistants into operation. However, for robot-assisted solo MIS, it is crucial to have appropriate methods for robot control. This work presents a design of flag language as a novel human-to-robot communication method based on image processing of the endoscope video during real-time intervention. The proposed system comprises autonomous positioning of endoscope holder combined with recognition of surgeon intention by analyzing surgical instrument postures. The proposed algorithm has been evaluated using experimental setup as well as video clips from laparoscopic operation. Experimental results show that the flag posture can be detected satisfactorily with speed of 12 frames per second, as well as system robustness under moderate lighting and noise conditions.

[1]  Kai-Tai Song,et al.  Image tracking of laparoscopic instrument using spiking neural networks , 2013, 2013 13th International Conference on Control, Automation and Systems (ICCAS 2013).

[2]  P. Berkelman,et al.  Control and user interface design for compact manipulators in minimally-invasive surgery , 2005, Proceedings of 2005 IEEE Conference on Control Applications, 2005. CCA 2005..

[3]  Xiaoli Zhang,et al.  Attention-aware robotic laparoscope for human-robot cooperative surgery , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[4]  Le-Nan Wu,et al.  An adaptive threshold for the Canny Operator of edge detection , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[5]  C. Nathan,et al.  The voice-controlled robotic assist scope holder AESOP for the endoscopic approach to the sella. , 2006, Skull base : official journal of North American Skull Base Society ... [et al.].

[6]  Fumio Miyazaki,et al.  FAce MOUSe: A novel human-machine interface for controlling the position of a laparoscope , 2003, IEEE Trans. Robotics Autom..

[7]  Axel Krieger,et al.  Smart Tissue Anastomosis Robot (STAR): A Vision-Guided Robotics System for Laparoscopic Suturing , 2014, IEEE Transactions on Biomedical Engineering.

[8]  Sébastien Ourselin,et al.  Toward Detection and Localization of Instruments in Minimally Invasive Surgery , 2013, IEEE Transactions on Biomedical Engineering.

[9]  Jiri Matas,et al.  Robust Detection of Lines Using the Progressive Probabilistic Hough Transform , 2000, Comput. Vis. Image Underst..

[10]  J. Gilbert.  The EndoAssist robotic camera holder as an aid to the introduction of laparoscopic colorectal surgery. , 2009, Annals of the Royal College of Surgeons of England.

[11]  Purang Abolmaesumi,et al.  Automatic Localization of the da Vinci Surgical Instrument Tips in 3-D Transrectal Ultrasound , 2013, IEEE Transactions on Biomedical Engineering.