Visual Servo of a 6-DOF Robotic Stereo Flexible Endoscope Based on da Vincix Research Kit (dVRK) System

Endoscopes play an important role in minimally invasive surgery (MIS). Due to the advantages of less occupied motion space and enhanced safety, flexible endoscopes are drawing more and more attention. However, the structure of the flexible section makes it difficult for surgeons to manually rotate and guide the view of endoscopes. To solve these problems, we developed a 6-DOF robotic stereo flexible endoscope (RSFE) based on the da Vinci Research Kit (dVRK). Then an image-based endoscope guidance method with depth information is proposed for the RSFE. With this method, the view and insertion depth of the RSFE can be adjusted by tracking the surgical instruments automatically. Additionally, an image-based view rotation control method is proposed, with which the rotation of the view can be controlled by tracking two surgical instruments. The experimental results show that the proposed methods control the direction and rotation of the view of the flexible endoscope faster than the manual control method. Lastly, an ex vivo experiment is performed to demonstrate the feasibility of the proposed control method and system.

[1]  Fumio Miyazaki,et al.  FAce MOUSe: A novel human-machine interface for controlling the position of a laparoscope , 2003, IEEE Trans. Robotics Autom..

[2]  Jumpei Arata,et al.  A new robotic-assisted flexible endoscope with single-hand control: endoscopic submucosal dissection in the ex vivo porcine stomach , 2018, Surgical Endoscopy.

[3]  Dong-Soo Kwon,et al.  Intelligent interaction between surgeon and laparoscopic assistant robot system , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[4]  J. Landman,et al.  Evaluation of surgical performance with standard rigid and flexible-tip laparoscopes , 2004, Surgical Endoscopy And Other Interventional Techniques.

[5]  Zheng Li,et al.  Autonomous Flexible Endoscope for Minimally Invasive Surgery With Enhanced Safety , 2019, IEEE Robotics and Automation Letters.

[6]  Guang-Zhong Yang,et al.  An articulated universal joint based flexible access robot for minimally invasive surgery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Zheng Li,et al.  Kinematic comparison of surgical tendon-driven manipulators and concentric tube manipulators , 2017 .

[8]  M. de Mathelin,et al.  Simultaneous physiological motion cancellation and depth adaptation in flexible endoscopy using visual servoing , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[9]  Russell H. Taylor,et al.  A dexterous system for laryngeal surgery , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[10]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Peter Kazanzides,et al.  ARssist: augmented reality on a head-mounted display for the first assistant in robotic surgery , 2018, Healthcare technology letters.

[12]  Zheng Li,et al.  Design of a Novel Flexible Endoscope-Cardioscope , 2015 .

[13]  Stefano Stramigioli,et al.  Image-based flexible endoscope steering , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Farid García,et al.  Segmentation of images by color features: A survey , 2018, Neurocomputing.

[15]  Pietro Valdastri,et al.  Image partitioning and illumination in image-based pose detection for teleoperated flexible endoscopes , 2013, Artif. Intell. Medicine.

[16]  Xiao Li,et al.  Pose Measurement Method and Experiments for High-Speed Rolling Targets in a Wind Tunnel , 2014, Sensors.

[17]  Makoto Hashizume,et al.  Remote-controlled laparoscope manipulator system, NaviotTM, for endoscopic surgery , 2003, CARS.

[18]  B. Yeung,et al.  A technical review of flexible endoscopic multitasking platforms. , 2012, International journal of surgery.

[19]  U. Schwarz,et al.  Cognitive eyes , 2004 .

[20]  Sungwan Kim,et al.  Development of stereo endoscope system with its innovative master interface for continuous surgical operation , 2017, Biomedical engineering online.

[21]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[22]  Peter Kazanzides,et al.  Image-Based Trajectory Tracking Control of 4-DoF Laparoscopic Instruments Using a Rotation Distinguishing Marker , 2017, IEEE Robotics and Automation Letters.

[23]  Pietro Valdastri,et al.  Jacobian-Based Iterative Method for Magnetic Localization in Robotic Capsule Endoscopy , 2016, IEEE Transactions on Robotics.

[24]  Zheng Li,et al.  A robotic flexible endoscope with shared autonomy: a study of mockup cholecystectomy , 2019, Surgical Endoscopy.

[25]  Philippe Cinquin,et al.  Visual servoing of a robotic endoscope holder based on surgical instrument tracking , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[26]  Peter Corke,et al.  Visual Control of Robots: High-Performance Visual Servoing , 1996 .

[27]  C. Nathan,et al.  The voice-controlled robotic assist scope holder AESOP for the endoscopic approach to the sella. , 2006, Skull Base.

[28]  Calvin Sze Hang Ng,et al.  Visual Servo Control of a Novel Magnetic Actuated Endoscope for Uniportal Video-Assisted Thoracic Surgery , 2019, IEEE Robotics and Automation Letters.

[29]  Robert J. Webster,et al.  Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review , 2010, Int. J. Robotics Res..