An image-processing based prototype of decreasing transmission time of visual information for a tele-operative surgical system

The Internet-based tele-operative surgical training system for Vascular Interventional Surgery (VIS) is a promising method to protect surgeons from long time exposure to radiation and to do the surgery cooperatively across the whole world and to allow unskilled surgeons to learn basic catheter or guidewire skills corresponding to inter-country distances. However, unpredictable and variable transmission time of visual feedback is always accompanied by the significant deterioration of the feasibility and manoeuvrability and could lead to damage to tissues in actual surgery. In this paper, an image-processing based prototype was proposed to effectively reduce the transmission time of visual feedback. At patient's site, the shape of catheter or guidewire was detected in real time and the position of catheter was presented by the three dimensional coordinates in World Coordinate System (WCS). Furthermore, at operative site, the shape of catheter was reconstructed as the visual feedback according to the coordinate values received from patient's site. Transmission time of visual feedback was therefore decreased due to significant reduction of data volume. In addition, coordinates values are more easily synchronized with the control signals and haptic data due to the size between visual and other data is similar. Finally, a remote transmission experiment of visual feedback was conducted to show that the proposed prototype made a better performance improvement for Internet-based transmission with delays during inter-country distances.

[1]  Shuxiang Guo,et al.  A robotic catheter system with real-time force feedback and monitor , 2012, Australasian Physical & Engineering Sciences in Medicine.

[2]  Shuxiang Guo,et al.  A method of decreasing transmission time of visual feedback for the Internet-based surgical training system , 2013, 2013 IEEE International Conference on Mechatronics and Automation.

[3]  Christian Smith,et al.  A predictor for operator input for time-delayed teleoperation , 2010 .

[4]  Shuxiang Guo,et al.  A method of decreasing time delay for a tele-surgery system , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[5]  Sun Lining,et al.  Internet based telesurgery with a bone-setting system , 2007, 2007 IEEE International Conference on Integration Technology.

[6]  Nan Xiao,et al.  A novel robotic catheter system with force and visual feedback for vascular interventional surgery , 2012, Int. J. Mechatronics Autom..

[7]  Mehran Anvari,et al.  Telesurgery: Remote Knowledge Translation in Clinical Surgery , 2007, World Journal of Surgery.

[8]  Shuxiang Guo,et al.  Development of a novel robotic catheter manipulating system , 2012, 2012 International Conference on Manipulation, Manufacturing and Measurement on the Nanoscale (3M-NANO).

[9]  Jacques Marescaux,et al.  Transatlantic robot-assisted telesurgery , 2001, Nature.

[10]  Abdulmotaleb El Saddik,et al.  Internet-based teleoperation systems with time varying communication delay , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[11]  Ki-Young Kim,et al.  A Teleoperated Minimally Invasive Surgical System with an Additional Degree of Freedom Manipulator , 2010, 2010 Fourth International Conference on Sensor Technologies and Applications.

[12]  Shuxiang Guo,et al.  Internet-based robotic catheter surgery system—System design and performance evaluation , 2012, 2012 IEEE International Conference on Automation and Logistics.

[13]  Liu Da,et al.  Remote‐controlled vascular interventional surgery robot , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[14]  Xiaojun Shen,et al.  Design and Implementation of Haptic Tele-mentoring over the Internet , 2007 .

[15]  Mamoru Mitsuishi,et al.  A remote surgery experiment between Japan and Thailand over Internet using a low latency CODEC system , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  A. Boukerche,et al.  Exploiting the Concept of Activity for Dynamic Reconfiguration of Distributed Simulation , 2007, 11th IEEE International Symposium on Distributed Simulation and Real-Time Applications (DS-RT'07).

[17]  Rajnikant V. Patel,et al.  Autonomous Image-Guided Robot-Assisted Active Catheter Insertion , 2008, IEEE Transactions on Robotics.

[18]  Shuxiang Guo,et al.  Virtual Reality Simulators Based on a Novel Robotic Catheter Operating System for Training in Minimally Invasive Surgery , 2012, J. Robotics Mechatronics.

[19]  Shuxiang Guo,et al.  The master-slave catheterisation system for positioning the steerable catheter , 2011, Int. J. Mechatronics Autom..

[20]  A. Iqbal,et al.  Evaluation of real-time delays for networked telerobotics , 2005, INDIN '05. 2005 3rd IEEE International Conference on Industrial Informatics, 2005..

[21]  Mamoru Mitsuishi,et al.  A remote surgery experiment between Japan-Korea using the minimally invasive surgical system , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[22]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  M. Mitsuishi Medical Robot and Master Slave System for Minimally Invasive Surgery , 2007, 2007 IEEE/ICME International Conference on Complex Medical Engineering.