A Scaled Bilateral Teleoperation System for Robotic-Assisted Surgery with Time Delay

The master-slave teleoperated robotic systems have advanced the surgeries in the past decades. Time delay is usually caused due to the data transmission between communication channel connecting the master and slave in bilateral teleoperation, which is crucial because even small time delay could destabilize the whole teleoperation system. Motivated to solve the instability caused by time delay in bilateral teleoperation, wave variable transformation (WVT) structure has been proposed to passivate the delayed communication channel. However, conventional WVT structure provides poor velocity, position and force tracking performances which are not sufficient for surgical applications. In this paper, a new wave variable compensation (WVC) structure is proposed to improve the tracking performances with less conservative condition and comprehensive analysis to keep stable and improved tracking performance is also provided. In order to better facilitate certain surgical procedures with special requirements, e.g. robotic-assisted neurosurgery, velocity/position and force scalings are designed in the proposed structure with guaranteed system passivity, and transparency of the scaled WVC structure is also analyzed. Simulation and experimental studies were carried out to verify the performance of the proposed structure with time delay. System performance comparisons with several existing wave based bilateral teleoperation structures are also provided through simulation studies to show the improvements brought by the proposed teleoperation structure.

[1]  Wail Gueaieb,et al.  Trends in the Control Schemes for Bilateral Teleoperation with Time Delay , 2011, AIS.

[2]  Mohammad Ali Badamchizadeh,et al.  Discrete-time control of bilateral teleoperation systems: a review , 2018, Robotica.

[3]  Sandra Hirche,et al.  Perception-Based Data Reduction and Transmission of Haptic Data in Telepresence and Teleaction Systems , 2008, IEEE Transactions on Signal Processing.

[4]  Yuanqing Xia,et al.  Neural Network-Based Control of Networked Trilateral Teleoperation With Geometrically Unknown Constraints , 2016, IEEE Transactions on Cybernetics.

[5]  Kenji Kawashima,et al.  Achieving Stable Tracking in Wave-Variable-Based Teleoperation , 2014, IEEE/ASME Transactions on Mechatronics.

[6]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[7]  Blake Hannaford,et al.  Bilateral teleoperation with time delay using modified wave variable based controller , 2009, 2009 IEEE International Conference on Robotics and Automation.

[8]  Chao Liu,et al.  Stable and enhanced position-force tracking for bilateral teleoperation with time delay , 2015, 2015 European Control Conference (ECC).

[9]  Allison M. Okamura,et al.  Analysis of effective impedance transmitted to the operator in position-exchange bilateral teleoperation , 2017, 2017 IEEE World Haptics Conference (WHC).

[10]  Günther Schmidt,et al.  Transparency and Stability of Bilateral Kinesthetic Teleoperation with Time-Delayed Communication , 2004, J. Intell. Robotic Syst..

[11]  Chao Liu,et al.  Viscoelastic model based force control for soft tissue interaction and its application in physiological motion compensation , 2014, Comput. Methods Programs Biomed..

[12]  Sotirios Kontogiannis,et al.  A Survey of Transport Protocols for Haptic Applications , 2012, 2012 16th Panhellenic Conference on Informatics.

[13]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[14]  Lucian Panait,et al.  The role of haptic feedback in laparoscopic simulation training. , 2009, The Journal of surgical research.

[15]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[16]  M. Mitsuishi Medical Robot and Master Slave System for Minimally Invasive Surgery , 2007, 2007 IEEE/ICME International Conference on Complex Medical Engineering.

[17]  Paolo Fiorini,et al.  Medical Robotics and Computer-Integrated Surgery , 2008, 2008 32nd Annual IEEE International Computer Software and Applications Conference.

[18]  Romeo Ortega,et al.  Passivity-based control for bilateral teleoperation: A tutorial , 2011, Autom..

[19]  Riccardo Muradore,et al.  A Review of Bilateral Teleoperation Algorithms , 2016 .

[20]  Guang-Zhong Yang,et al.  From Passive Tool Holders to Microsurgeons: Safer, Smaller, Smarter Surgical Robots , 2014, IEEE Transactions on Biomedical Engineering.

[21]  Zheng Li,et al.  Reducing Wave-Based Teleoperator Reflections for Unknown Environments , 2011, IEEE Transactions on Industrial Electronics.

[22]  S. Downing,et al.  Beating-heart mitral valve surgery: preliminary model and methodology. , 2002, The Journal of thoracic and cardiovascular surgery.

[23]  Xingjian Wang,et al.  Teleoperation Control Based on Combination of Wave Variable and Neural Networks , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Mahdi Tavakoli,et al.  Haptics for Teleoperated Surgical Robotic Systems , 2008, New Frontiers in Robotics.

[25]  Jagadeesan Jayender,et al.  Kalman filter-based EM-optical sensor fusion for needle deflection estimation , 2018, International Journal of Computer Assisted Radiology and Surgery.

[26]  Chao Liu,et al.  Scaled position-force tracking for wireless teleoperation of miniaturized surgical robotic system , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[28]  Günter Dieter Niemeyer,et al.  Using wave variables in time delayed force reflecting teleoperation , 1996 .

[29]  Maxime Adjigble,et al.  Towards advanced robotic manipulation for nuclear decommissioning: A pilot study on tele-operation and autonomy , 2016, 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA).

[30]  Jean-Jacques E. Slotine,et al.  Stable Adaptive Teleoperation , 1990, 1990 American Control Conference.

[31]  Frans C. T. van der Helm,et al.  The Low-Stiffness Teleoperator Slave — a Trade-off between Stability and Performance , 2007, Int. J. Robotics Res..

[32]  Rajni Patel,et al.  Pre‐clinical remote telesurgery trial of a da Vinci telesurgery prototype , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[33]  Robin R. Murphy,et al.  Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[34]  F. Mohr,et al.  Computer-enhanced "robotic" cardiac surgery: experience in 148 patients. , 2001, The Journal of thoracic and cardiovascular surgery.

[35]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[36]  Peter Xiaoping Liu,et al.  Improving Haptic Feedback Fidelity in Wave-Variable-Based Teleoperation Orientated to Telemedical Applications , 2009, IEEE Transactions on Instrumentation and Measurement.

[37]  Claudio Pacchierotti,et al.  Sensory Subtraction in Robot-Assisted Surgery: Fingertip Skin Deformation Feedback to Ensure Safety and Improve Transparency in Bimanual Haptic Interaction , 2014, IEEE Transactions on Biomedical Engineering.

[38]  Mahdi Tavakoli,et al.  Bilateral control of a teleoperator for soft tissue palpation: design and experiments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[39]  Robert J. Webster,et al.  A Telerobotic System for Transnasal Surgery , 2014, IEEE/ASME Transactions on Mechatronics.

[40]  Zexiang Li,et al.  Analysis of absolute stability for time-delay teleoperation systems , 2007, Int. J. Autom. Comput..

[41]  L. Alonso Sanchez,et al.  The impact of interaction model on stability and transparency in bilateral teleoperation for medical applications , 2012, 2012 IEEE International Conference on Robotics and Automation.

[42]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[43]  Purang Abolmaesumi,et al.  A Framework for the Design of a Novel Haptic-Based Medical Training Simulator , 2008, IEEE Transactions on Information Technology in Biomedicine.

[44]  Guang-Zhong Yang,et al.  Emerging Robotic Platforms for Minimally Invasive Surgery , 2013, IEEE Reviews in Biomedical Engineering.

[45]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[46]  Paolo Dario,et al.  Array of Robots Augmenting the Kinematics of Endocavitary Surgery , 2014, IEEE/ASME Transactions on Mechatronics.

[47]  Yuanqing Xia,et al.  Adaptive Fuzzy Control for Multilateral Cooperative Teleoperation of Multiple Robotic Manipulators Under Random Network-Induced Delays , 2014, IEEE Transactions on Fuzzy Systems.

[48]  Ioan A. Lina,et al.  Techniques and accuracy of thoracolumbar pedicle screw placement. , 2014, World journal of orthopedics.

[49]  Ron Alterovitz,et al.  Needle steering in biological tissue using ultrasound-based online curvature estimation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[50]  Yongqiang Ye,et al.  Improving Trajectory Tracking in Wave-Variable-Based Teleoperation , 2010, IEEE/ASME Transactions on Mechatronics.

[51]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[52]  Martin Buss,et al.  Passive Haptic Data-Compression Methods With Perceptual Coding for Bilateral Presence Systems , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[53]  E. Antonio Chiocca,et al.  Neurosurgical robotics: a review of brain and spine applications , 2007, Journal of robotic surgery.

[54]  S. Munir,et al.  Wave-based teleoperation with prediction , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[55]  Wayne J. Book,et al.  Internet-Based Bilateral Teleoperation Based on Wave Variable With Adaptive Predictor and Direct Drift Control , 2006 .