Stability and Transparency of Delayed Bilateral Teleoperation with Haptic Feedback

Abstract Haptic guidance can improve control accuracy in bilateral teleoperation. With haptic sensing, the human operator feels that he grabs the robot on the remote side. There are results on the stability and transparency analysis of teleoperation without haptic guidance, and the analysis of teleoperation with haptic feedback is only for linear and zero time-delay systems. In this paper, we consider more general cases: the bilateral teleoperation systems have time-varying communication delays, the whole systems are nonlinear, and they have force feedback. By using the admittance human operator model, we propose a new control scheme with the interaction passivity of the teleoperator. The stability and transparency of the master-slave system are proven with the Lyapunov–Krasovskii method. Numerical simulations illustrate the efficiency of the proposed control methods.

[1]  Rogelio Lozano,et al.  Synchronization of bilateral teleoperators with time delay , 2008, Autom..

[2]  Wayne J. Book,et al.  Control Techniques and Programming Issues for Time Delayed Internet Based Teleoperation , 2003 .

[3]  Zheng Chen,et al.  A Novel Wave-Variable Based Time-Delay Compensated Four-Channel Control Design for Multilateral Teleoperation System , 2018, IEEE Access.

[4]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[5]  Keyvan Hashtrudi-Zaad,et al.  Transparent Rate Mode Bilateral Teleoperation Control , 2008, Int. J. Robotics Res..

[6]  M.A. Jordan,et al.  On the Presence of Nonlinear Oscillations in the Teleoperation of Underwater Vehicles under the Influence of Sea Wave and Current , 2007, 2007 American Control Conference.

[7]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[8]  Ming Zhu,et al.  Achieving transparency for teleoperator systems under position and rate control , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[9]  S. Hirche,et al.  Bilateral teleoperation over the internet: the time varying delay problem , 2003, Proceedings of the 2003 American Control Conference, 2003..

[10]  Seiichiro Katsura,et al.  Bilateral control with local force feedback for delay-free teleoperation , 2012, 2012 12th IEEE International Workshop on Advanced Motion Control (AMC).

[11]  Romeo Ortega,et al.  An adaptive controller for nonlinear teleoperators , 2010, Autom..

[12]  Perry Y. Li,et al.  Passive bilateral control and tool dynamics rendering for nonlinear mechanical teleoperators , 2005, IEEE Transactions on Robotics.

[13]  John T. Wen,et al.  Stability analysis of position and force control for robot arms , 1991 .

[14]  Soheil Ganjefar,et al.  Position and force tracking in nonlinear teleoperation systems with sandwich linearity in actuators and time-varying delay , 2017 .

[15]  Wenfeng Zheng,et al.  A Four-channel Time Domain Passivity Approach for Bilateral Teleoperator , 2018, 2018 IEEE International Conference on Mechatronics and Automation (ICMA).

[16]  Bernhard Maschke,et al.  Dissipative Systems Analysis and Control , 2000 .

[17]  Tsuneo Yoshikawa,et al.  Bilateral teleoperation under time-varying communication delay , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[18]  Romeo Ortega,et al.  On tracking performance in bilateral teleoperation , 2006, IEEE Transactions on Robotics.

[19]  Jean-Jacques E. Slotine,et al.  Stable Adaptive Teleoperation , 1990, 1990 American Control Conference.

[20]  S. Munir,et al.  Internet based teleoperation using wave variables with prediction , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[21]  Masahiro Nohmi,et al.  Space teleoperation using force reflection of communication time delay , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[22]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[23]  B. Siciliano,et al.  Force/position regulation of compliant robot manipulators , 1994, IEEE Trans. Autom. Control..

[24]  Eckehard G. Steinbach,et al.  Model-Mediated Teleoperation: Toward Stable and Transparent Teleoperation Systems , 2016, IEEE Access.

[25]  Tsuneo Yoshikawa,et al.  Ground-space bilateral teleoperation of ETS-VII robot arm by direct bilateral coupling under 7-s time delay condition , 2004, IEEE Transactions on Robotics and Automation.

[26]  Jee-Hwan Ryu,et al.  Performance comparison of Wave Variable Transformation and Time Domain Passivity Approaches for time-delayed teleoperation: Preliminary results , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Corneliu Rablau,et al.  Providing haptic feedback in robot-assisted minimally invasive surgery: A direct optical force-sensing solution for haptic rendering of deformable bodies , 2013, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[28]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1994, IEEE Trans. Robotics Autom..

[29]  Dongjun Lee,et al.  Passive Bilateral Teleoperation With Constant Time Delay , 2006, IEEE Transactions on Robotics.

[30]  M Zareinejad,et al.  A stable perturbation estimator in force-reflecting passivity-based teleoperation , 2013 .

[31]  Andre Schiele,et al.  Time Domain Passivity Controller for 4-Channel Time-Delay Bilateral Teleoperation , 2015, IEEE Transactions on Haptics.

[32]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[33]  Neal A. Tanner,et al.  Improving Perception in Time Delayed Teleoperation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[34]  Jean-Jacques E. Slotine,et al.  Towards force-reflecting teleoperation over the Internet , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[35]  Jong Hyeon Park,et al.  Stable bilateral teleoperation under a time delay using a robust impedance control , 2005 .

[36]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[37]  Vincent Hayward,et al.  A Stable and Transparent Microscale Force Feedback Teleoperation System , 2015, IEEE/ASME Transactions on Mechatronics.

[38]  Blake Hannaford,et al.  Model-based passivity control for bilateral teleoperation of a surgical robot with time delay , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Emmanuel Nuno,et al.  Nonlinear Bilateral Teleoperation: Stability Analysis , 2009, 2009 IEEE International Conference on Robotics and Automation.

[40]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[41]  Ming Zhu,et al.  Transparent Bilateral Teleoperation under Position and Rate Control , 2000, Int. J. Robotics Res..

[42]  Mustafa Suphi Erden,et al.  Assisting manual welding with robot , 2011 .