Unifying bilateral teleoperation and tele-impedance for enhanced user experience

Usability is one of the most important aspects of teleoperation. Ideally, the operator’s experience should be one of complete command over the remote environment, but also be as close as possible to what they would have if physically present at the remote end, i.e., transparency in terms of both action and perception. These two aspects may coincide in favorable conditions, where classic approaches such as the four-channel architecture ensures transparency of the control framework. In the presence of substantial delays between the user and the slave, however, the stability–performance trade-off inherent to bilateral teleoperation deteriorates not only transparency, but also command. An alternative, unilateral approach is given by tele-impedance, which controls the slave–environment interaction by measuring and remotely replicating the user’s limb endpoint position and impedance. Not including force feedback to the operator, tele-impedance is absolutely robust to delays, whereas it completely lacks transparency. This article introduces a novel control framework that integrates a new, fully transparent, two-channel bilateral architecture with the tele-impedance paradigm. The result is a unified solution that mitigates problems of classical approaches, and provides the user with additional tools to modulate the slave robot’s physical interaction behavior, resulting in a better operator experience in spite of time inconsistencies. The validity and effectiveness of the proposed solution is demonstrated in terms of performance in the interaction tasks, of user fatigue and overall experience.

[1]  K. Ohnishi,et al.  Reproducibility and operationality in bilateral teleoperation , 2004, The 8th IEEE International Workshop on Advanced Motion Control, 2004. AMC '04..

[2]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[3]  Jee-Hwan Ryu,et al.  Stable Bilateral Control of Teleoperators Under Time-varying Communication Delay: Time Domain Passivity Approach , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[5]  Justin Manzo,et al.  The DARPA Robotics Challenge [Competitions] , 2013, IEEE Robotics Autom. Mag..

[6]  Oussama Khatib,et al.  Ocean One: A Robotic Avatar for Oceanic Discovery , 2016, IEEE Robotics & Automation Magazine.

[7]  Kouhei Ohnishi,et al.  Frequency-Domain Damping Design for Time-Delayed Bilateral Teleoperation System Based on Modal Space Analysis , 2013, IEEE Transactions on Industrial Electronics.

[8]  Sven Behnke,et al.  NimbRo Rescue: Solving Disaster‐response Tasks with the Mobile Manipulation Robot Momaro , 2017, J. Field Robotics.

[9]  O. J. M. Smith,et al.  A controller to overcome dead time , 1959 .

[10]  Kouhei Ohnishi,et al.  Time-Delay Compensation by Communication Disturbance Observer for Bilateral Teleoperation Under Time-Varying Delay , 2010, IEEE Transactions on Industrial Electronics.

[11]  Jee-Hwan Ryu,et al.  Reducing the conservatism of the time domain passivity approach through consideration of energy reflection in delayed coupled network systems , 2019 .

[12]  Angel Rubio,et al.  Experimental quantitative comparison of different control architectures for master-slave teleoperation , 2004, IEEE Transactions on Control Systems Technology.

[13]  Jean-Jacques E. Slotine,et al.  Using wave variables for system analysis and robot control , 1997, Proceedings of International Conference on Robotics and Automation.

[14]  Oussama Khatib,et al.  Passivity-based stability in explicit force control of robots , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Marcia Kilchenman O'Malley,et al.  Compensating position drift in Time Domain Passivity Approach based teleoperation , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[16]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[17]  Ming Zhu,et al.  Transparent Bilateral Teleoperation under Position and Rate Control , 2000, Int. J. Robotics Res..

[18]  Andre Schiele,et al.  Time Domain Passivity Controller for 4-Channel Time-Delay Bilateral Teleoperation , 2015, IEEE Transactions on Haptics.

[19]  Erico Guizzo,et al.  The hard lessons of DARPA's robotics challenge [News] , 2015 .

[20]  Mikel Sagardia,et al.  The DLR bimanual haptic device with optimized workspace , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Mattia Poggiani,et al.  Humanoids at Work: The WALK-MAN Robot in a Postearthquake Scenario , 2018, IEEE Robotics & Automation Magazine.

[22]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[23]  Mohammad Farrokhi,et al.  A Simple Structure for Bilateral Transparent Teleoperation Systems With Time Delay , 2008 .

[24]  Sandra Hirche,et al.  Transparency of haptic telepresence systems with constant time delay , 2005 .

[25]  Nikolaos G. Tsagarakis,et al.  A Real-Time Identification and Tracking Method for the Musculoskeletal Model of Human Arm , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[27]  Keyvan Hashtrudi-Zaad,et al.  Design, implementation and evaluation of stable bilateral teleoperation control architectures for enhanced telepresence , 2000 .

[28]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[29]  Alin Albu-Schäffer,et al.  KONTUR-2: Force-feedback teleoperation from the international space station , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Eckehard G. Steinbach,et al.  Point Cloud-Based Model-Mediated Teleoperation With Dynamic and Perception-Based Model Updating , 2014, IEEE Transactions on Instrumentation and Measurement.

[31]  Septimiu E. Salcudean,et al.  Transparency in time-delayed systems and the effect of local force feedback for transparent teleoperation , 2002, IEEE Trans. Robotics Autom..

[32]  Probal Mitra,et al.  Model-mediated Telemanipulation , 2008, Int. J. Robotics Res..

[33]  Riccardo Muradore,et al.  An Energy Tank-Based Interactive Control Architecture for Autonomous and Teleoperated Robotic Surgery , 2015, IEEE Transactions on Robotics.

[34]  George C. Verghese,et al.  Design issues in 2-port network models of bilateral remote manipulation , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[35]  Nikolaos G. Tsagarakis,et al.  TeleImpedance: Exploring the role of common-mode and configuration-dependant stiffness , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[36]  Jee-Hwan Ryu,et al.  Time Domain Passivity Control for Position-Position Teleoperation Architectures , 2010, PRESENCE: Teleoperators and Virtual Environments.

[37]  D. Prattichizzo,et al.  Experimental evaluation of magnified haptic feedback for robot‐assisted needle insertion and palpation , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[38]  Jordi Artigas Esclusa,et al.  Time domain passivity control for delayed teleoperation , 2014 .

[39]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[40]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[41]  Hamad Karki,et al.  Application of robotics in onshore oil and gas industry - A review Part I , 2016, Robotics Auton. Syst..

[42]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[43]  Jee-Hwan Ryu,et al.  Multilateral control for delayed teleoperation , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[44]  Antonio Bicchi,et al.  Reduced-complexity representation of the human arm active endpoint stiffness for supervisory control of remote manipulation , 2018, Int. J. Robotics Res..

[45]  Manuel G. Catalano,et al.  Tele-impedance with force feedback under communication time delay , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[47]  Eckehard G. Steinbach,et al.  Model-Mediated Teleoperation: Toward Stable and Transparent Teleoperation Systems , 2016, IEEE Access.

[48]  A. Bicchi,et al.  WALK-MAN Humanoid Robot : Field Experiments in a Post-earthquake Scenario , 2017 .

[49]  Gérard Piolain,et al.  Force-feedback teleoperation of an industrial robot in a nuclear spent fuel reprocessing plant , 2006, Ind. Robot.

[50]  Tsuneo Yoshikawa,et al.  Ground-space bilateral teleoperation of ETS-VII robot arm by direct bilateral coupling under 7-s time delay condition , 2004, IEEE Transactions on Robotics and Automation.

[51]  Giorgio Grioli,et al.  The Quest for Natural Machine Motion: An Open Platform to Fast-Prototyping Articulated Soft Robots , 2017, IEEE Robotics & Automation Magazine.

[52]  Blake Hannaford,et al.  Time domain passivity control of haptic interfaces , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[53]  Claudio Pacchierotti,et al.  Enhancing the Performance of Passive Teleoperation Systems via Cutaneous Feedback , 2015, IEEE Transactions on Haptics.