Multi-DoFs Exoskeleton-Based Bilateral Teleoperation with the Time-Domain Passivity Approach

It is well known that the sense of presence in a tele-robot system for both home-based telerehabilitation and rescue operations is enhanced by haptic feedback. Beyond several advantages, in the presence of communication delay haptic feedback can lead to an unstable teleoperation system. During the last decades, several control techniques have been proposed to ensure a good trade-off between transparency and stability in bilateral teleoperation systems under time delays. These proposed control approaches have been extensively tested with teleoperation systems based on identical master and slave robots having few degrees of freedom (DoF). However, a small number of DoFs cannot ensure both an effective restoration of the multi-joint coordination in tele-rehabilitation and an adequate dexterity during manipulation tasks in rescue scenario. Thus, a deep understanding of the applicability of such control techniques on a real bilateral teleoperation setup is needed. In this work, we investigated the behavior of the time-domain passivity approach (TDPA) applied on an asymmetrical teleoperator system composed by a 5-DoFs impedance designed upper-limb exoskeleton and a 4-DoFs admittance designed anthropomorphic robot. The conceived teleoperation architecture is based on a velocity–force (measured) architecture with position drift compensation and has been tested with a representative set of tasks under communication delay (80 ms round-trip). The results have shown that the TDPA is suitable for a multi-DoFs asymmetrical setup composed by two isomorphic haptic interfaces characterized by different mechanical features. The stability of the teleoperator has been proved during several (1) high-force contacts against stiff wall that involve more Cartesian axes simultaneously, (2) continuous contacts with a stiff edge tests, (3) heavy-load handling tests while following a predefined path and (4) high-force contacts against stiff wall while handling a load. The found results demonstrated that the TDPA could be used in several teleoperation scenarios like home-based tele-rehabilitation and rescue operations.

[1]  Shuuji Kajita,et al.  Task-level teleoperated manipulation for the HRP-2Kai humanoid robot , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[2]  Fazel Naghdy,et al.  Application of Adaptive Controllers in Teleoperation Systems: A Survey , 2014, IEEE Transactions on Human-Machine Systems.

[3]  Blake Hannaford,et al.  Sliding Control of Force Reflecting Teleoperation:Preliminary Studies , 1994, Presence: Teleoperators & Virtual Environments.

[4]  Ryan J. Murphy,et al.  Approaches to robotic teleoperation in a disaster scenario: From supervised autonomy to direct control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Vinay Chawda,et al.  Position Synchronization in Bilateral Teleoperation Under Time-Varying Communication Delays , 2015, IEEE/ASME Transactions on Mechatronics.

[6]  Antonio Frisoli,et al.  A Soft Tendon-Driven Robotic Glove: Preliminary Evaluation , 2018, Converging Clinical and Engineering Research on Neurorehabilitation III.

[7]  Gerd Hirzinger,et al.  Network representation and passivity of delayed teleoperation systems , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Blake Hannaford,et al.  Time-domain passivity control of haptic interfaces , 2001, IEEE Trans. Robotics Autom..

[9]  Jean-Jacques E. Slotine,et al.  Stable adaptive teleoperation , 1991 .

[10]  D.J. Reinkensmeyer,et al.  Web-based telerehabilitation for the upper extremity after stroke , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Antonio Frisoli,et al.  A Linear Approach to Optimize an EMG-Driven Neuromusculoskeletal Model for Movement Intention Detection in Myo-Control: A Case Study on Shoulder and Elbow Joints , 2018, Front. Neurorobot..

[12]  Jee-Hwan Ryu,et al.  Time Domain Passivity Control for Position-Position Teleoperation Architectures , 2010, PRESENCE: Teleoperators and Virtual Environments.

[13]  Antonio Frisoli,et al.  A Linear Optimization Procedure for an EMG-driven NeuroMusculoSkeletal Model Parameters Adjusting: Validation Through a Myoelectric Exoskeleton Control , 2016, EuroHaptics.

[14]  Antonio Frisoli,et al.  Comparison of a Soft Exosuit and a Rigid Exoskeleton in an Assistive Task , 2018, Biosystems & Biorobotics.

[15]  Antonio Frisoli,et al.  WRES: A Novel 3 DoF WRist ExoSkeleton With Tendon-Driven Differential Transmission for Neuro-Rehabilitation and Teleoperation , 2018, IEEE Robotics and Automation Letters.

[16]  Silvestro Micera,et al.  Evaluation of a New Exoskeleton for Upper Limb Post-stroke Neuro-rehabilitation: Preliminary Results , 2014 .

[17]  Blake Hannaford,et al.  Stable teleoperation with time-domain passivity control , 2004, IEEE Trans. Robotics Autom..

[18]  Mark W. Spong,et al.  Asymptotic Stability for Force Reflecting Teleoperators with Time Delay , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[19]  Alin Albu-Schäffer,et al.  KONTUR-2: Force-feedback teleoperation from the international space station , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Antonio Frisoli,et al.  A neuromusculoskeletal model of the human upper limb for a myoelectric exoskeleton control using a reduced number of muscles , 2015, 2015 IEEE World Haptics Conference (WHC).

[21]  Nikolaos G. Tsagarakis,et al.  A manipulation framework for compliant humanoid COMAN: Application to a valve turning task , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[22]  Hermano I Krebs,et al.  Telerehabilitation robotics: bright lights, big future? , 2006, Journal of rehabilitation research and development.

[23]  Antonio Frisoli,et al.  An interaction torque control improving human force estimation of the rehab-exos exoskeleton , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[24]  Antonio Frisoli,et al.  Design and embedded control of a soft elbow exosuit , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[25]  Marcia Kilchenman O'Malley,et al.  Compensating position drift in Time Domain Passivity Approach based teleoperation , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[26]  Antonio Frisoli,et al.  Real-Time 3D Tracker in Robot-Based Neurorehabilitation , 2018 .

[27]  Probal Mitra,et al.  Model-mediated Telemanipulation , 2008, Int. J. Robotics Res..

[28]  Jee-Hwan Ryu,et al.  Bilateral Control with Time Domain Passivity Approach Under Time-varying Communication Delay , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[29]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[30]  Thomas Hulin,et al.  Integrating Measured Force Feedback in Passive Multilateral Teleoperation , 2016, EuroHaptics.

[31]  Antonio Frisoli,et al.  Evaluation of a Pose-Shared Synergy-Based Isometric Model for Hand Force Estimation: Towards Myocontrol , 2017 .

[32]  Rodrigo Ventura,et al.  Immersive 3-D teleoperation of a search and rescue robot using a head-mounted display , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[33]  Jon Rigelsford,et al.  Modelling and Control of Robot Manipulators , 2000 .

[34]  S. Micera,et al.  Evaluation of the effects of the Arm Light Exoskeleton on movement execution and muscle activities: a pilot study on healthy subjects , 2016, Journal of NeuroEngineering and Rehabilitation.

[35]  Blake Hannaford,et al.  Some practical issues in time domain passivity control of haptic interfaces , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[36]  Antonio Frisoli,et al.  Development of a new exoskeleton for upper limb rehabilitation , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[37]  Mahdi Tavakoli,et al.  A Passivity-Based Approach for Stable Patient–Robot Interaction in Haptics-Enabled Rehabilitation Systems: Modulated Time-Domain Passivity Control , 2017, IEEE Transactions on Control Systems Technology.

[38]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[39]  Antonio Frisoli,et al.  Characterisation of Pressure Distribution at the Interface of a Soft Exosuit: Towards a More Comfortable Wear , 2018 .

[40]  Bruce A. Francis,et al.  Bilateral controller for teleoperators with time delay via μ-synthesis , 1995, IEEE Trans. Robotics Autom..

[41]  Sven Behnke,et al.  NimbRo Rescue: Solving Disaster‐response Tasks with the Mobile Manipulation Robot Momaro , 2017, J. Field Robotics.

[42]  Beibei Han,et al.  FPGA based time domain Passivity Observer and Passivity Controller , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[43]  Munsang Kim,et al.  A force reflected exoskeleton-type masterarm for human-robot interaction , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[44]  Liam Paull,et al.  Neural network-based multiple robot Simultaneous Localization and Mapping , 2011, IROS.