After a Decade of Teleimpedance: A Survey

Despite the significant progress made in making robots more intelligent and autonomous, today, teleoperation remains a dominant robot control paradigm for the execution of complex and highly unpredictable tasks. Attempts have been made to make teleoperation systems stable, easy to use, and efficient in terms of physical interactions between the follower remote robot and the environment. In particular, the emergence of torque-controlled robots has permitted to regulate the interaction forces from a distance through direct force or impedance control, enabling them to engage in complex interaction tasks. Exploiting this feature, the concept of teleimpedance control was introduced as an alternative method to bilateral force-reflecting teleoperation. The aim was to create a feed-froward yet contact-efficient teleoperation by enriching the leader commands with desired impedance profiles while executing a task. Since then, the teleimpedance concept has found its way into a wide range of interface and controller designs, as well as application domains. Accordingly, after a decade of research progress, this survey aims to provide: first, a convenient introduction of the concept to new researchers in the field, second, consolidate the existing state-of-the-art for active researchers, third, and discuss the pros and cons of different methods in terms of interface and force feedback to provide guidelines for different applications and future developments.

[1]  L. Peternel,et al.  Foot-operated Tele-impedance Interface for Robot Manipulation Tasks in Interaction with Unpredictable Environments , 2022, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  C. Torras,et al.  Perturbation-Based Stiffness Inference in Variable Impedance Control , 2022, IEEE Robotics and Automation Letters.

[3]  S. Haddadin,et al.  The Franka Emika Robot: A Reference Platform for Robotics Research and Education , 2022, IEEE Robotics & Automation Magazine.

[4]  Canjun Yang,et al.  A Review of Human–Machine Cooperation in the Robotics Domain , 2022, IEEE Transactions on Human-Machine Systems.

[5]  L. Peternel,et al.  Independently Commanding Size, Shape and Orientation of Robot Endpoint Stiffness in Tele-Impedance by Virtual Ellipsoid Interface , 2021, 2021 20th International Conference on Advanced Robotics (ICAR).

[6]  David A. Abbink,et al.  A Semi-Autonomous Tele-Impedance Method based on Vision and Voice Interfaces , 2021, 2021 20th International Conference on Advanced Robotics (ICAR).

[7]  David A. Abbink,et al.  Design and Evaluation of Haptic Interface Wiggling Method for Remote Commanding of Variable Stiffness Profiles , 2021, 2021 20th International Conference on Advanced Robotics (ICAR).

[8]  Enhao Zheng,et al.  An Electrical Impedance Tomography Based Interface for Human–Robot Collaboration , 2021, IEEE/ASME Transactions on Mechatronics.

[9]  B. Siciliano,et al.  Autonomy in Physical Human-Robot Interaction: A Brief Survey , 2021, IEEE Robotics and Automation Letters.

[10]  Roberto Meattini,et al.  Combining Unsupervised Muscle Co-Contraction Estimation With Bio-Feedback Allows Augmented Kinesthetic Teaching , 2021, IEEE Robotics and Automation Letters.

[11]  Benjamin Navarro,et al.  Human guided trajectory and impedance adaptation for tele-operated physical assistance , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Arash Ajoudani,et al.  A Scalable Framework for Multi-Robot Tele-Impedance Control , 2021, IEEE Transactions on Robotics.

[13]  Sylvain Calinon,et al.  Learning Optimal Impedance Control During Complex 3D Arm Movements , 2021, IEEE Robotics and Automation Letters.

[14]  Antonio Bicchi,et al.  Elastic Structure Preserving Control for Compliant Robots Driven by Agonistic-Antagonistic Actuators (ESPaa) , 2021, IEEE Robotics and Automation Letters.

[15]  Claudio Pacchierotti,et al.  Bilateral Teleoperation With Adaptive Impedance Control for Contact Tasks , 2021, IEEE Robotics and Automation Letters.

[16]  Roya Sabbagh Novin,et al.  Posture Estimation and Optimization in Ergonomically Intelligent Teleoperation Systems , 2021, HRI.

[17]  David A. Abbink,et al.  Analysis of Coupling Effect in Human-Commanded Stiffness During Bilateral Tele-Impedance , 2021, IEEE Transactions on Robotics.

[18]  Fares J. Abu-Dakka,et al.  Variable Impedance Control and Learning—A Review , 2020, Frontiers in Robotics and AI.

[19]  Shuxiang Guo,et al.  A Home-Based Bilateral Rehabilitation System With sEMG-based Real-Time Variable Stiffness , 2020, IEEE Journal of Biomedical and Health Informatics.

[20]  Qiang Wei,et al.  Synergy-Based Control of Assistive Lower-Limb Exoskeletons by Skill Transfer , 2020, IEEE/ASME Transactions on Mechatronics.

[21]  Manuel G. Catalano,et al.  Unifying bilateral teleoperation and tele-impedance for enhanced user experience , 2020, Int. J. Robotics Res..

[22]  Chenguang Yang,et al.  Neural Learning Enhanced Variable Admittance Control for Human–Robot Collaboration , 2020, IEEE Access.

[23]  Enhao Zheng,et al.  Toward a Human-Machine Interface Based on Electrical Impedance Tomography for Robotic Manipulator Control , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  E. Hocaoğlu,et al.  sEMG-Based Natural Control Interface for a Variable Stiffness Transradial Hand Prosthesis , 2019, Frontiers in Neurorobotics.

[25]  G. Weßel,et al.  Joining the blunt and the pointy end of the spear: towards a common framework of joint action, human–machine cooperation, cooperative guidance and control, shared, traded and supervisory control , 2019, Cognition, Technology & Work.

[26]  Manuel G. Catalano,et al.  On the role of wearable haptics for force feedback in teleimpedance control for dual-arm robotic teleoperation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[27]  Daniela Rus,et al.  Sharing the Load: Human-Robot Team Lifting Using Muscle Activity , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[28]  Cuntai Guan,et al.  A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration , 2019, Biomed. Signal Process. Control..

[29]  Tao Peng,et al.  Variable impedance interaction and demonstration interface design based on measurement of arm muscle co-activation for demonstration learning , 2019, Biomed. Signal Process. Control..

[30]  Wan Kyun Chung,et al.  Programming by Demonstration Using the Teleimpedance Control Scheme: Verification by an sEMG-Controlled Ball-Trapping Robot , 2019, IEEE Transactions on Industrial Informatics.

[31]  Saeid Nahavandi,et al.  Control Methods for Internet-Based Teleoperation Systems: A Review , 2019, IEEE Transactions on Human-Machine Systems.

[32]  Darwin G. Caldwell,et al.  Force-based variable impedance learning for robotic manipulation , 2018, Robotics Auton. Syst..

[33]  Sylvain Calinon,et al.  A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials , 2018, IEEE Transactions on Robotics.

[34]  Ayman Habib,et al.  OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement , 2018, PLoS Comput. Biol..

[35]  Nikolaos G. Tsagarakis,et al.  Robot adaptation to human physical fatigue in human–robot co-manipulation , 2018, Auton. Robots.

[36]  Cheng Fang,et al.  A DMPs-Based Framework for Robot Learning and Generalization of Humanlike Variable Impedance Skills , 2018, IEEE/ASME Transactions on Mechatronics.

[37]  Brian S. Peters,et al.  Review of emerging surgical robotic technology , 2018, Surgical Endoscopy.

[38]  Giancarlo Ferrigno,et al.  On the Value of Estimating Human Arm Stiffness during Virtual Teleoperation with Robotic Manipulators , 2017, Front. Neurosci..

[39]  Nikolaos G. Tsagarakis,et al.  Teleoperation in cluttered environments using wearable haptic feedback , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[40]  Max Mulder,et al.  Estimating driver time-varying neuromuscular admittance through LPV model and grip force , 2017 .

[41]  Arash Ajoudani,et al.  A Human–Robot Co-Manipulation Approach Based on Human Sensorimotor Information , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[43]  Wan Kyun Chung,et al.  Tele-impedance control of virtual system with visual feedback to verify adaptation of unstable dynamics during reach-to-point tasks , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[44]  Alin Albu-Schäffer,et al.  KONTUR-2: Force-feedback teleoperation from the international space station , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[46]  Tadej Petric,et al.  Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[47]  Darwin G. Caldwell,et al.  A task-parameterized probabilistic model with minimal intervention control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[48]  P. Artemiadis,et al.  The role of muscle synergies in myoelectric control: trends and challenges for simultaneous multifunction control , 2014, Journal of neural engineering.

[49]  Claudio Castellini,et al.  sEMG-based estimation of human stiffness: Towards impedance-controlled rehabilitation , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[50]  Aude Billard,et al.  Learning Compliant Manipulation through Kinesthetic and Tactile Human-Robot Interaction , 2014, IEEE Transactions on Haptics.

[51]  Allison M. Okamura,et al.  Task-dependent impedance and implications for upper-limb prosthesis control , 2014, Int. J. Robotics Res..

[52]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[53]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[54]  M. Kawato,et al.  Two is better than one: Physical interactions improve motor performance in humans , 2014, Scientific Reports.

[55]  Slobodan Jaric,et al.  Effects of muscle fatigue on grip and load force coordination and performance of manipulation tasks , 2013, Neuroscience Letters.

[56]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[57]  Sethu Vijayakumar,et al.  Transferring Human Impedance Behavior to Heterogeneous Variable Impedance Actuators , 2013, IEEE Transactions on Robotics.

[58]  Nikolaos G. Tsagarakis,et al.  Tele-Impedance based stiffness and motion augmentation for a knee exoskeleton device , 2013, 2013 IEEE International Conference on Robotics and Automation.

[59]  S. Schaal,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[60]  Volkan Patoglu,et al.  Tele-impedance control of a variable stiffness prosthetic hand , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[61]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Teleoperation with impedance regulation using a body–machine interface , 2012, Int. J. Robotics Res..

[62]  Robin R. Murphy,et al.  Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[63]  Sethu Vijayakumar,et al.  Model-free apprenticeship learning for transfer of human impedance behaviour , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[64]  Andrej Gams,et al.  On-line frequency adaptation and movement imitation for rhythmic robotic tasks , 2011, Int. J. Robotics Res..

[65]  Nikolaos G. Tsagarakis,et al.  Tele-Impedance: Preliminary results on measuring and replicating human arm impedance in tele operated robots , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[66]  Mark Mulder,et al.  Is grip strength related to neuromuscular admittance during steering wheel control? , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[67]  Alin Albu-Schäffer,et al.  Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions , 2011, IEEE Transactions on Robotics.

[68]  Frans C. T. van der Helm,et al.  Measuring Neuromuscular Control Dynamics During Car Following With Continuous Haptic Feedback , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[69]  John Kenneth Salisbury,et al.  Demonstrating the benefits of variable impedance to telerobotic task execution , 2011, 2011 IEEE International Conference on Robotics and Automation.

[70]  Alin Albu-Schäffer,et al.  The DLR hand arm system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[71]  Patrick van der Smagt,et al.  The Grasp Perturbator: Calibrating human grasp stiffness during a graded force task , 2011, 2011 IEEE International Conference on Robotics and Automation.

[72]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[73]  Sethu Vijayakumar,et al.  Transferring impedance control strategies between heterogeneous systems via apprenticeship learning , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[74]  S. Gandevia,et al.  Change in manipulation with muscle fatigue , 2010, The European journal of neuroscience.

[75]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[76]  Günter Niemeyer,et al.  User-controlled variable impedance teleoperation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[77]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[78]  Chris Jones,et al.  HazBot: Development of a telemanipulator robot with haptics for emergency response. , 2008, American journal of disaster medicine.

[79]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[80]  L. Ting,et al.  Muscle synergies characterizing human postural responses. , 2007, Journal of neurophysiology.

[81]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[82]  Rieko Osu,et al.  Endpoint Stiffness of the Arm Is Directionally Tuned to Instability in the Environment , 2007, The Journal of Neuroscience.

[83]  Frans C. T. van der Helm,et al.  The Low-Stiffness Teleoperator Slave — a Trade-off between Stability and Performance , 2007, Int. J. Robotics Res..

[84]  Alin Albu-Schäffer,et al.  A Unified Passivity-based Control Framework for Position, Torque and Impedance Control of Flexible Joint Robots , 2007, Int. J. Robotics Res..

[85]  Katherine J. Kuchenbecker,et al.  Induced Master Motion in Force-Reflecting Teleoperation , 2006 .

[86]  Michael Damsgaard,et al.  Analysis of musculoskeletal systems in the AnyBody Modeling System , 2006, Simulation modelling practice and theory.

[87]  Klaus Landzettel,et al.  Robotics Component Verification on ISS ROKVISS - Preliminary Results for Telepresence , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[88]  Antonio Bicchi,et al.  Design and Control of a Variable Stiffness Actuator for Safe and Fast Physical Human/Robot Interaction , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[89]  A. Okamura Methods for haptic feedback in teleoperated robot-assisted surgery , 2004, Ind. Robot.

[90]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[91]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[92]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[93]  Neville Hogan,et al.  SKELETAL MUSCLE IMPEDANCE IN THE CONTROL OF MOTOR ACTIONS , 2002 .

[94]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[95]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[96]  E Burdet,et al.  A method for measuring endpoint stiffness during multi-joint arm movements. , 2000, Journal of biomechanics.

[97]  R. W. Daniel,et al.  Fundamental Limits of Performance for Force Reflecting Teleoperation , 1998, Int. J. Robotics Res..

[98]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[99]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[100]  Dale A. Lawrence,et al.  Stability and transparency in bilateral teleoperation , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[101]  Blake Hannaford,et al.  Force-reflection and shared compliant control in operating telemanipulators with time delay , 1992, IEEE Trans. Robotics Autom..

[102]  Blake Hannaford,et al.  Performance evaluation of a six-axis generalized force-reflecting teleoperator , 1991, IEEE Trans. Syst. Man Cybern..

[103]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[104]  Dana R. Yoerger,et al.  Supervisory control architecture for underwater teleoperation , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[105]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[106]  N. Hogan Adaptive control of mechanical impedance by coactivation of antagonist muscles , 1984 .

[107]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[108]  T. Lozano-Perez,et al.  Robot programming , 1983, Proceedings of the IEEE.

[109]  J. Babič,et al.  Robotic assembly solution by human-in-the-loop teaching method based on real-time stiffness modulation , 2018, Auton. Robots.

[110]  Ruifeng Li,et al.  Interface Design of a Physical Human–Robot Interaction System for Human Impedance Adaptive Skill Transfer , 2018, IEEE Transactions on Automation Science and Engineering.

[111]  Antonio Bicchi,et al.  Reduced-complexity representation of the human arm active endpoint stiffness for supervisory control of remote manipulation , 2018, Int. J. Robotics Res..

[112]  Nikolaos G. Tsagarakis,et al.  Online Model Based Estimation of Complete Joint Stiffness of Human Arm , 2018, IEEE Robotics and Automation Letters.

[113]  Antonio Bicchi,et al.  Development of a robotic teaching interface for human to human skill transfer , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[114]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[115]  L. C. Visser,et al.  Accepted Manuscript , 2007 .

[116]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..