Tele-impedance: Teleoperation with impedance regulation using a body–machine interface

This work presents the concept of tele-impedance as a method for remotely controlling a robotic arm in interaction with uncertain environments. As an alternative to bilateral force-reflecting teleoperation control, in tele-impedance a compound reference command is sent to the slave robot including both the desired motion trajectory and impedance profile, which are then realized by the remote controller without explicit feedback to the operator. We derive the reference command from a novel body–machine interface (BMI) applied to the master operator’s arm, using only non-intrusive position and electromyography (EMG) measurements, and excluding any feedback from the remote site except for looking at the task. The proposed BMI exploits a novel algorithm to decouple the estimates of force and stiffness of the human arm while performing the task. The endpoint (wrist) position of the human arm is monitored by an optical tracking system and used for the closed-loop position control of the robot’s end-effector. The concept is demonstrated in two experiments, namely a peg-in-the-hole and a ball-catching task, which illustrate complementary aspects of the method. The performance of tele-impedance control is assessed by comparing the results obtained with the slave arm under either constantly low or high stiffness.

[1]  Norbert M. Seel,et al.  Encyclopedia of the sciences of learning , 2012 .

[2]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[4]  Wied Ruijssenaars,et al.  Encyclopedia of the Sciences of Learning , 2012 .

[5]  G. Genta Vibration of structures and machines , 1993 .

[6]  Yoshiyuki Tanaka,et al.  Analysis of mechanical impedance in human arm movements using a virtual tennis system , 2004, Biological Cybernetics.

[7]  T. Milner,et al.  Wrist muscle activation patterns and stiffness associated with stable and unstable mechanical loads , 2004, Experimental Brain Research.

[8]  B. Nigg,et al.  Muscle activity reduces soft-tissue resonance at heel-strike during walking. , 2003, Journal of biomechanics.

[9]  T. Milner Contribution of geometry and joint stiffness to mechanical stability of the human arm , 2002, Experimental Brain Research.

[10]  R. C. Goertz,et al.  THE ANL MODEL 3 MASTER-SLAVE ELECTRIC MANIPULATOR--ITS DESIGN AND USE IN A CAVE , 1961 .

[11]  Aude Billard,et al.  Imitation Learning (of Robots) , 2011 .

[12]  Peter J. Beek,et al.  Can co-activation reduce kinematic variability? A simulation study , 2005, Biological Cybernetics.

[13]  Y. Koike,et al.  A myokinetic arm model for estimating joint torque and stiffness from EMG signals during maintained posture. , 2009, Journal of neurophysiology.

[14]  Tsuneo Yoshikawa,et al.  Ground-space bilateral teleoperation of ETS-VII robot arm by direct bilateral coupling under 7-s time delay condition , 2004, IEEE Transactions on Robotics and Automation.

[15]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[16]  Nikolaos G. Tsagarakis,et al.  A new variable stiffness actuator (CompAct-VSA): Design and modelling , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Mark L. Nagurka,et al.  Dynamic and loaded impedance components in the maintenance of human arm posture , 1993, IEEE Trans. Syst. Man Cybern..

[18]  H. Gomi,et al.  Task-Dependent Viscoelasticity of Human Multijoint Arm and Its Spatial Characteristics for Interaction with Environments , 1998, The Journal of Neuroscience.

[19]  H. McCallion,et al.  A compliant device for inserting a peg in a hole , 1979 .

[20]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[21]  H. Gomi,et al.  Multijoint muscle regulation mechanisms examined by measured human arm stiffness and EMG signals. , 1999, Journal of neurophysiology.

[22]  G. Schreiber,et al.  The Fast Research Interface for the KUKA Lightweight Robot , 2022 .

[23]  Antonio Bicchi,et al.  Design and Control of a Variable Stiffness Actuator for Safe and Fast Physical Human/Robot Interaction , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[24]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[25]  Sethu Vijayakumar,et al.  Constraint-based equilibrium and stiffness control of variable stiffness actuators , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Claudio Melchiorri,et al.  Force reflecting telemanipulators with time-delay: stability analysis and control design , 1998, IEEE Trans. Robotics Autom..

[27]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[28]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[29]  A. Palmer,et al.  Frequency spectrum analysis of wrist motion for activities of daily living , 1989, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[30]  Philippe Poignet,et al.  Towards a cooperative framework for interactive manipulation involving a human and a humanoid , 2011, 2011 IEEE International Conference on Robotics and Automation.

[31]  Antonio Bicchi,et al.  Fast and "soft-arm" tactics [robot arm design] , 2004, IEEE Robotics & Automation Magazine.

[32]  F. Mussa-Ivaldi,et al.  Brain–machine interfaces: computational demands and clinical needs meet basic neuroscience , 2003, Trends in Neurosciences.

[33]  Tauseef Gulrez,et al.  Controlling wheelchairs by body motions: A learning framework for the adaptive remapping of space , 2011, ArXiv.

[34]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[35]  David J. Ostry,et al.  Compensation for loads during arm movements using equilibrium-point control , 2000, Experimental Brain Research.

[36]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[37]  T. Milner,et al.  Inability to activate muscles maximally during cocontraction and the effect on joint stiffness , 2004, Experimental Brain Research.

[38]  Paul L Gribble,et al.  Role of cocontraction in arm movement accuracy. , 2003, Journal of neurophysiology.

[39]  Alin Albu-Schäffer,et al.  The DLR lightweight robot: design and control concepts for robots in human environments , 2007, Ind. Robot.

[40]  P. Crago,et al.  Multijoint dynamics and postural stability of the human arm , 2004, Experimental Brain Research.

[41]  Eric J Perreault,et al.  Voluntary control of static endpoint stiffness during force regulation tasks. , 2002, Journal of neurophysiology.

[42]  N. A. Borghese,et al.  Time-varying mechanical behavior of multijointed arm in man. , 1993, Journal of neurophysiology.

[43]  Toshio Tsuji,et al.  Human hand impedance characteristics during maintained posture , 1995, Biological Cybernetics.

[44]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[45]  Keng Peng Tee,et al.  A model of force and impedance in human arm movements , 2004, Biological Cybernetics.

[46]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[47]  Daniel E. Whitney,et al.  Mechanical Behavior and Design Equations for Elastomer Shear Pad Remote Center Compliances , 1986 .

[48]  Blake Hannaford,et al.  Experimental and simulation studies of hard contact in force reflecting teleoperation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[49]  Christian Laugier,et al.  The International Journal of Robotics Research (IJRR) - Special issue on ``Field and Service Robotics '' , 2009 .

[50]  Paul Weiss,et al.  SELF-DIFFERENTIATION OF THE BASIC PATTERNS OF COORDINATION , 1968 .

[51]  Bruce A. Francis,et al.  Bilateral controller for teleoperators with time delay via μ-synthesis , 1995, IEEE Trans. Robotics Autom..

[52]  R. Trumbower,et al.  Use of Self-Selected Postures to Regulate Multi-Joint Stiffness During Unconstrained Tasks , 2009, PloS one.

[53]  K. Akazawa,et al.  Modulation of reflex EMG and stiffness in response to stretch of human finger muscle. , 1983, Journal of neurophysiology.

[54]  Rieko Osu,et al.  Short- and long-term changes in joint co-contraction associated with motor learning as revealed from surface EMG. , 2002, Journal of neurophysiology.

[55]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.