A Human–Robot Co-Manipulation Approach Based on Human Sensorimotor Information

This paper aims to improve the interaction and coordination between the human and the robot in cooperative execution of complex, powerful, and dynamic tasks. We propose a novel approach that integrates online information about the human motor function and manipulability properties into the hybrid controller of the assistive robot. Through this human-in-the-loop framework, the robot can adapt to the human motor behavior and provide the appropriate assistive response in different phases of the cooperative task. We experimentally evaluate the proposed approach in two human–robot co-manipulation tasks that require specific complementary behavior from the two agents. Results suggest that the proposed technique, which relies on a minimum degree of task-level pre-programming, can achieve an enhanced physical human–robot interaction performance and deliver appropriate level of assistance to the human operator.

[1]  N. Hogan Adaptive control of mechanical impedance by coactivation of antagonist muscles , 1984 .

[2]  J. F. Yang,et al.  Electromyographic amplitude normalization methods: improving their sensitivity as diagnostic tools in gait analysis. , 1984, Archives of physical medicine and rehabilitation.

[3]  Neville Hogan,et al.  Impedance control - An approach to manipulation. I - Theory. II - Implementation. III - Applications , 1985 .

[4]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[5]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[7]  Hikaru Inooka,et al.  Variable impedance control of a robot for cooperation with a human , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[8]  Ian D. Walker,et al.  Myoelectric teleoperation of a complex robotic hand , 1996, IEEE Trans. Robotics Autom..

[9]  Kazuhiro Kosuge,et al.  Control of a robot handling an object in cooperation with a human , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[10]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[11]  Yuan F. Zheng,et al.  Arm-manipulator coordination for load sharing using reflexive motion control , 1997, Proceedings of International Conference on Robotics and Automation.

[12]  H. Hermens,et al.  European recommendations for surface electromyography: Results of the SENIAM Project , 1999 .

[13]  Jacob Rosen,et al.  A myosignal-based powered exoskeleton system , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[14]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[15]  Toru Tsumugiwa,et al.  Variable impedance control with virtual stiffness for human-robot cooperative peg-in-hole task , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[18]  Toshio Tsuji,et al.  Human hand impedance characteristics during maintained posture , 1995, Biological Cybernetics.

[19]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  J. Muscolino Kinesiology : The Skeletal System and Muscle Function , 2006 .

[21]  Clément Gosselin,et al.  General Model of Human-Robot Cooperation Using a Novel Velocity Based Variable Impedance Control , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[22]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[23]  A Unified Passivity-based Control Framework for Position, Torque and Impedance Control of Flexible Joint Robots , 2007 .

[24]  Kyle B. Reed,et al.  Physical Collaboration of Human-Human and Human-Robot Teams , 2008, IEEE Transactions on Haptics.

[25]  Günter Hommel,et al.  A Human--Exoskeleton Interface Utilizing Electromyography , 2008, IEEE Transactions on Robotics.

[26]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[27]  Paul Evrard,et al.  Teaching physical collaborative tasks: object-lifting case study with a humanoid , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[28]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Abderrahmane Kheddar,et al.  Motion learning and adaptive impedance for robot control during physical interaction with humans , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Alin Albu-Schäffer,et al.  Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions , 2011, IEEE Transactions on Robotics.

[31]  Antonio Bicchi,et al.  Optimality principles in variable stiffness control: The VSA hammer , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Sandra Hirche,et al.  Feedback motion planning and learning from demonstration in physical robotic assistance: differences and synergies , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Teleoperation with impedance regulation using a body–machine interface , 2012, Int. J. Robotics Res..

[34]  Takashi Minato,et al.  Physical Human-Robot Interaction: Mutual Learning and Adaptation , 2012, IEEE Robotics & Automation Magazine.

[35]  Sandra Hirche,et al.  Towards interactive physical robotic assistance: Parameterizing motion primitives through natural language , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[36]  Luka Peternel,et al.  Learning of compliant human–robot interaction using full-body haptic interface , 2013, Adv. Robotics.

[37]  Xilun Ding,et al.  A Novel Method of Motion Planning for an Anthropomorphic Arm Based on Movement Primitives , 2013, IEEE/ASME Transactions on Mechatronics.

[38]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[39]  Panagiotis Artemiadis,et al.  A hybrid BMI-based exoskeleton for paresis: EMG control for assisting arm movements , 2017, Journal of neural engineering.

[40]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[41]  M. Kawato,et al.  Two is better than one: Physical interactions improve motor performance in humans , 2014, Scientific Reports.

[42]  Andrej Gams,et al.  Coupling Movement Primitives: Interaction With the Environment and Bimanual Tasks , 2014, IEEE Transactions on Robotics.

[43]  Don Joven Agravante,et al.  Collaborative human-humanoid carrying using vision and haptic sensing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Sandra Hirche,et al.  Cooperative suspended object manipulation using reinforcement learning and energy-based control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Sami Haddadin,et al.  Unified passivity-based Cartesian force/impedance control for rigid and flexible joint robots via task-energy tanks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[47]  Nikolaos G. Tsagarakis,et al.  A reduced-complexity description of arm endpoint stiffness with applications to teleimpedance control , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[48]  Darwin G. Caldwell,et al.  Learning optimal controllers in human-robot cooperative transportation tasks with position and force constraints , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[49]  Tadej Petric,et al.  Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[50]  Aude Billard,et al.  Task Parameterization Using Continuous Constraints Extracted From Human Demonstrations , 2015, IEEE Transactions on Robotics.

[51]  Jun Morimoto,et al.  Adaptive Control of Exoskeleton Robots for Periodic Assistive Behaviours Based on EMG Feedback Minimisation , 2016, PloS one.

[52]  Nikolaos G. Tsagarakis,et al.  Towards multi-modal intention interfaces for human-robot co-manipulation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[53]  Martin Buss,et al.  Cooperative Swinging of Complex Pendulum-Like Objects: Experimental Evaluation , 2016, IEEE Transactions on Robotics.

[54]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[55]  Oliver Kroemer,et al.  Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks , 2017, Auton. Robots.