Adaptation of robot physical behaviour to human fatigue in human-robot co-manipulation

In this paper, we propose a method that allows the robot to adapt its physical behaviour to the human fatigue in human-robot co-manipulation tasks. The robot initially imitates the human to perform the collaborative task in a leader-follower setting, using a feedback about the human motor behaviour. Simultaneously, the robot obtains the skill in online manner. When a predetermined level of human fatigue is detected, the robot uses the learnt skill to take over the physically demanding aspect of the task and contributes to a significant reduction of the human effort. The human, on the other hand, controls and supervises the high-level interaction behaviour and performs the aspects that require the contribution of both agents in such a dynamic co-manipulation setup. The robot adaptation system is based on the Dynamical Movement Primitives, Locally Weighted Regression and Adaptive Frequency Oscillators. The estimation of the human motor fatigue is carried out using a proposed online model, which is based on the human muscle activity measured by the electromyography. We demonstrate the proposed method with experiments on a real-world co-manipulation task with environmental constraints and dynamic uncertainties.

[1]  Jan Peters,et al.  Learning multiple collaborative tasks with a mixture of Interaction Primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Abderrahmane Kheddar,et al.  Motion learning and adaptive impedance for robot control during physical interaction with humans , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Don Joven Agravante,et al.  Collaborative human-humanoid carrying using vision and haptic sensing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Fouad Bennis,et al.  A new simple dynamic muscle fatigue model and its validation , 2022, ArXiv.

[5]  Luka Peternel,et al.  Learning of compliant human–robot interaction using full-body haptic interface , 2013, Adv. Robotics.

[6]  Andrej Gams,et al.  On-line frequency adaptation and movement imitation for rhythmic robotic tasks , 2011, Int. J. Robotics Res..

[7]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[8]  Paul Evrard,et al.  Teaching physical collaborative tasks: object-lifting case study with a humanoid , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[9]  Jörn Malzahn,et al.  WALK‐MAN: A High‐Performance Humanoid Platform for Realistic Environments , 2017, J. Field Robotics.

[10]  Takashi Minato,et al.  Physical Human-Robot Interaction: Mutual Learning and Adaptation , 2012, IEEE Robotics & Automation Magazine.

[11]  Darwin G. Caldwell,et al.  Learning optimal controllers in human-robot cooperative transportation tasks with position and force constraints , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Kazuhiro Kosuge,et al.  Control of a robot handling an object in cooperation with a human , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[13]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Teleoperation with impedance regulation using a body–machine interface , 2012, Int. J. Robotics Res..

[14]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[15]  Jun Nakanishi,et al.  Learning rhythmic movements by demonstration using nonlinear oscillators , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[17]  Hamed Saeidi,et al.  Modeling and Control of Trust in Human and Robot Collaborative Manufacturing , 2014, AAAI Spring Symposia.

[18]  Kenji KANEKO,et al.  Humanoid robot HRP-3 , 2004, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Andrej Gams,et al.  On-line learning and modulation of periodic movements with nonlinear dynamical systems , 2009, Auton. Robots.

[20]  Jun Morimoto,et al.  Adaptive Control of Exoskeleton Robots for Periodic Assistive Behaviours Based on EMG Feedback Minimisation , 2016, PloS one.

[21]  Sandra Hirche,et al.  Towards interactive physical robotic assistance: Parameterizing motion primitives through natural language , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[22]  Alin Albu-Schäffer,et al.  The DLR lightweight robot: design and control concepts for robots in human environments , 2007, Ind. Robot.

[23]  Peternel Luka,et al.  Towards multi-modal intention interfaces for human-robot co-manipulation , 2016 .

[24]  Martin Buss,et al.  Cooperative Swinging of Complex Pendulum-Like Objects: Experimental Evaluation , 2016, IEEE Transactions on Robotics.

[25]  R. Enoka,et al.  Muscle fatigue: what, why and how it influences muscle function , 2008, The Journal of physiology.

[26]  C. D. De Luca,et al.  Myoelectrical manifestations of localized muscular fatigue in humans. , 1984, Critical reviews in biomedical engineering.