Online Human Muscle Force Estimation for Fatigue Management in Human-Robot Co-Manipulation

In this paper, we propose a novel method for selective management of muscle fatigue in human-robot co-manipulation. The proposed framework enables the detection of excessive fatigue levels of an individual muscle group while executing a certain task, and provides anticipatory robotic responses to distribute the effort among less-fatigued muscles of human arm. Our approach uses a machine learning technique to enable online predictions of muscle forces in different arm configurations and endpoint interaction forces. The estimated muscle forces are then used for the model-based estimation of muscle fatigue levels. Through optimisation, the fatigue management system can alter the task execution in a way that specific fatigued muscles are offloaded, while at the same time enables the production of task force using muscles with lower levels of fatigue. The main advantage of the proposed method is that it can operate online, and that all the measurements are performed by the robot sensory system, which can significantly increase the applicability in real-world scenarios. To validate the proposed method, we performed proof-of-concept experiments where the task of the human operator was to use a tool to polish an object that was manipulated by the robot.

[1]  Nikolaos G. Tsagarakis,et al.  A Real-Time Identification and Tracking Method for the Musculoskeletal Model of Human Arm , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  Fouad Bennis,et al.  A new muscle fatigue and recovery model and its ergonomics application in human simulation , 2008, ArXiv.

[3]  M G Pandy,et al.  Static and dynamic optimization solutions for gait are practically equivalent. , 2001, Journal of biomechanics.

[4]  Tanja Schultz,et al.  Towards an EEG-based emotion recognizer for humanoid robots , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Kazuhiro Kosuge,et al.  Progress and prospects of the human–robot collaboration , 2017, Autonomous Robots.

[6]  Xilun Ding,et al.  A Novel Method of Motion Planning for an Anthropomorphic Arm Based on Movement Primitives , 2013, IEEE/ASME Transactions on Mechatronics.

[7]  Don Joven Agravante,et al.  Collaborative human-humanoid carrying using vision and haptic sensing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Antonio Bicchi,et al.  Reduced-complexity representation of the human arm active endpoint stiffness for supervisory control of remote manipulation , 2018, Int. J. Robotics Res..

[9]  Sandra Hirche,et al.  Towards interactive physical robotic assistance: Parameterizing motion primitives through natural language , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Kazuhiro Kosuge,et al.  Mechanical system control with man-machine-environment interactions , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[11]  N. Hogan Adaptive control of mechanical impedance by coactivation of antagonist muscles , 1984 .

[12]  Arash Ajoudani,et al.  A Human–Robot Co-Manipulation Approach Based on Human Sensorimotor Information , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  W. Herzog,et al.  Force enhancement following stretching of skeletal muscle: a new mechanism. , 2002, The Journal of experimental biology.

[14]  C. D. De Luca,et al.  Myoelectrical manifestations of localized muscular fatigue in humans. , 1984, Critical reviews in biomedical engineering.

[15]  Jan Peters,et al.  Local Gaussian process regression for real-time model-based robot control , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Tim W Dorn,et al.  Comparison of different methods for estimating muscle forces in human movement , 2012, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[17]  Scott L Delp,et al.  Generating dynamic simulations of movement using computed muscle control. , 2003, Journal of biomechanics.

[18]  Michael Damsgaard,et al.  Analysis of musculoskeletal systems in the AnyBody Modeling System , 2006, Simulation modelling practice and theory.

[19]  André Crosnier,et al.  Collaborative manufacturing with physical human–robot interaction , 2016 .

[20]  Nikolaos G. Tsagarakis,et al.  Robot adaptation to human physical fatigue in human–robot co-manipulation , 2018, Auton. Robots.

[21]  Walter Herzog,et al.  Model-based estimation of muscle forces exerted during movements. , 2007, Clinical biomechanics.

[22]  Nikolaos G. Tsagarakis,et al.  Anticipatory Robot Assistance for the Prevention of Human Static Joint Overloading in Human–Robot Collaboration , 2018, IEEE Robotics and Automation Letters.

[23]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[24]  Hamed Saeidi,et al.  Modeling and Control of Trust in Human and Robot Collaborative Manufacturing , 2014, AAAI Spring Symposia.

[25]  Martin Buss,et al.  Cooperative Swinging of Complex Pendulum-Like Objects: Experimental Evaluation , 2016, IEEE Transactions on Robotics.

[26]  Fouad Bennis,et al.  A new simple dynamic muscle fatigue model and its validation , 2022, ArXiv.

[27]  Matthew Millard,et al.  Flexing computational muscle: modeling and simulation of musculotendon dynamics. , 2013, Journal of biomechanical engineering.

[28]  Oliver Kroemer,et al.  Interaction primitives for human-robot cooperation tasks , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Nikolaos G. Tsagarakis,et al.  Online Joint Stiffness Transfer from Human Arm to Anthropomorphic Arm , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[30]  Arash Ajoudani,et al.  Towards ergonomie control of human-robot co-manipulation and handover , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[31]  Nikolaos G. Tsagarakis,et al.  Online Model Based Estimation of Complete Joint Stiffness of Human Arm , 2018, IEEE Robotics and Automation Letters.

[32]  Marcus G Pandy,et al.  A neuromusculoskeletal tracking method for estimating individual muscle forces in human movement. , 2007, Journal of biomechanics.

[33]  Anca Velisar,et al.  Benchmarking of dynamic simulation predictions in two software platforms using an upper limb musculoskeletal model , 2015, Computer methods in biomechanics and biomedical engineering.