Safe Human Robot Cooperation in Task Performed on the Shared Load

Human-robot collaboration in industrial settings calls for implementing safety measures to ensure there is no risk to humans working in such an environment. In human-robot physical collaboration, an object or a load is handled by both human and the robot. Developing a safety framework for the robot is a requirement for preventing collisions during performing a task. In this paper, force myography (FMG) data are used to develop a control scheme for the robot such that it can work with the human worker while avoiding collisions. Force myography quantifies the activities of human muscles when applying forces to handle an object. A neural network-based approach is then used to select the most informative features of the FMG signal. The developed control scheme incorporates the FMG data and the robot dynamics to obtain a prediction about the next step of the cooperation task and to plan the robot motion accordingly. The proposed approach is evaluated experimentally in real time in a moving objects task which requires appropriate complementary actions from the robot and the human user. The results of this study show that the proposed scheme can successfully plan the robot motion based on the actions of the human user.

[1]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[2]  Martin Buss,et al.  An HMM approach to realistic haptic human-robot interaction , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[3]  Sandra Hirche,et al.  Load sharing in human-robot cooperative manipulation , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[4]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[5]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[6]  Mirko Rakovic,et al.  Anticipation in Human-Robot Cooperation: A Recurrent Neural Network Approach for Multiple Action Sequences Prediction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Brian Scassellati,et al.  Transparent role assignment and task allocation in human robot collaboration , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Katsushi Ikeuchi,et al.  Flexible cooperation between human and robot by interpreting human intention from gaze information , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Carlo Menon,et al.  Continuous Prediction of Finger Movements Using Force Myography , 2016 .

[10]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[11]  Sandra Hirche,et al.  Considering Human Behavior Uncertainty and Disagreements in Human–Robot Cooperative Manipulation , 2017 .

[12]  Carlo Menon,et al.  Control an exoskeleton for forearm rotation using FMG , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[13]  C. J. van Rijsbergen,et al.  Probabilistic models of information retrieval based on measuring the divergence from randomness , 2002, TOIS.

[14]  Frank L. Lewis,et al.  Optimized Assistive Human–Robot Interaction Using Reinforcement Learning , 2016, IEEE Transactions on Cybernetics.

[15]  Hema Swetha Koppula,et al.  Car that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Sandra Hirche,et al.  Impedance-based Gaussian Processes for predicting human behavior during physical interaction , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Silvio Savarese,et al.  Structural-RNN: Deep Learning on Spatio-Temporal Graphs , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Bernd Finkemeyer.  Towards safe human-robot collaboration , 2017, 2017 22nd International Conference on Methods and Models in Automation and Robotics (MMAR).

[19]  Nikolaos G. Tsagarakis,et al.  Online Model Based Estimation of Complete Joint Stiffness of Human Arm , 2018, IEEE Robotics and Automation Letters.

[20]  Andrea Maria Zanchettin,et al.  Safety Assessment and Control of Robotic Manipulators Using Danger Field , 2013, IEEE Transactions on Robotics.

[21]  Jitendra Malik,et al.  Recurrent Network Models for Human Dynamics , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).