Towards multi-modal intention interfaces for human-robot co-manipulation

This paper presents a novel approach for human-robot cooperation in tasks with dynamic uncertainties. The essential element of the proposed method is a multi-modal interface that provides the robot with the feedback about the human motor behaviour in real-time. The human muscle activity measurements and the arm force manipulability properties encode the information about the motion and impedance, and the intended configuration of the task frame, respectively. Through this human-in-the-loop framework, the developed hybrid controller of the robot can adapt its actions to provide the desired motion and impedance regulation in different phases of the cooperative task. We experimentally evaluate the proposed approach in a two-person sawing task that requires an appropriate complementary behaviour from the two agents.

[1]  Jun Morimoto,et al.  Adaptive Control of Exoskeleton Robots for Periodic Assistive Behaviours Based on EMG Feedback Minimisation , 2016, PloS one.

[2]  Takashi Minato,et al.  Physical Human-Robot Interaction: Mutual Learning and Adaptation , 2012, IEEE Robotics & Automation Magazine.

[3]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[4]  Jan Peters,et al.  Learning multiple collaborative tasks with a mixture of Interaction Primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Abderrahmane Kheddar,et al.  Motion learning and adaptive impedance for robot control during physical interaction with humans , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[7]  Don Joven Agravante,et al.  Collaborative human-humanoid carrying using vision and haptic sensing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Hikaru Inooka,et al.  Variable impedance control of a robot for cooperation with a human , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[9]  M. Turvey.  Action and perception at the level of synergies. , 2007, Human movement science.

[10]  Andrej Gams,et al.  Coupling Movement Primitives: Interaction With the Environment and Bimanual Tasks , 2014, IEEE Transactions on Robotics.

[11]  Clément Gosselin,et al.  General Model of Human-Robot Cooperation Using a Novel Velocity Based Variable Impedance Control , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[12]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[13]  Nikolaos G. Tsagarakis,et al.  A reduced-complexity description of arm endpoint stiffness with applications to teleimpedance control , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Panagiotis Artemiadis,et al.  A hybrid BMI-based exoskeleton for paresis: EMG control for assisting arm movements , 2017, Journal of neural engineering.

[15]  Yuan F. Zheng,et al.  Arm-manipulator coordination for load sharing using reflexive motion control , 1997, Proceedings of International Conference on Robotics and Automation.

[16]  Sandra Hirche,et al.  Feedback motion planning and learning from demonstration in physical robotic assistance: differences and synergies , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Neville Hogan,et al.  Impedance control - An approach to manipulation. I - Theory. II - Implementation. III - Applications , 1985 .

[18]  Kyle B. Reed,et al.  Physical Collaboration of Human-Human and Human-Robot Teams , 2008, IEEE Transactions on Haptics.

[19]  Kazuhiro Kosuge,et al.  Control of a robot handling an object in cooperation with a human , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[20]  Vincenzo Lippiello,et al.  Human-robot interaction control using force and vision , 2007 .

[21]  Sami Haddadin,et al.  Unified passivity-based Cartesian force/impedance control for rigid and flexible joint robots via task-energy tanks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Darwin G. Caldwell,et al.  Learning optimal controllers in human-robot cooperative transportation tasks with position and force constraints , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Luka Peternel,et al.  Learning of compliant human–robot interaction using full-body haptic interface , 2013, Adv. Robotics.

[24]  Xilun Ding,et al.  A Novel Method of Motion Planning for an Anthropomorphic Arm Based on Movement Primitives , 2013, IEEE/ASME Transactions on Mechatronics.

[25]  Sandra Hirche,et al.  Towards interactive physical robotic assistance: Parameterizing motion primitives through natural language , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[26]  Sandra Hirche,et al.  Human-robot cooperative object swinging , 2013, 2013 IEEE International Conference on Robotics and Automation.

[27]  Tadej Petric,et al.  Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Toru Tsumugiwa,et al.  Variable impedance control with virtual stiffness for human-robot cooperative peg-in-hole task , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Alin Albu-Schäffer,et al.  Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions , 2011, IEEE Transactions on Robotics.

[30]  Aude Billard,et al.  Task Parameterization Using Continuous Constraints Extracted From Human Demonstrations , 2015, IEEE Transactions on Robotics.

[31]  Sandra Hirche,et al.  Cooperative suspended object manipulation using reinforcement learning and energy-based control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[33]  Paul Evrard,et al.  Teaching physical collaborative tasks: object-lifting case study with a humanoid , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[34]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.