Human-Guided Multirobot Cooperative Manipulation

The interaction of a human with a team of cooperative robots, which collaboratively manipulate an object, poses significant challenges for the control design. In this paper, we propose a formation-based approach to map the human input to the motion of the object cooperatively manipulated by multiple manipulators which feature a local compliance control at the end-effector level. The formation-based approach guarantees that the reference trajectories maintain a desired geometry with respect to each other. Without being in touch with the object, the human operator is part of the formation and guides the robots explicitly. Here, the human can be interpreted as a leader in a leader–follower formation with the robotic manipulators being the followers. We analyze the system consisting of a human operator and a multirobot manipulation task in both the transient phase and the steady state for which we derive the equilibrium of the object pose from the human input and show its stability. A controllability analysis suggests that it is beneficial to make the state of the human accessible to all manipulators in order to reduce internal stress on the object. The proposed approach is evaluated in a full-scale multirobot cooperative manipulation experiment with a human.

[1]  Sandra Hirche,et al.  Multi-robot manipulation controlled by a human with haptic feedback , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Senior Member,et al.  Model and analysis of the interaction dynamics in cooperative manipulation tasks , 2016 .

[3]  Darwin G. Caldwell,et al.  Learning bimanual end-effector poses from demonstrations using task-parameterized dynamical systems , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  María Isabel García Planas,et al.  Sufficient conditions for controllability and observability of serial and parallel concatenated linear systems , 2014 .

[5]  Oussama Khatib,et al.  The virtual linkage: a model for internal forces in multi-grasp manipulation , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[6]  Vijay Kumar,et al.  A potential field based approach to multi-robot manipulation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Domenico Prattichizzo,et al.  Human-Robot Formation Control via Visual and Vibrotactile Haptic Feedback , 2014, IEEE Transactions on Haptics.

[8]  Lawrence W. Stark,et al.  A comparison of position and rate control for telemanipulations with consideration of manipulator system dynamics , 1987, IEEE Journal on Robotics and Automation.

[9]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[10]  Domenico Prattichizzo,et al.  Discussion of paper by , 2003 .

[11]  Dongjun Lee,et al.  Bilateral Teleoperation of Multiple Cooperative Robots over Delayed Communication Networks: Theory , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[12]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[13]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[14]  Jihong Lee,et al.  Multi-robot cooperative localization with optimally fused information of odometer and GPS , 2007, 2007 International Conference on Control, Automation and Systems.

[15]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Vijay Kumar,et al.  Decentralized Algorithms for Multi-Robot Manipulation via Caging , 2004, Int. J. Robotics Res..

[17]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[18]  Magnus Egerstedt,et al.  Controllability Characterizations of Leader-Based Swarm Interactions , 2012, AAAI Fall Symposium: Human Control of Bioinspired Swarms.

[19]  Daniela Rus,et al.  Controlling a team of robots with a single input , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Marco Dorigo,et al.  Gesturing at Subswarms: Towards Direct Human Control of Robot Swarms , 2013, TAROS.

[21]  Sandra Hirche,et al.  Model and Analysis of the Interaction Dynamics in Cooperative Manipulation Tasks , 2016, IEEE Transactions on Robotics.

[22]  R. Kalaba,et al.  A new perspective on constrained motion , 1992, Proceedings of the Royal Society of London. Series A: Mathematical and Physical Sciences.

[23]  Oussama Khatib,et al.  The augmented object model: cooperative manipulation and parallel mechanism dynamics , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[24]  Magnus Egerstedt,et al.  Distributed Coordination Control of Multiagent Systems While Preserving Connectedness , 2007, IEEE Transactions on Robotics.

[25]  Alin Albu-Schäffer,et al.  Comparison of object-level grasp controllers for dynamic dexterous manipulation , 2012, Int. J. Robotics Res..

[26]  Antonio Franchi,et al.  A passivity-based decentralized approach for the bilateral teleoperation of a group of UAVs with switching topology , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  Hyo-Sung Ahn,et al.  A survey of multi-agent formation control , 2015, Autom..

[28]  Sandra Hirche,et al.  An impedance-based control architecture for multi-robot cooperative dual-arm mobile manipulation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Emmanuel Nuño,et al.  Leader-follower Pose Consensus for Heterogeneous Robot Networks with Variable Time-Delays , 2014 .

[30]  Sandra Hirche,et al.  Formation-based approach for multi-robot cooperative manipulation based on optimal control design , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Magnus Egerstedt,et al.  Haptic interactions with multi-robot swarms using manipulability , 2015, HRI 2015.

[32]  Emmanuel Nuño,et al.  Pose consensus in networks of heterogeneous robots with variable time delays , 2015 .