Team-level properties for haptic human-swarm interactions

This paper explores how haptic interfaces should be designed to enable effective human-swarm interactions. When a single operator is interacting with a team of mobile robots, there are certain properties of the team that may help the operator complete the task at hand if these properties were fed back via haptics. However, not all team-level properties may be particularly well-suited for haptic feedback. In this paper, characteristics that make a property of a multi-agent system appropriate for haptic feedback are defined. The focus here is on leader-follower networks, in which one robot, the so-called leader, is controlled via an operator with a haptic device, whereas the remaining robots, the so-called followers, are tasked with maintaining distances between one another. Multi-agent manipulability, a property which describes how effective the leader is at controlling the movement of the followers, is proposed as one such appropriate property for haptic feedback in a human-swarm interaction scenario. Manipulability feedback is implemented using a PHANTOM Omni haptic joystick and experiments in which a team of mobile robots is controlled via a human operator with access to this feedback show that this is viable in practice.

[1]  Katia Sycara,et al.  Using Haptic Feedback in Human Robotic Swarms Interaction , 2013 .

[2]  Antonio Franchi,et al.  Haptic teleoperation of multiple unmanned aerial vehicles over the internet , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Dusan M. Stipanovic,et al.  Bilateral Teleoperation of Multiple Mobile Agents: Coordinated Motion and Collision Avoidance , 2010, IEEE Transactions on Control Systems Technology.

[4]  J. A. Fax,et al.  Graph Laplacians and Stabilization of Vehicle Formations , 2002 .

[5]  Katia P. Sycara,et al.  Using Coverage for Measuring the Effect of Haptic Feedback in Human Robotic Swarm Interaction , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[6]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[7]  Magnus Egerstedt,et al.  Approximate manipulability of leader-follower networks , 2011, IEEE Conference on Decision and Control and European Control Conference.

[8]  James McLurkin,et al.  Speaking Swarmish: Human-Robot Interface Design for Large Swarms of Autonomous Mobile Robots , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[9]  Vijay Kumar,et al.  Modeling and control of formations of nonholonomic mobile robots , 2001, IEEE Trans. Robotics Autom..

[10]  Antonio Bicchi,et al.  On the mobility and manipulability of general multiple limb robots , 1995, IEEE Trans. Robotics Autom..

[11]  Magnus Egerstedt,et al.  Manipulability of leader-follower networks with the rigid-link approximation , 2014, Autom..

[12]  Antonio Bicchi,et al.  Manipulability of cooperating robots with unactuated joints and closed-chain mechanisms , 2000, IEEE Trans. Robotics Autom..

[13]  Michael A. Goodrich,et al.  Toward human interaction with bio-inspired robot teams , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[14]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[15]  Jie Lin,et al.  The multi-agent rendezvous problem , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[16]  Antonio Franchi,et al.  Bilateral teleoperation of a group of UAVs with communication delays and switching topology , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  Michael Lewis,et al.  Towards human control of robot swarms , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Francesco Bullo,et al.  Distributed Control of Robotic Networks , 2009 .

[19]  Michael A. Goodrich,et al.  Human influence of robotic swarms with bandwidth and localization issues , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[20]  Katia P. Sycara,et al.  Neglect benevolence in human control of swarms in the presence of latency , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[21]  P. R. Klarer.  Flocking small smart machines: An experiment in cooperative, multi-machine control , 1998 .

[22]  M. Ishihara,et al.  Evaluation of force delays on the operation of haptic sense , 2008, 2008 International Conference on Control, Automation and Systems.

[23]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[24]  Matthias Harders,et al.  Influence of visual and haptic delays on stiffness perception in augmented reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.