Omnipotent Virtual Giant for Remote Human–Swarm Interaction

This paper proposes an intuitive human-swarm interaction framework inspired by our childhood memory in which we interacted with living ants by changing their positions and environments as if we were omnipotent relative to the ants. In virtual reality, analogously, we can be a super-powered virtual giant who can supervise a swarm of mobile robots in a vast and remote environment by flying over or resizing the world and coordinate them by picking and placing a robot or creating virtual walls. This work implements this idea by using Virtual Reality along with Leap Motion, which is then validated by proof-of-concept experiments using real and virtual mobile robots in mixed reality. We conduct a usability analysis to quantify the effectiveness of the overall system as well as the individual interfaces proposed in this work. The results revealed that the proposed method is intuitive and feasible for interaction with swarm robots, but may require appropriate training for the new end-user interface device.

[1]  Carlo Pinciroli,et al.  Mixed-Granularity Human-Swarm Interaction , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[2]  Antonios Tsourdos,et al.  An integrated decision-making framework of a heterogeneous aerial robotic swarm for cooperative tasks with minimum requirements , 2019 .

[3]  Libor Preucil,et al.  A Practical Multirobot Localization System , 2014, J. Intell. Robotic Syst..

[4]  Huosheng Hu,et al.  Towards human-friendly efficient control of multi-robot teams , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[5]  Alexander Lanzon,et al.  An innovative tri-rotor drone and associated distributed aerial drone swarm control , 2018, Robotics Auton. Syst..

[6]  Luca Maria Gambardella,et al.  Wisdom of the swarm for cooperative decision-making in human-swarm interaction , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Heiko Hamann,et al.  Swarm Robotics - A Formal Approach , 2018 .

[8]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[9]  Luca Maria Gambardella,et al.  Human-swarm interaction using spatial gestures , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Vikram Kapila,et al.  Toward Mobile Mixed-Reality Interaction With Multi-Robot Systems , 2017, IEEE Robotics and Automation Letters.

[11]  Paul A. Beardsley,et al.  Gesture based human - Multi-robot swarm interaction and its application to an interactive display , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Antonios Tsourdos,et al.  Local information-based control for probabilistic swarm distribution guidance , 2017, Swarm Intelligence.

[13]  David Whitney,et al.  ROS Reality: A Virtual Reality Framework Using Consumer-Grade Hardware for ROS-Enabled Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Antonio Barrientos,et al.  Multi-robot Systems, Virtual Reality and ROS: Developing a New Generation of Operator Interfaces , 2019 .

[15]  Benjamin Bird,et al.  Radiological Monitoring of Nuclear Facilities Using the Continuous Autonomous Radiation Monitoring Assistance (CARMA) Robot , 2018 .

[16]  Barry Lennox,et al.  Intuitive Bare-Hand Teleoperation of a Robotic Manipulator Using Virtual Reality and Leap Motion , 2019, TAROS.

[17]  Ali Emre Turgut,et al.  COSΦ: Artificial pheromone system for robotic swarms research , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Marco Dorigo,et al.  Gesturing at Subswarms: Towards Direct Human Control of Robot Swarms , 2013, TAROS.

[19]  Benjamin Bird,et al.  Mona: an Affordable Open-Source Mobile Robot for Education and Research , 2018, Journal of Intelligent & Robotic Systems.

[20]  Pierre Dragicevic,et al.  Zooids: Building Blocks for Swarm User Interfaces , 2016, UIST.

[21]  Eliseo Ferrante,et al.  ARGoS: A modular, multi-engine simulator for heterogeneous swarm robotics , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Luca Maria Gambardella,et al.  Wearable multi-modal interface for human multi-robot interaction , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[23]  Marco Dorigo,et al.  Kilogrid: a novel experimental environment for the Kilobot robot , 2018, Swarm Intelligence.

[24]  Antonios Tsourdos,et al.  Anonymous Hedonic Game for Task Allocation in a Large-Scale Multiple Agent System , 2017, IEEE Transactions on Robotics.

[25]  Alcherio Martinoli,et al.  Modeling Swarm Robotic Systems: a Case Study in Collaborative Distributed Manipulation , 2004, Int. J. Robotics Res..