Mixed-Granularity Human-Swarm Interaction

We present an augmented reality human-swarm interface that combines two modalities of interaction: environment-oriented and robot-oriented. The environment-oriented modality allows the user to modify the environment (either virtual or physical) to indicate a goal to attain for the robot swarm. The robot-oriented modality makes it possible to select individual robots to reassign them to other tasks to increase performance or remedy failures. Previous research has concluded that environment-oriented interaction might prove more difficult to grasp for untrained users. In this paper, we report a user study which indicates that, at least in collective transport, environment-oriented interaction is more effective than purely robot-oriented interaction, and that the two combined achieve remarkable efficacy.

[1]  Luca Maria Gambardella,et al.  Wearable multi-modal interface for human multi-robot interaction , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[2]  Luca Maria Gambardella,et al.  Human-swarm interaction using spatial gestures , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Magnus Egerstedt,et al.  Haptic interactions with multi-robot swarms using manipulability , 2015, HRI 2015.

[4]  Pierre Dragicevic,et al.  Zooids: Building Blocks for Swarm User Interfaces , 2016, UIST.

[5]  Eliseo Ferrante,et al.  ARGoS: a modular, parallel, multi-engine simulator for multi-robot systems , 2012, Swarm Intelligence.

[6]  Daniela Rus,et al.  Controlling a team of robots with a single input , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[8]  Yancy Diaz-Mercado,et al.  Distributed dynamic density coverage for human-swarm interactions , 2015, 2015 American Control Conference (ACC).

[9]  Paul A. Beardsley,et al.  Gesture based human - Multi-robot swarm interaction and its application to an interactive display , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[11]  Katia Sycara,et al.  Human-swarm interaction , 2013, HRI 2013.

[12]  Eliseo Ferrante,et al.  Swarm robotics: a review from the swarm engineering perspective , 2013, Swarm Intelligence.

[13]  Katia P. Sycara,et al.  Human Interaction With Robot Swarms: A Survey , 2016, IEEE Transactions on Human-Machine Systems.

[14]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[15]  Roderich Groß,et al.  Human-Robot Swarm Interaction with Limited Situational Awareness , 2016, ANTS Conference.

[16]  Marco Dorigo,et al.  Gesturing at Subswarms: Towards Direct Human Control of Robot Swarms , 2013, TAROS.

[17]  Wafa Johal,et al.  Cellulo: Versatile Handheld Robots for Education , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[18]  Rafael Fernández Rubio Mining: The Challenge Knocks on our Door , 2012 .