ARDebug: An Augmented Reality Tool for Analysing and Debugging Swarm Robotic Systems

Despite growing interest in collective robotics over the past few years, analysing and debugging the behaviour of swarm robotic systems remains a challenge due to the lack of appropriate tools. We present a solution to this problem—ARDebug: an open-source, cross-platform, and modular tool that allows the user to visualise the internal state of a robot swarm using graphical augmented reality techniques. In this paper we describe the key features of the software, the hardware required to support it, its implementation, and usage examples. ARDebug is specifically designed with adoption by other institutions in mind, and aims to provide an extensible tool that other researchers can easily integrate with their own experimental infrastructure.

[1]  Francesco Mondada,et al.  The e-puck, a Robot Designed for Education in Engineering , 2009 .

[2]  Wenguo Liu,et al.  Open-hardware e-puck Linux extension board for experimental swarm robotics research , 2011, Microprocess. Microsystems.

[3]  Radhika Nagpal,et al.  Kilobot: A low cost scalable robot system for collective behaviors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Marco Dorigo,et al.  Kilogrid: A modular virtualization environment for the Kilobot robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Jonathan Timmis,et al.  The Psi Swarm: A Low-Cost Robotics Platform and Its Use in an Education Setting , 2016, TAROS.

[6]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[7]  Jon Timmis,et al.  A low-cost real-time tracking infrastructure for ground-based robot swarms , 2014 .

[8]  Eliseo Ferrante,et al.  Swarm robotics: a review from the swarm engineering perspective , 2013, Swarm Intelligence.

[9]  Stephen Travis Pope,et al.  A Description of the Model-View-Controller User Interface Paradigm in the Smalltalk-80 System , 1998 .

[10]  G.,et al.  Software Infrastructure for E-puck ( and TAM ) , 2016 .

[11]  Mark T. Bolas,et al.  Mixed reality for robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Luca Maria Gambardella,et al.  Interactive Augmented Reality for understanding and analyzing multi-robot systems , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  James A. R. Marshall,et al.  ARK: Augmented Reality for Kilobots , 2017, IEEE Robotics and Automation Letters.

[14]  Mauro Birattari,et al.  Augmented reality for robots: Virtual sensing technology applied to a swarm of e-pucks , 2015, 2015 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).

[15]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[16]  Bruce A. MacDonald,et al.  An Augmented Reality Debugging System for Mobile Robot Software Engineers , 2010 .

[17]  James McLurkin,et al.  Speaking Swarmish: Human-Robot Interface Design for Large Swarms of Autonomous Mobile Robots , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[18]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[19]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[20]  Wei Li,et al.  The Pi-puck extension board: A raspberry Pi interface for the e-puck robot platform , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Jodi Forlizzi,et al.  Designing interfaces for multi-user, multi-robot systems , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Nikolaus Correll,et al.  Miniature six-channel range and bearing system: Algorithm, analysis and experimental validation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).