A Collaborative Framework for 3D Mapping Using Unmanned Aerial Vehicles

This paper describes an overview of a generic framework for collaboration among humans and multiple heterogeneous robotic systems based on the use of a formal characterization of delegation as a speech act. The system used contains a complex set of integrated software modules that include delegation managers for each platform, a task specification language for characterizing distributed tasks, a task planner, a multi-agent scan trajectory generation and region partitioning module, and a system infrastructure used to distributively instantiate any number of robotic systems and user interfaces in a collaborative team. The application focusses on 3D reconstruction in alpine environments intended to be used by alpine rescue teams. Two complex UAV systems used in the experiments are described. A fully autonomous collaborative mission executed in the Italian Alps using the framework is also described.

[1]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[2]  Roland Siegwart,et al.  The SHERPA project: Smart collaboration between humans and ground-aerial robots for improving rescuing activities in alpine environments , 2012, 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[3]  Rino Falcone,et al.  The human in the loop of a delegated agent: the theory of adjustable social autonomy , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[5]  Jonas Kvarnström,et al.  Planning for Loosely Coupled Agents Using Partial Order Forward-Chaining , 2010, ICAPS.

[6]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[7]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Nikos G. Tsagarakis,et al.  Proceedings of Robotics: Science and Systems IX , 2013 .

[9]  Csr Young,et al.  How to Do Things With Words , 2009 .

[10]  Rino Falcone,et al.  Towards a theory of delegation for agent-based systems , 1998, Robotics Auton. Syst..

[11]  Roland Siegwart,et al.  Collaborative 3D Reconstruction Using Heterogeneous UAVs: System and Experiments , 2016, ISER.

[12]  Hector J. Levesque,et al.  Intention is Choice with Commitment , 1990, Artif. Intell..

[13]  Patrick Doherty,et al.  High-Level Mission Specification and Planning for Collaborative Unmanned Aircraft Systems Using Delegation , 2013 .

[14]  Patrick Doherty,et al.  Temporal Composite Actions with Constraints , 2012, KR.

[15]  Vladimir J. Lumelsky,et al.  Polygon Area Decomposition for Multiple-Robot Workspace Division , 1998, Int. J. Comput. Geom. Appl..

[16]  Roland Siegwart,et al.  Point Clouds Registration with Probabilistic Data Association , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).