Active Perception Based Formation Control for Multiple Aerial Vehicles

We present a novel robotic front-end for autonomous aerial motion-capture (mocap) in outdoor environments. In previous work, we presented an approach for cooperative detection and tracking (CDT) of a subject using multiple micro-aerial vehicles (MAVs). However, it did not ensure optimal view-point configurations of the MAVs to minimize the uncertainty in the person's cooperatively tracked 3D position estimate. In this article, we introduce an active approach for CDT. In contrast to cooperatively tracking only the 3D positions of the person, the MAVs can actively compute optimal local motion plans, resulting in optimal view-point configurations, which minimize the uncertainty in the tracked estimate. We achieve this by decoupling the goal of active tracking into a quadratic objective and non-convex constraints corresponding to angular configurations of the MAVs w.r.t. the person. We derive this decoupling using Gaussian observation model assumptions within the CDT algorithm. We preserve convexity in optimization by embedding all the non-convex constraints, including those for dynamic obstacle avoidance, as external control inputs in the MPC dynamics. Multiple real robot experiments and comparisons involving 3 MAVs in several challenging scenarios are presented.

[1]  Oliver E. Drummond,et al.  Coordinate transformation bias in target tracking , 1999, Optics & Photonics.

[2]  Davide Scaramuzza,et al.  PAMPC: Perception-Aware Model Predictive Control for Quadrotors , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Angela P. Schoellig,et al.  Generation of collision-free trajectories for a quadrocopter fleet: A sequential convex programming approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Brian D. O. Anderson,et al.  Optimality analysis of sensor-target localization geometries , 2010, Autom..

[5]  Qionghai Dai,et al.  FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras , 2016, IEEE Transactions on Visualization and Computer Graphics.

[6]  Vesselin P. Jilkov,et al.  Survey of maneuvering target tracking: III. Measurement models , 2001 .

[7]  Peter Cheeseman,et al.  On the Representation and Estimation of Spatial Uncertainty , 1986 .

[8]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[9]  Fabio Morbidi,et al.  On active target tracking and cooperative localization for multiple aerial vehicles , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Simon J. D. Prince,et al.  Computer Vision: Models, Learning, and Inference , 2012 .

[11]  Heinrich H. Bülthoff,et al.  Deep Neural Network-Based Cooperative Visual Tracking Through Multiple Micro Aerial Vehicles , 2018, IEEE Robotics and Automation Letters.

[12]  LI X.RONG,et al.  Best linear unbiased filtering with nonlinear measurements for target tracking , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Stergios I. Roumeliotis,et al.  Multirobot Active Target Tracking With Combinations of Relative Observations , 2011, IEEE Transactions on Robotics.

[14]  Xin Yang,et al.  ACT: An Autonomous Drone Cinematography System for Action Scenes , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Alexander Domahidi,et al.  Real-time planning for automated multi-view drone cinematography , 2017, ACM Trans. Graph..

[16]  André Dias,et al.  Formation control driven by cooperative object tracking , 2015, Robotics Auton. Syst..

[17]  Vijay Kumar,et al.  Human Motion Capture Using a Drone , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Anis Koubaa Robot Operating System (ROS): The Complete Reference (Volume 1) , 2016 .

[19]  Michael J. Black,et al.  Decentralized MPC based Obstacle Avoidance for Multi-Robot Target Tracking Scenarios , 2018, 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[20]  Gaurav S. Sukhatme,et al.  Cooperative multi-robot control for target tracking with onboard sensing 1 , 2015, Int. J. Robotics Res..

[21]  Paul A. Beardsley,et al.  Collision avoidance for aerial vehicles in multi-agent scenarios , 2015, Auton. Robots.

[22]  Y. Bar-Shalom,et al.  Unbiased converted measurements for tracking , 1998 .

[23]  Javier Alonso-Mora,et al.  Flycon: real-time environment-independent multi-view human pose estimation with aerial vehicles , 2019, ACM Trans. Graph..

[24]  Gaurav S. Sukhatme,et al.  Occlusion-aware multi-robot 3D tracking , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).