Autonomous indoor object tracking with the Parrot AR.Drone

This article presents an image-based visual servoing system for indoor visual tracking of 3D moving objects by an Unmanned Aerial Vehicle. This system autonomously follows a 3D moving target object, maintaining it with a fixed distance and centered on its image plane. The initial setup is tested in a detailed simulation environment. The system is then validated on flights in indoor scenarios using the Parrot AR.Drone and the CMT tracker, demonstrating the robustness of the system to differences in object features, environmental clutter, and target trajectory. The obtained results indicate that the proposed system is suitable for complex controls task, such object surveillance and pursuit.

[1]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[2]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Ashutosh Saxena,et al.  Autonomous MAV flight in indoor environments using single image perspective cues , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[5]  Robert E. Mahony,et al.  A Practical Visual Servo Control for an Unmanned Aerial Vehicle , 2008, IEEE Transactions on Robotics.

[6]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[7]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[8]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[9]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[10]  Miguel A. Olivares-Méndez,et al.  Computer Vision Onboard UAVs for Civilian Tasks , 2009, J. Intell. Robotic Syst..

[11]  Roman P. Pflugfelder,et al.  Clustering of static-adaptive correspondences for deformable object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Pascual Campoy Cervera,et al.  Computer vision based general object following for GPS-denied multirotor unmanned vehicles , 2014, 2014 American Control Conference.

[13]  Miguel A. Olivares-Méndez,et al.  3D object following based on visual information for Unmanned Aerial Vehicles , 2011, IX Latin American Robotics Symposium and IEEE Colombian Conference on Automatic Control, 2011 IEEE.

[14]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[15]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).