Simultaneous aerial vehicle localization and Human tracking

In this paper, we propose a robotic video surveillance system. A prototype system is implemented on an aerial vehicle, a quadcopter. It is capable of following a person or any moving object, while simultaneously localizing it, i.e., measuring the coordinates of the quadcopter on a scaled map. The system can operate well, even if it is flying in an unknown and GPS-silent environment. The prototype system consists of 3 major modules. First is an ‘Image-based Visual Servoing (IBVS)’ module for tracking the desired object or person, and sending the error parameters to the actuators. The second module is ‘Parallel Tracking and Mapping (PTAM)’ module. The third module is an ‘Extended Kalman Filter (EKF)’ module. The PTAM and EKF modules help in estimating the location of the quadcopter at every time-instant. The proposed system enables the quadcopter to follow the desired object smoothly, while keeping the tracked object in the center of the frame and maintaining a constant distance from the object. The effectiveness of the system is validated by computing the precise measurements of the aerial movements, while ensuring the minimal error. The proposed method can be helpful for quadcopters used in diverse applications such as surveillance, monitoring and tracking a desired object.

[1]  Daniel Cremers,et al.  Scale-aware navigation of a low-cost quadrocopter with a monocular camera , 2014, Robotics Auton. Syst..

[2]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Roland Siegwart,et al.  Optimal surveillance coverage for teams of micro aerial vehicles in GPS-denied environments using onboard vision , 2012, Auton. Robots.

[4]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[5]  Raffaello D'Andrea,et al.  Cooperative quadrocopter ball throwing and catching , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Daniel Cremers,et al.  Accurate Figure Flying with a Quadrocopter Using Onboard Visual and Inertial Sensing , 2012 .

[7]  Pascual Campoy Cervera,et al.  Vision based GPS-denied Object Tracking and following for unmanned aerial vehicles , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[8]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Wolfram Burgard,et al.  Towards a navigation system for autonomous indoor flying , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Christian Kerl Odometry from RGB-D Cameras for Autonomous Quadrocopters , 2012 .

[11]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Jörg Stückler,et al.  Dense Continuous-Time Tracking and Mapping with Rolling Shutter RGB-D Cameras , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Nicholas Roy,et al.  Construction of Cubic Structures with Quadrotor Teams , 2012 .

[14]  Roland Siegwart,et al.  Visual-inertial SLAM for a small helicopter in large outdoor environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Daniel Cremers,et al.  Semi-dense Visual Odometry for a Monocular Camera , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Nicholas Roy,et al.  Towards A Swarm of Agile Micro Quadrotors , 2013 .

[17]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Daniel Cremers,et al.  Camera-based navigation of a low-cost quadrocopter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Daniel Cremers,et al.  Real-Time Camera Tracking and 3D Reconstruction Using Signed Distance Functions , 2013, Robotics: Science and Systems.

[20]  Daniel Cremers,et al.  Real-time visual odometry from dense RGB-D images , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).