Effective target aware visual navigation for UAVs

In this paper we propose an effective vision-based navigation method that allows a multirotor vehicle to simultaneously reach a desired goal pose in the environment while constantly facing a target object or landmark. Standard techniques such as Position-Based Visual Servoing (PBVS) and Image-Based Visual Servoing (IBVS) in some cases (e.g., while the multirotor is performing fast maneuvers) do not allow to constantly maintain the line of sight with a target of interest. Instead, we compute the optimal trajectory by solving a non-linear optimization problem that minimizes the target reprojection error while meeting the UAV's dynamic constraints. The desired trajectory is then tracked by means of a real-time Non-linear Model Predictive Controller (NMPC): this implicitly allows the multirotor to satisfy both the required constraints. We successfully evaluate the proposed approach in many real and simulated experiments, making an exhaustive comparison with a standard approach.

[1]  Rafik Mebarki,et al.  Autonomous landing of rotary-wing aerial vehicles by image-based visual servoing in GPS-denied environments , 2015, 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[2]  Roland Siegwart,et al.  A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM , 2014, ICRA 2014.

[3]  Daewon Lee,et al.  Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Moritz Diehl,et al.  ACADO toolkit—An open‐source framework for automatic control and dynamic optimization , 2011 .

[5]  Thomas Petersen A Comparison of 2D-3D Pose Estimation Methods , 2008 .

[6]  Roland Siegwart,et al.  A robust and modular multi-sensor fusion approach applied to MAV navigation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Tarek Hamel,et al.  Nonlinear control of VTOL UAVs incorporating flapping dynamics , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[10]  Pascual Campoy Cervera,et al.  Computer vision based general object following for GPS-denied multirotor unmanned vehicles , 2014, 2014 American Control Conference.

[11]  Anis Koubâa,et al.  Robot Operating System (ROS): The Complete Reference (Volume 1) , 2016 .

[12]  Roland Siegwart,et al.  Linear vs Nonlinear MPC for Trajectory Tracking Applied to Rotary Wing Micro Aerial Vehicles , 2016, ArXiv.

[13]  Roland Siegwart,et al.  Robust visual inertial odometry using a direct EKF-based approach , 2015, IROS 2015.

[14]  Anis Koubaa Robot Operating System (ROS): The Complete Reference (Volume 1) , 2016 .

[15]  Giuseppe Oriolo,et al.  Output feedback image-based visual servoing control of an underactuated unmanned aerial vehicle , 2014, J. Syst. Control. Eng..

[16]  Robert E. Mahony,et al.  Image-Based Visual Servo Control of the Translation Kinematics of a Quadrotor Aerial Vehicle , 2009, IEEE Transactions on Robotics.

[17]  Gaurav S. Sukhatme,et al.  Visual servoing of an autonomous helicopter in urban areas using feature tracking , 2006, J. Field Robotics.

[18]  François Chaumette,et al.  Dynamic visual servoing with image moments for a quadrotor using a virtual spring approach , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Vijay Kumar,et al.  Toward image based visual servoing for aerial grasping and perching , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[20]  T. Hamel,et al.  A practical Visual Servo Control for a Unmanned Aerial Vehicle , 2008, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[21]  Davide Scaramuzza,et al.  Aggressive quadrotor flight through narrow gaps with onboard sensing and computing using active vision , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[22]  A.H.A. Hafez,et al.  Hybrid Visual Servoing by Boosting IBVS and PBVS , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[23]  Marin Kobilarov,et al.  Optimal Visual Servoing for differentially flat underactuated systems , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Robert E. Mahony,et al.  Control of a quadrotor helicopter using visual feedback , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[25]  Roland Siegwart,et al.  Fast nonlinear Model Predictive Control for unified trajectory optimization and tracking , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[26]  R. Siegwart,et al.  Aerial service robots for visual inspection of thermal power plant boiler systems , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).

[27]  Peter I. Corke,et al.  Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor , 2012, IEEE Robotics & Automation Magazine.