A Framework for Vision-Based Multiple Target Finding and Action Using Multirotor UAVs

This paper presents a framework for vision-based target finding and action using a multirotor UAV system. The proposed framework detects and tracks a set of ground targets by using a vision-based position estimation technique. An internal map created using the relative locations of the adjacent targets is used to overcome the vision-based position estimation error and GPS noise and drift. The framework was implemented using the Robotic Operating System (ROS) and tested in the Software in the Loop (SITL) Simulation with the Gazebo robotics simulator. The test results demonstrate that the framework is robust to drift and errors, and able to perform the intended tasks successfully.

[1]  Felipe Gonzalez,et al.  Open source computer-vision based guidance system for UAVs on-board decision making , 2016, 2016 IEEE Aerospace Conference.

[2]  Peter Corke,et al.  Towards the development of a gas sensor system for monitoring pollutant gases in the low troposphere using small unmanned aerial vehicles , 2012 .

[3]  Carlos Silvestre,et al.  UAV-based marine mammals positioning and tracking system , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[4]  Hyun-Chan Cho,et al.  Tracking a moving ground object using quadcopter UAV in a presence of noise , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[5]  Nabil Aouf,et al.  Visual servoing of a Quadrotor UAV for autonomous power lines inspection , 2014, 22nd Mediterranean Conference on Control and Automation.

[6]  Chang-Hun Lee,et al.  An image based visual servoing approach for multi-target tracking using an quad-tilt rotor UAV , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Andreas Zell,et al.  An Onboard Monocular Vision System for Autonomous Takeoff, Hovering and Landing of a Micro Aerial Vehicle , 2012, Journal of Intelligent & Robotic Systems.

[8]  Dmitry Bratanov,et al.  A Novel Methodology for Improving Plant Pest Surveillance in Vineyards and Crops Using UAV-Based Hyperspectral and Spatial Data , 2018, Sensors.

[9]  Luis Felipe Gonzalez,et al.  UAV based target finding and tracking in GPS-denied and cluttered environments , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Felipe Gonzalez,et al.  Autonomous UAV with vision based on-board decision making for remote sensing and precision agriculture , 2017, 2017 IEEE Aerospace Conference.

[11]  Jonathan M. Roberts,et al.  Vision-Based Target Finding and Inspection of a Ground Target Using a Multirotor UAV System , 2017, Sensors.

[12]  Luis Felipe Gonzalez,et al.  FPGA Implementation of an Evolutionary Algorithm for Autonomous Unmanned Aerial Vehicle On-Board Path Planning , 2013, IEEE Transactions on Evolutionary Computation.

[13]  Hui Cheng,et al.  An autonomous vision-based target tracking system for rotorcraft unmanned aerial vehicles , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Luis F. Gonzalez,et al.  Evolutionary Optimisation Methods with Uncertainty for Modern Multidisciplinary Design in Aeronautical Engineering , 2009 .

[15]  Callie Branyan,et al.  A Dual-Use Unmanned Aerial System for Precision Agriculture and Search and Rescue Applications , 2016 .

[16]  Dongjin Lee,et al.  Robust marker tracking algorithm for precise UAV vision-based autonomous landing , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[17]  Angelos Antonopoulos,et al.  Towards Autonomous Modular UAV Missions: The Detection, Geo-Location and Landing Paradigm , 2016, Sensors.

[18]  Dale Schinstock,et al.  Tracking ground targets with measurements obtained from a single monocular camera mounted on an unmanned aerial vehicle , 2008, 2008 IEEE International Conference on Robotics and Automation.

[19]  Jens Braband,et al.  Vision-based control of a quadrotor for an object inspection scenario , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[20]  David Hyunchul Shim,et al.  Vision-based UAV landing on the moving vehicle , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[21]  Xiaoguang Zhao,et al.  Tracking ground targets using an autonomous helicopter with a vision system , 2010, 2010 3rd International Congress on Image and Signal Processing.

[22]  Volkan Isler,et al.  Vision-Based UAV Navigation in Orchards* , 2016 .