Multi-stage Bayesian target estimation by UAV using fisheye lens camera and pan/tilt camera

This paper presents a generalized multi-stage Bayesian approach for an unmanned aerial vehicle to estimate the location of a mobile target. The major hardware components of the proposed approach are a camera with a fisheye lens and another camera with a normal lens and a pan/tilt unit. With wide angle of view (AOV), the fisheye lens camera first detects the bearing of the target, and the PT camera next captures the target in its AOV. The recursive Bayesian estimation steadily locates the target in a globally defined space. The paper also proposes a multi-stage detection method for the fisheye lens camera. The level of confidence is defined in association with the probability of detection (POD) for each detection technique, and the fisheye lens enables continuous detection by gradually increasing the POD. The observation likelihood is finally derived from the POD in a generalized manner. The proposed approach was applied to the detection of a mobile target by a multi-rotor helicopter, and results have demonstrated the effectiveness of both the proposed multi-stage Bayesian approach and multi-stage fisheye lens detection method.

[1]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[2]  Gamini Dissanayake,et al.  Estimation of a nonvisible field-of-view mobile target incorporating optical and acoustic sensors , 2016, Auton. Robots.

[3]  Hugh F. Durrant-Whyte,et al.  Autonomous Bayesian Search and Tracking, and its Experimental Validation , 2012, Adv. Robotics.

[4]  Alborz Geramifard,et al.  On the Design and Use of a Micro Air Vehicle to Track and Avoid Adversaries , 2010, Int. J. Robotics Res..

[5]  Miguel A. Olivares-Méndez,et al.  A pan-tilt camera Fuzzy vision controller on an unmanned aerial vehicle , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Xiaoguang Gao,et al.  UAV Mobile Ground Target Pursuit Algorithm , 2012, J. Intell. Robotic Syst..

[7]  J. Karl Hedrick,et al.  Autonomous UAV path planning and estimation , 2009, IEEE Robotics & Automation Magazine.

[8]  J. Karl Hedrick,et al.  A multiple UAV system for vision-based search and localization , 2008, 2008 American Control Conference.

[9]  Erdinç Altug,et al.  A Catadioptric and Pan-Tilt-Zoom Camera Pair Object Tracking System for UAVs , 2011, J. Intell. Robotic Syst..

[10]  Zhenbang Gong,et al.  A Pan-tilt Camera Control System of UAV Visual Tracking Based on Biomimetic Eye , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[11]  Michael Teutsch,et al.  Detection, Segmentation, and Tracking of Moving Objects in UAV Videos , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[12]  Gaurav S. Sukhatme,et al.  Combined optic-flow and stereo-based navigation of urban canyons for a UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Hugh F. Durrant-Whyte,et al.  Recursive Bayesian search-and-tracking using coordinated uavs for lost targets , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..