Vision‐Based Tracking and Position Estimation of Moving Targets for Unmanned Helicopter Systems

The primary goal of this study is to track a ground‐moving target using a machine‐vision system installed on an unmanned helicopter, and to estimate its position if the target becomes unobservable. The machine‐vision system is accomplished using real‐time color images obtained from a charge‐coupled device (CCD) camera mounted on a computer‐controlled gimbaled system that can pitch and yaw. To avoid real‐time image‐tracking failure resulting from a moving target becoming concealed, the Kalman filtering technique is applied to predict the target's follow‐on position, so that the camera can continuously track the target. The entire system is initially tested on the ground and then mounted on a helicopter for in‐flight testing. The following three cases are shown in the flight tests: (1) an uncovered static target; (2) a moving visible target; and (3) a target that moves in a straight line at a constant speed and becomes temporarily concealed. The vision‐based tracking system with the developed algorithm is successfully applied in all three cases.

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  T. Kanade,et al.  System Identification Modeling of a Model-Scale Helicopter , 2000 .

[3]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[4]  Raúl Rojas,et al.  Kalman filter for vision tracking , 2005 .

[5]  Shiuh-Ku Weng,et al.  Video object tracking using adaptive Kalman filter , 2006, J. Vis. Commun. Image Represent..

[6]  Fei-Bin Hsiao,et al.  An unmanned helicopter vehicle system development , 2007 .

[7]  Kenzo Nonami,et al.  3D Vision Based Landing Control of a Small Scale Autonomous Helicopter , 2007 .

[8]  Derek W. Seward,et al.  Development of a Multi-Arm Mobile Robot for Nuclear Decommissioning Tasks , 2007 .

[9]  Le Yi Wang,et al.  Identification of cascaded systems with linear and quantized observations , 2009 .

[10]  Ching-Chih Tsai,et al.  Adaptive backstepping integral control of a small‐scale helicopter for airdrop missions , 2010 .

[11]  Ben M. Chen,et al.  An overview on development of miniature unmanned rotorcraft systems , 2010 .

[12]  Chingiz Hajiyev,et al.  GNSS signals processing via linear and extended Kalman filters , 2011 .

[13]  Shau-Shiun Jan,et al.  Autonomous Hovering of an Experimental Unmanned Helicopter System with Proportional-Integral Sliding Mode Control , 2011 .

[14]  A. Sengupta,et al.  A recursive maximum a posteriori estimator , 2011 .

[15]  Towhid Zargar Ershadi,et al.  Target Tracking Based on Mean Shift and KALMAN Filter with Kernel Histogram Filtering , 2011, Comput. Inf. Sci..

[16]  Jaafar AlMutawa.  Robust Kalman filter and smoother for errors-in-variables state space models with observation outliers based on the minimum-covariance determinant estimator† , 2011 .

[17]  Mehmet Önder Efe,et al.  Battery power loss compensated fractional order sliding mode control of a quadrotor UAV , 2012 .