A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera

We develop a real-time method to detect and track moving objects (DATMO) from unmanned aerial vehicles (UAVs) using a single camera. To address the challenging characteristics of these vehicles, such as continuous unrestricted pose variation and low-frequency vibrations, new approaches must be developed. The main concept proposed in this work is to create an artificial optical flow field by estimating the camera motion between two subsequent video frames. The core of the methodology consists of comparing this artificial flow with the real optical flow directly calculated from the video feed. The motion of the UAV between frames is estimated with available parallel tracking and mapping techniques that identify good static features in the images and follow them between frames. By comparing the two optical flows, a list of dynamic pixels is obtained and then grouped into dynamic objects. Tracking these dynamic objects through time and space provides a filtering procedure to eliminate spurious events and misdetections. The algorithms have been tested with a quadrotor platform using a commercial camera.

[1]  Chandrika Kamath,et al.  Robust Background Subtraction with Foreground Validation for Urban Traffic Video , 2005, EURASIP J. Adv. Signal Process..

[2]  Roland Siegwart,et al.  Stereo-Based Ego-Motion Estimation Using Pixel Tracking and Iterative Closest Point , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[3]  Robert C. Bolles,et al.  Outdoor Mapping and Navigation Using Stereo Vision , 2006, ISER.

[4]  Baoxin Hu,et al.  Comprehensive Utilization of Temporal and Spatial Domain Outlier Detection Methods for Mobile Terrestrial LiDAR Data , 2011, Remote. Sens..

[5]  Gabriel Oliver,et al.  Experimental Assessment of Different Feature Tracking Strategies for an IPT-based Navigation Task , 2010 .

[6]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[7]  Kazuhiko Takahashi,et al.  Moving-object tracking with multi-laser range sensors for mobile robot navigation , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[8]  Mary Inaba,et al.  Applications of weighted Voronoi diagrams and randomization to variance-based k-clustering: (extended abstract) , 1994, SCG '94.

[9]  C. Laugier,et al.  Real-time moving obstacle detection using optical flow models , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[10]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[11]  Larry H. Matthies,et al.  Real-time detection of moving objects from moving vehicles using dense stereo and optical flow , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Subhash Challa,et al.  Sensor fusion-based visual target tracking for autonomous vehicles with the out-of-sequence measurements solution , 2008, Robotics Auton. Syst..

[13]  Hai-Yan Zhang,et al.  Multiple moving objects detection and tracking based on optical flow in polar-log images , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[14]  Yi-Ta Wu,et al.  A Hybrid Moving Object Detection Method for Aerial Images , 2010, PCM.

[15]  David Suter,et al.  Object tracking in image sequences using point features , 2005, Pattern Recognit..

[16]  Naoki Suganuma,et al.  Fast dynamic object extraction using stereovision based on Occupancy Grid Maps and optical flow , 2011, 2011 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[17]  Hyeran Byun,et al.  Human tracking and silhouette extraction for human–robot interaction systems , 2008, Pattern Analysis and Applications.

[18]  Ivan Markovic,et al.  Optical flow field segmentation in an omnidirectional camera image based on known camera motion , 2011, 2011 Proceedings of the 34th International Convention MIPRO.

[19]  Jun Zhang,et al.  TRAFFIC VIDEO-BASED MOVING VEHICLE DETECTION AND TRACKING IN THE COMPLEX ENVIRONMENT , 2009, Cybern. Syst..

[20]  S. Heinrich,et al.  Fast obstacle detection for urban traffic situations , 2002, IEEE Trans. Intell. Transp. Syst..

[21]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  Yasuyuki Sugaya,et al.  Detecting Incorrect Feature Tracking by Affine Space Fitting , 2009, PSIVT.

[23]  Yoko Watanabe,et al.  Simultaneous visual target tracking and navigation in a GPS-denied environment , 2009, 2009 International Conference on Advanced Robotics.

[24]  Fei Teng,et al.  A Registration Method Based on Nature Feature with KLT Tracking Algorithm for Wearable Computers , 2008, CW.

[25]  Mubarak Shah,et al.  Person Tracking in UAV Video , 2007, CLEAR.

[26]  Naoya Ohta,et al.  Accuracy bounds and optimal computation of homography for image mosaicing applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[27]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[28]  T. List,et al.  Comparison of target detection algorithms using adaptive background models , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[29]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[31]  Robert C. Bolles,et al.  Background modeling for segmentation of video-rate stereo sequences , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[32]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[33]  S. Ribaric,et al.  Real-time object tracking based on optical flow and active rays , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[34]  Michel Barlaud,et al.  Region-of-Interest Tracking Based on Keypoint Trajectories on a Group of Pictures , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[35]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .