Detection, Segmentation, and Tracking of Moving Objects in UAV Videos

Automatic processing of videos coming from small UAVs offers high potential for advanced surveillance applications but is also very challenging. These challenges include camera motion, high object distance, varying object background, multiple objects near to each other, weak signal-to-noise-ratio (SNR), or compression artifacts. In this paper, a video processing chain for detection, segmentation, and tracking of multiple moving objects is presented dealing with the mentioned challenges. The fundament is the detection of local image features, which are not stationary. By clustering these features and subsequent object segmentation, regions are generated representing object hypotheses. Multi-object tracking is introduced using a Kalman filter and considering the camera motion. Split or merged object regions are handled by fusion of the regions and the local features. Finally, a quantitative evaluation of object segmentation and tracking is provided.

[1]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[2]  Haroon Idrees,et al.  Detection and Tracking of Large Number of Targets in Wide Area Surveillance , 2010, ECCV.

[3]  Yuri Owechko,et al.  Detection of unknown targets from aerial camera and extraction of simple object fingerprints for the purpose of target reacquisition , 2011, Electronic Imaging.

[4]  W. Krüger,et al.  Automatic image exploitation system for small UAVs , 2008, SPIE Defense + Commercial Sensing.

[5]  Robert M. Haralick,et al.  Morphologic edge detection , 1987, IEEE J. Robotics Autom..

[6]  Xuelong Li,et al.  KLT Feature Based Vehicle Detection and Tracking in Airborne Videos , 2011, 2011 Sixth International Conference on Image and Graphics.

[7]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jürgen Beyerer,et al.  Fusion of region and point-feature detections for measurement reconstruction in multi-target Kalman tracking , 2011, 14th International Conference on Information Fusion.

[9]  Michael Teutsch,et al.  Spatio-temporal fusion of object segmentation approaches for moving distant targets , 2012, 2012 15th International Conference on Information Fusion.

[10]  Fenghui Yao,et al.  Multiple moving target detection, tracking, and recognition from a moving observer , 2008, 2008 International Conference on Information and Automation.

[11]  Supun Samarasekera,et al.  Aerial video surveillance and exploitation , 2001, Proc. IEEE.

[12]  A. G. Amitha Perera,et al.  Multi-Object Tracking Through Simultaneous Long Occlusions and Split-Merge Conditions , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  P. Anandan,et al.  A unified approach to moving object detection in 2D and 3D scenes , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[14]  Harpreet S. Sawhney,et al.  Vehicle detection and tracking in wide field-of-view aerial video , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Witold Czajewski,et al.  Moving Objects Detection and Tracking Framework for UAV-based Surveillance , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[16]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Axel Korn,et al.  Toward a Symbolic Representation of Intensity Changes in Images , 1988, IEEE Trans. Pattern Anal. Mach. Intell..