A Scheme for the Detection and Tracking of People Tuned for Aerial Image Sequences

This paper addresses the problem of detecting and tracking a large number of individuals in aerial image sequences that have been taken from high altitude. We propose a method which can handle the numerous challenges that are associated with this task and demonstrate its quality on several test sequences. Moreover this paper contains several contributions to improve object detection and tracking in other domains, too. We show how to build an effective object detector in a flexible way which incorporates the shadow of an object and enhanced features for shape and color. Furthermore the performance of the detector is boosted by an improved way to collect background samples for the classifier training. At last we describe a tracking-by-detection method that can handle frequent misses and a very large number of similar objects.

[1]  J. Friedman.  Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[2]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[3]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[4]  Stefan Hinz,et al.  PEOPLE TRACKING AND TRAJECTORY INTERPRETATION IN AERIAL IMAGE SEQUENCES , 2010 .

[5]  Margrit Betke,et al.  Tracking Large Variable Numbers of Objects in Clutter , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Uwe Stilla,et al.  Vehicle Detection in Very High Resolution Satellite Images of City Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Mubarak Shah,et al.  Geometric Constraints for Human Detection in Aerial Imagery , 2010, ECCV.

[9]  Ramakant Nevatia,et al.  Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet based Part Detectors , 2007, International Journal of Computer Vision.

[10]  Wiro J. Niessen,et al.  Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[11]  Jie Yu,et al.  A Review and Comparison of Measures for Automatic Video Surveillance Systems , 2008, EURASIP J. Image Video Process..

[12]  Hui Cheng,et al.  Vehicle and Person Tracking in Aerial Videos , 2007, CLEAR.

[13]  Supun Samarasekera,et al.  Aerial video surveillance and exploitation , 2001, Proc. IEEE.

[14]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[15]  Bo Wu,et al.  Boosted Markov Chain Monte Carlo Data Association for Multiple Target Detection and Tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  Haroon Idrees,et al.  Detection and Tracking of Large Number of Targets in Wide Area Surveillance , 2010, ECCV.

[17]  Horst Bischof,et al.  On-line boosting-based car detection from aerial images , 2008 .

[18]  Peter Reinartz,et al.  A new software/hardware architecture for real time image processing of wide area airborne camera images , 2008, Journal of Real-Time Image Processing.

[19]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Mubarak Shah,et al.  Person Tracking in UAV Video , 2007, CLEAR.

[21]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Josiane Zerubia,et al.  Detection of Object Motion Regions in Aerial Image Pairs With a Multilayer Markovian Model , 2009, IEEE Transactions on Image Processing.

[23]  J. B. Collins,et al.  Efficient gating in data association with multivariate Gaussian distributed states , 1992 .

[24]  Jonathan G. Fiscus,et al.  Multimodal Technologies for Perception of Humans, International Evaluation Workshops CLEAR 2007 and RT 2007, Baltimore, MD, USA, May 8-11, 2007, Revised Selected Papers , 2008, CLEAR.

[25]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Ramakant Nevatia,et al.  Robust Object Tracking by Hierarchical Association of Detection Responses , 2008, ECCV.