Feature detection and tracking for extraction of crowd dynamics

Extraction of crowd dynamics from video is the fundamental step for automatic detection of abnormal events. However, it is difficult to obtain sufficient performance with object tracking due to occlusions and insufficient resolution of the objects in the scene. As a result, optical flow or feature tracking methods are preferred in crowd videos. These applications also require algorithms to work in real-time. In this work, we investigated the applicability and performance of feature detection and tracking algorithms in crowd videos. The algorithms that were tested in this paper include Scale Invariant Feature Transform (SIFT) and Speeded-Up Robust Features (SURF) as well as relatively newer approaches Binary Robust Independent Elementary Features (BRIEF) and Oriented Fast and Rotated Brief (ORB). These algorithms have been tested with videos having different crowd densities and comparative results of their accuracy and computational performance have been reported. The results show that BRIEF is computationally faster than the others, allowing real-time operation, and comparable with other algorithms regarding matching accuracy.

[1]  Krystian Mikolajczyk,et al.  Evaluation of local detectors and descriptors for fast feature matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jan-Michael Frahm,et al.  Comparative Evaluation of Binary Features , 2012, ECCV.

[4]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[5]  Brian C. Lovell,et al.  Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture , 2011, CVPR 2011 WORKSHOPS.

[6]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[7]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Alberto Del Bimbo,et al.  Dense spatio-temporal features for non-parametric anomaly detection and localization , 2010, ARTEMIS '10.

[10]  C Wallraven.  Local features for object recognition and categorization , 2003 .

[11]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Nan Li,et al.  Abnormal Crowd Behavior Detection using , 2011 .