Pedestrian Detection Based on Blob Motion Statistics

Pedestrian detection based on video analysis is a key functionality in automated surveillance systems. In this paper, we present efficient detection metrics that consider the fact that human movement presents distinctive motion patterns. Contrary to several methods that perform an intrablob analysis based on motion masks, we approach the problem without necessarily considering the periodic pixel motion inside the blob. As such, we do not analyze periodicity in the pixel luminances, but in the motion statistics of the tracked blob as a whole. For this, we propose the use of the following cues: 1) a cyclic behavior in the blob trajectory, and 2) an in-phase relationship between the change in blob size and position. In addition, we also exploit the relationship between blob size and vertical position, assuming that the camera is positioned sufficiently high. If the homography between the camera and the ground is known, the features are normalized by transforming the blob size to the real person size. For improved performance, we combine these features using the Bayes classifier. We also present a theoretical statistical analysis to evaluate the system performance in the presence of noise. We perform online experiments in a real industrial scenario and also with videos from well-known databases. The results illustrate the applicability of the proposed features.

[1]  Hassan Foroosh,et al.  Trajectory Rectification and Path Modeling for Video Surveillance , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Francesco G. B. De Natale,et al.  Syntactic matching of pedestrian trajectories for behavioral analysis , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[3]  Ashley Tews,et al.  Real-Time Object Tracking and Classification Using a Static Came ra , 2009 .

[4]  Katja Nummiaro A Color-based Particle Filter , 2002 .

[5]  Ignacio Parra,et al.  Combination of Feature Extraction Methods for SVM Pedestrian Detection , 2007, IEEE Transactions on Intelligent Transportation Systems.

[6]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[7]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[8]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[9]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jeffrey E. Boyd,et al.  Synchronization of oscillations for machine perception of gaits , 2004, Comput. Vis. Image Underst..

[11]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[12]  Larry S. Davis,et al.  A Pose-Invariant Descriptor for Human Detection and Segmentation , 2008, ECCV.

[13]  Neil Genzlinger A. and Q , 2006 .

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[16]  Dimitris G. Manolakis,et al.  Statistical and Adaptive Signal Processing , 2000 .

[17]  S. Johnsen,et al.  Real-Time Object Tracking and Classification Using a Static Camera , 2009 .

[18]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[19]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[21]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[22]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Sergios Theodoridis,et al.  Pattern Recognition , 1998, IEEE Trans. Neural Networks.

[25]  Xiangjian He,et al.  Motion Based Pedestrian Recognition , 2008, 2008 Congress on Image and Signal Processing.

[26]  T. Gal,et al.  Multicriteria Decision Making: Advances in MCDM Models, Algorithms, Theory, and Applications , 2012 .

[27]  Larry S. Davis,et al.  Pedestrian Detection via Periodic Motion Analysis , 2007, International Journal of Computer Vision.

[28]  A. Willsky,et al.  Signals and Systems , 2004 .

[29]  Bernt Schiele,et al.  Pedestrian detection in crowded scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[30]  Ram Nevatia,et al.  Detection and Segmentation of Multiple, Partially Occluded Objects by Grouping, Merging, Assigning Part Detection Responses , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Bertrand Vachon,et al.  Statistical Background Modeling for Foreground Detection: A Survey , 2010 .

[32]  Mubarak Shah,et al.  Cyclic motion detection for motion based recognition , 1994, Pattern Recognit..

[33]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[34]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Sharath Pankanti,et al.  Appearance models for occlusion handling , 2006, Image Vis. Comput..

[36]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Baihua Li,et al.  Recognition of human periodic movements from unstructured information using a motion-based frequency domain approach , 2006, Image Vis. Comput..

[38]  Barry G. Quinn,et al.  The Estimation and Tracking of Frequency , 2001 .