DTV: Detection, Tracking and Validation Framework for Unique People Count

Counting the unique number of people in a video (i.e., counting a person only once while the person is within the field of view), is required in many significant video analytical applications, such as transit passenger and pedestrian volume count in railway stations, shopping malls and road intersections and many others. In this paper, a novel framework is proposed for counting passengers, mainly in a railway station. The framework has three components: people detection, tracking and validation. In the detection step, a person is detected when he or she enters the field of view. Then, the person is tracked by optical flow based tracking until the person leaves the field of view. Finally, the trajectory generated by the tracker is validated through a spatiotemporal validation technique. The number of valid trajectories denotes the number of people. The novelty of the framework is the inclusion of the validation step, which is overlooked by the existing methods. Extensive experiments have been conducted on the datasets having both top views and whole body views of the passengers. Experimental results demonstrate that the proposed framework generates more than 90% accuracy on both types of views. It also detects and tracks persons having different hair colors and wearing hoodies, caps, long winter jackets, carrying bags and more. The proposed algorithm shows promising results also for people moving in different directions.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[3]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[4]  Mario Vento,et al.  Counting Moving People in Videos by Salient Points Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[5]  Liang Wang,et al.  Semi-supervised Elastic net for pedestrian counting , 2011, Pattern Recognit..

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Huadong Ma,et al.  Robust Head-Shoulder Detection by PCA-Based Multilevel HOG-LBP Detector for People Counting , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  James W. Davis Recognizing Movement using Motion Histograms , 1999 .

[12]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[13]  Yasushi MAKIHARA,et al.  Pedestrian Detection by Combining the Spatio and Temporal Features , 2010 .

[14]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[16]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[17]  朱松纯,et al.  Flow Mosaicking: Real-time Pedestrian Counting without Scene-specific Learning , 2009 .

[18]  Satarupa Mukherjee,et al.  Anovel framework for automatic passenger counting , 2011, 2011 18th IEEE International Conference on Image Processing.

[19]  Ames SteetCambridge Recognizing Movement Using Motion Histograms , 1999 .

[20]  Robert T. Collins,et al.  Marked point processes for crowd counting , 2009, CVPR.

[21]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[22]  Michel Desvignes,et al.  People Counting in Transport Vehicles , 2005, WEC.

[23]  Sung-Jea Ko,et al.  Real-time Vision-based People Counting System for the Security Door , 2002 .