A novel approach for people counting and tracking from crowd video

Crowd analysis on video recordings is an important research area currently. In this work, a combined crowd density estimation method is presented to overcome this problem. To improve the accuracy of the system two different estimators run simultaneously and a blob is marked as a person only if both estimators mark it as person. One of the main problems in crowd density estimation is occlusion. To overcome this problem we tracked the trajectories of blobs by using a Kalman filter. The method was applied to three common benchmark data which are PETS2009, UCSD and Grand Central. The results confirm the proposed method's success.

[1]  Jean-Luc Dugelay,et al.  Crowd density map estimation based on feature tracks , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[2]  Julian Magarey,et al.  Motion estimation using a complex-valued wavelet transform , 1998, IEEE Trans. Signal Process..

[3]  Chang-Lung Tsai,et al.  Crowd Density Estimation Based on Frequency Analysis , 2011, 2011 Seventh International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[4]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[5]  Hua An Zhao,et al.  A novel method for crowd density estimations , 2012 .

[6]  Lei Huang,et al.  Crowd density analysis using co-occurrence texture features , 2010, 5th International Conference on Computer Sciences and Convergence Information Technology.

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Farhad Tehranipour,et al.  Attention control using fuzzy inference system in monitoring CCTV based on crowd density estimation , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[9]  M. Bellanger.  Adaptive filter theory: by Simon Haykin, McMaster University, Hamilton, Ontario L8S 4LB, Canada, in: Prentice-Hall Information and System Sciences Series, published by Prentice-Hall, Englewood Cliffs, NJ 07632, U.S.A., 1986, xvii+590 pp., ISBN 0-13-004052-5 025 , 1987 .

[10]  Hakan Erdogan,et al.  Counting people by clustering person detector outputs , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  M. Severcan,et al.  Target tracking using the complex discrete wavelet transform based motion estimation method , 2005, Proceedings of the IEEE 13th Signal Processing and Communications Applications Conference, 2005..

[12]  Xiaohui Chen,et al.  Crowd counting using accumulated HOG , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[13]  Jean-Luc Dugelay,et al.  People counting system in crowded scenes based on feature regression , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[14]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Soraia Raupp Musse,et al.  Crowd Analysis Using Computer Vision Techniques , 2010, IEEE Signal Processing Magazine.

[17]  Adrien Descamps,et al.  Counting People in the Crowd Using a Generic Head Detector , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[18]  P. Karpagavalli,et al.  Estimating the density of the people and counting the number of people in a crowd environment for human safety , 2013, 2013 International Conference on Communication and Signal Processing.

[19]  Shaogang Gong,et al.  Feature Mining for Localised Crowd Counting , 2012, BMVC.

[20]  Yaobin Mao,et al.  Estimation of crowd density using multi-local features and regression , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[21]  Xiaojuan Wu,et al.  A new approach of crowd density estimation , 2010, TENCON 2010 - 2010 IEEE Region 10 Conference.

[22]  Jing Wang,et al.  Pedestrian Counting Based on Crowd Density Estimation and Lucas-Kanade Optical Flow , 2013, 2013 Seventh International Conference on Image and Graphics.

[23]  Mubarak Shah,et al.  Floor Fields for Tracking in High Density Crowd Scenes , 2008, ECCV.

[24]  Robert T. Collins,et al.  Crowd Density Analysis with Marked Point Processes , 2010 .

[25]  Nuno Vasconcelos,et al.  Analysis of Crowded Scenes using Holistic Properties , 2009 .

[26]  Xiaogang Wang,et al.  Cross-scene crowd counting via deep convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Yaoxuan Yuan.  Crowd Monitoring Using Mobile Phones , 2014, 2014 Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics.

[28]  Nuno Vasconcelos,et al.  Counting People With Low-Level Features and Bayesian Regression , 2012, IEEE Transactions on Image Processing.

[29]  吴新宇,et al.  Crowd Density Estimation via Markov Random Field (MRF) , 2010 .

[30]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[31]  Marimuthu Palaniswami,et al.  Crowd density estimation based on optical flow and hierarchical clustering , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[32]  Xuran Zhao,et al.  Crowd density analysis using subspace learning on local binary pattern , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[33]  Yuanyuan Liu,et al.  A crowd flow estimation method based on dynamic texture and GRNN , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[34]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Robert T. Collins,et al.  Crowd Density Analysis with Marked Point Processes [Applications Corner] , 2010, IEEE Signal Processing Magazine.

[36]  Peng Bo,et al.  Research on central issues of crowd density estimation , 2013, 2013 10th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[37]  Jae-Young Jung,et al.  Automated measurement of crowd density based on edge detection and optical flow , 2010, 2010 The 2nd International Conference on Industrial Mechatronics and Automation.