A Recent Trend in Individual Counting Approach Using Deep Network

In video surveillance scheme, counting individuals is regarded as a crucial task. Of all the individual counting techniques in existence, the regression technique can offer enhanced performance under overcrowded area. However, this technique is unable to specify the details of counting individual such that it fails in locating the individual. On contrary, the density map approach is very effective to overcome the counting problems in various situations such as heavy overlapping and low resolution. Nevertheless, this approach may break down in cases when only the heads of individuals appear in video scenes, and it is also restricted to the feature’s types. The popular technique to obtain the pertinent information automatically is Convolutional Neural Network (CNN). However, the CNN based counting scheme is unable to sufficiently tackle three difficulties, namely, distributions of non-uniform density, changes of scale and variation of drastic scale. In this study, we cater a review on current counting techniques which are in correlation with deep net in different applications of crowded scene. The goal of this work is to specify the effectiveness of CNN applied on popular individuals counting approaches for attaining higher precision results.

[1]  Yandong Tang,et al.  Flow mosaicking: Real-time pedestrian counting without scene-specific learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Hmina Nabil,et al.  Deep Belief Network and Auto-Encoder for Face Classification , 2019, Int. J. Interact. Multim. Artif. Intell..

[3]  A. O. Adegboye,et al.  Single-pixel approach for fast people counting and direction estimation , 2012 .

[4]  Antoni B. Chan,et al.  Crossing the Line: Crowd Counting by Integer Programming with Local Features , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Meng Wang,et al.  Transferring a generic pedestrian detector towards specific scenes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ben J. A. Kröse,et al.  Head Detection in Stereo Data for People Counting and Segmentation , 2011, VISAPP.

[7]  Shaogang Gong,et al.  Feature Mining for Localised Crowd Counting , 2012, BMVC.

[8]  Antoni B. Chan,et al.  Beyond Counting: Comparisons of Density Maps for Crowd Analysis Tasks—Counting, Detection, and Tracking , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Andrew Zisserman,et al.  Interactive Object Counting , 2014, ECCV.

[10]  Greg Mori,et al.  Detecting Pedestrians by Learning Shapelet Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Nenghai Yu,et al.  Crowd Tracking with Dynamic Evolution of Group Structures , 2014, ECCV.

[12]  Jean-Philippe Thiran,et al.  Counting Pedestrians in Video Sequences Using Trajectory Clustering , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Robert T. Collins,et al.  Marked point processes for crowd counting , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Kaiqi Huang,et al.  Large scale crowd analysis based on convolutional neural network , 2015, Pattern Recognit..

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Nuno Vasconcelos,et al.  Counting People With Low-Level Features and Bayesian Regression , 2012, IEEE Transactions on Image Processing.

[17]  David Ndzi,et al.  Distributed Monitoring System Based On Weighted Data Fusing Model , 2013 .

[18]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ozgur Yeniay,et al.  A comparison of partial least squares regression with other prediction methods , 2001 .

[20]  Nilanjan Ray,et al.  Robust people counting using sparse representation and random projection , 2015, Pattern Recognit..

[21]  Hakan Erdogan,et al.  Counting people by clustering person detector outputs , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[22]  Dit-Yan Yeung,et al.  Spatiotemporal Modeling for Crowd Counting in Videos , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Xiaochun Cao,et al.  Deep People Counting in Extremely Dense Crowds , 2015, ACM Multimedia.

[24]  A. E. Hoerl,et al.  Ridge Regression: Applications to Nonorthogonal Problems , 1970 .

[25]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Ullrich Köthe,et al.  Learning to count with regression forest and structured labels , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[27]  H. Chaté,et al.  Collective motion of self-propelled particles interacting without cohesion. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Jean-Luc Dugelay,et al.  Low level crowd analysis using frame-wise normalized feature for people counting , 2012, 2012 IEEE International Workshop on Information Forensics and Security (WIFS).

[29]  R. Cramer.  Partial Least Squares (PLS): Its strengths and limitations , 1993 .

[30]  Hatice Gunes,et al.  Head detection for video surveillance based on categorical hair and skin colour models , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[31]  Pei Li,et al.  People counting based on head detection combining Adaboost and CNN in crowded surveillance environment , 2016, Neurocomputing.

[32]  Sridha Sridharan,et al.  Crowd Counting Using Multiple Local Features , 2009, 2009 Digital Image Computing: Techniques and Applications.

[33]  Johan A. K. Suykens,et al.  Approximate Confidence and Prediction Intervals for Least Squares Support Vector Regression , 2011, IEEE Transactions on Neural Networks.

[34]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Xiangmin Xu,et al.  Multi-scale convolutional neural networks for crowd counting , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[36]  Norbert Brändle,et al.  Pedestrian Detection and Tracking for Counting Applications in Crowded Situations , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[37]  Hal Daumé,et al.  Frustratingly Easy Domain Adaptation , 2007, ACL.

[38]  Ivan Laptev,et al.  Data-driven crowd analysis in videos , 2011, ICCV.

[39]  Rubén Heras Evangelio,et al.  Counting People in Crowded Environments by Fusion of Shape and Motion Information , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[40]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[41]  Xiaogang Wang,et al.  Deeply learned attributes for crowded scene understanding , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Xiaogang Wang,et al.  Scene-Independent Group Profiling in Crowd , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Haroon Idrees,et al.  Detecting Humans in Dense Crowds Using Locally-Consistent Scale Prior and Global Occlusion Reasoning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Grantham Pang,et al.  People Counting and Human Detection in a Challenging Situation , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[45]  Sergio A. Velastin,et al.  Crowd monitoring using image processing , 1995 .

[46]  Nan Wang,et al.  Counting challenging crowds robustly using a multi-column multi-task convolutional neural network , 2018, Signal Process. Image Commun..

[47]  Fatih Murat Porikli,et al.  Pedestrian Detection via Classification on Riemannian Manifolds , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Guoping Qiu,et al.  Crowd density estimation based on rich features and random projection forest , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[49]  S. Fortunato,et al.  Statistical physics of social dynamics , 2007, 0710.3256.

[50]  Shaogang Gong,et al.  Crowd Counting and Profiling: Methodology and Evaluation , 2013, Modeling, Simulation and Visual Analysis of Crowds.

[51]  Mario Vento,et al.  A Method for Counting People in Crowded Scenes , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[52]  Luc Van Gool,et al.  Pedestrian detection at 100 frames per second , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Meng Wang,et al.  Automatic adaptation of a generic pedestrian detector to a specific traffic scene , 2011, CVPR 2011.

[54]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[55]  Yunjian Jia,et al.  Passenger flow estimation based on convolutional neural network in public transportation system , 2017, Knowl. Based Syst..

[56]  Meng Wang,et al.  Deep Learning of Scene-Specific Classifier for Pedestrian Detection , 2014, ECCV.

[57]  Xiaogang Wang,et al.  Fully Convolutional Neural Networks for Crowd Segmentation , 2014, ArXiv.

[58]  Xiaogang Wang,et al.  Measuring Crowd Collectiveness , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Hua-An Zhao,et al.  New Techniques of Foreground Detection, Segmentation and Density Estimation for Crowded Objects Motion Analysis , 2011, J. Inf. Process..

[60]  Shenghua Gao,et al.  Single-Image Crowd Counting via Multi-Column Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Zeyad Q. H. Al-Zaydi,et al.  An adaptive people counting system with dynamic features selection and occlusion handling , 2016, J. Vis. Commun. Image Represent..

[62]  Xiaogang Wang,et al.  Coherent Filtering: Detecting Coherent Motions from Crowd Clutters , 2012, ECCV.

[63]  Anil M. Cheriyadat,et al.  Detecting multiple moving objects in crowded environments with coherent motion regions , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[64]  Ryuzo Okada,et al.  COUNT Forest: CO-Voting Uncertain Number of Targets Using Random Forest for Crowd Density Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[65]  Scott Cohen,et al.  Background estimation as a labeling problem , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[66]  Christoph H. Lampert.  Kernel Methods in Computer Vision , 2009, Found. Trends Comput. Graph. Vis..

[67]  Xiaogang Wang,et al.  Cross-scene crowd counting via deep convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[68]  Shiliang Pu,et al.  Estimation of crowd density in surveillance scenes based on deep convolutional neural network , 2017 .

[69]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[70]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..