An energy model approach to people counting for abnormal crowd behavior detection

Abnormal crowd behavior detection plays an important role in surveillance applications. We propose a camera parameter independent and perspective distortion invariant approach to detect two types of abnormal crowd behavior. The two typical abnormal activities are people gathering and running. Since people counting is necessary for detecting the abnormal crowd behavior, we present an potential energy-based model to estimate the number of people in public scenes. Building histograms on the X- and Y-axes, respectively, we can obtain probability distribution of the foreground object and then define crowd entropy. We define the Crowd Distribution Index by combining the people counting results with crowd entropy to represent the spatial distribution of crowd. We set a threshold on Crowd Distribution Index to detect people gathering. To detect people running, the kinetic energy is determined by computation of optical flow and Crowd Distribution Index. With a threshold, kinetic energy can be used to detect people running. To test the performance of our algorithm, videos of different scenes and different crowd densities are used in the experiments. Without camera calibration and training data, our method can robustly detect abnormal behaviors with low computation load.

[1]  Hai Tao,et al.  A Viewpoint Invariant Approach for Crowd Counting , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  Lu Yong,et al.  Video-Based Detection of Abnormal Behavior in the Examination Room , 2010, 2010 International Forum on Information Technology and Applications.

[3]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Feng Chen,et al.  A Fast and Robust People Counting Method in Video Surveillance , 2007 .

[5]  Thou-Ho Chen.  An automatic bi-directional passing-people counting method based on color image processing , 2003, IEEE 37th Annual 2003 International Carnahan Conference onSecurity Technology, 2003. Proceedings..

[6]  Christophe Rosenberger,et al.  Abnormal events detection based on spatio-temporal co-occurences , 2009, CVPR.

[7]  Sheng-Fuu Lin,et al.  Estimation of number of people in crowded scenes using perspective transformation , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Leonidas J. Guibas,et al.  Counting people in crowds with a real-time network of simple image sensors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Xuelong Li,et al.  Geometric Mean for Subspace Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Louis Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, CVPR.

[13]  L. Brillouin,et al.  Science and information theory , 1956 .

[14]  Kristen Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, CVPR.

[15]  S. Challa,et al.  Estimating the Number of People in Buildings Using Visual Information , 2007, 2007 Information, Decision and Control.

[16]  Qiang Yang,et al.  Spatio-temporal event detection using dynamic conditional random fields , 2009, IJCAI 2009.

[17]  M.H. Sharif,et al.  Crowd behaviour monitoring on the escalator exits , 2008, 2008 11th International Conference on Computer and Information Technology.

[18]  Luigi Cinque,et al.  A Statistical Method for People Counting in Crowded Environments , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[19]  Yangsheng Xu,et al.  Crowd Energy and Feature Analysis , 2007, 2007 IEEE International Conference on Integration Technology.

[20]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[21]  Hujun Bao,et al.  Recovering consistent video depth maps via bundle optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Xiaowei Zhang,et al.  Automatic human head location for pedestrian counting , 1997 .

[23]  Duan-Yu Chen,et al.  Dynamic human crowd modeling and its application to anomalous events detcetion , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[24]  José Mira Mira,et al.  On the effect of feedback in multilevel representation spaces for visual surveillance tasks , 2009, Neurocomputing.

[25]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[26]  Yangsheng Xu,et al.  Abnormal crowd motion analysis , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[27]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[28]  Dacheng Tao,et al.  Max-Min Distance Analysis by Using Sequential SDP Relaxation for Dimension Reduction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, CVPR 2004.

[30]  Chabane Djeraba,et al.  Real-time crowd motion analysis , 2008, 2008 19th International Conference on Pattern Recognition.

[31]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Mariano Rincón,et al.  A block-based model for monitoring of human activity , 2011, Neurocomputing.

[33]  Yangsheng Xu,et al.  A detection system for human abnormal behavior , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Zhongfei Zhang,et al.  Robust object tracking using a spatial pyramid heat kernel structural information representation , 2010, Neurocomputing.

[35]  Li Guo,et al.  The detection of unusual events in video based on Bayesian surprise model , 2010, The 2nd International Conference on Information Science and Engineering.

[36]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[37]  Xuelong Li,et al.  Scene segmentation based on IPCA for visual surveillance , 2009, Neurocomputing.

[38]  Peter H. Tu,et al.  Detecting and counting people in surveillance applications , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[39]  G.K.H. Pang,et al.  Automated people counting at a mass site , 2008, 2008 IEEE International Conference on Automation and Logistics.

[40]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[41]  Osama Masoud,et al.  Estimating pedestrian counts in groups , 2008, Comput. Vis. Image Underst..

[42]  Zhigang Luo,et al.  Non-Negative Patch Alignment Framework , 2011, IEEE Transactions on Neural Networks.

[43]  Zhenjiang Miao,et al.  Anomaly detection in crowd scene , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[44]  Robert B. Fisher,et al.  Detection of Emergency Events in Crowded Scenes , 2006 .

[45]  Yangsheng Xu,et al.  Crowd density estimation via Markov Random Field (MRF) , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[46]  Yangsheng Xu,et al.  Crowd Density Estimation Using Texture Analysis and Learning , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.