Loitering Detection Based on Pedestrian Activity Area Classification

Loitering detection can help recognize vulnerable people needing attention and potential suspects harmful to public security. The existing loitering detection methods used time or target trajectories as assessment criteria, and only handled some simple loitering circumstances because of complex track. To solve these problems, this paper proposes a loitering detection method based on pedestrian activity area classification. The paper first gave loitering definition from a new perspective using the size of pedestrian activity area. The pedestrian loitering behaviors were divided into three categories. The proposed algorithms dynamically calculate enclosing rectangle, ellipse, and sector of pedestrian activity areas through curve fitting based on trajectory coordinates within given staying time threshold. The loitering is recognized if the pedestrian activity is detected to be constrained in an area within a certain period of time. The algorithm does not need to calculate complex trajectories. The PETS2007 dataset and our own self-collected simulated test videos were tested. The experimental results show that the proposed method accurately detected the pedestrian loitering, not only detected some loitering that the existing methods could not detect, but also distinguishing different types of loitering. The proposed method is effectiveness, robust, and simplified in implementation.

[1]  Kwang-Eun Ko,et al.  Deep convolutional framework for abnormal behavior detection in a smart surveillance system , 2018, Eng. Appl. Artif. Intell..

[2]  Haim H. Permuter,et al.  A study of Gaussian mixture models of color and texture features for image classification and segmentation , 2006, Pattern Recognit..

[3]  Venkatesh Saligrama,et al.  Video anomaly detection based on local statistical aggregates , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Weidong Min,et al.  Human Fall Detection Based on Motion Tracking and Shape Aspect Ratio , 2016, MUE 2016.

[5]  Qixiang Ye,et al.  Visual abnormal behavior detection based on trajectory sparse reconstruction analysis , 2013, Neurocomputing.

[6]  Takashi Toriu,et al.  A Markov Random Walk Model for Loitering People Detection , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[7]  Hiok Chai Quek,et al.  ElliFit: An unconstrained, non-iterative, least squares based geometric Ellipse Fitting method , 2013, Pattern Recognit..

[8]  Chee Seng Chan,et al.  iSurveillance: Intelligent framework for multiple events detection in surveillance videos , 2014, Expert Syst. Appl..

[9]  Shihong Lao,et al.  Human Detection in Video over Large Viewpoint Changes , 2010, ACCV.

[10]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[11]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Matthew D'Souza,et al.  Energy efficient LoRa GPS tracker for dementia patients , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Osama Masoud,et al.  Detection of loitering individuals in public transportation areas , 2005, IEEE Transactions on Intelligent Transportation Systems.

[14]  Qian Zhang,et al.  Energy Level-Based Abnormal Crowd Behavior Detection , 2018, Sensors.

[15]  Michael J. V. Leach,et al.  Contextual anomaly detection in crowded surveillance scenes , 2014, Pattern Recognit. Lett..

[16]  NamYunyoung Loitering detection using an associating pedestrian tracker in crowded scenes , 2015 .

[17]  Martin D. Levine,et al.  Automated Real-Time Detection of Potentially Suspicious Behavior in Public Transport Areas , 2013, IEEE Transactions on Intelligent Transportation Systems.

[18]  Soharab Hossain Shaikh,et al.  A comprehensive survey of human action recognition with spatio-temporal interest point (STIP) detector , 2015, The Visual Computer.

[19]  Raja Bala,et al.  Adaptive Sparse Representations for Video Anomaly Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  L. Qian,et al.  Loitering detection based on discrete curvature entropy , 2013 .

[21]  Xingshe Zhou,et al.  Managing Elders’ Wandering Behavior Using Sensors-based Solutions: A Survey , 2014 .

[22]  Zhe Shi,et al.  Local abnormal behavior detection based on optical flow and spatio-temporal gradient , 2015, Multimedia Tools and Applications.

[24]  James M. Ferryman,et al.  Abnormal behaviour detection on queue analysis from stereo cameras , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[25]  Yunyoung Nam,et al.  Loitering detection using an associating pedestrian tracker in crowded scenes , 2015, Multimedia Tools and Applications.

[26]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Xingshe Zhou,et al.  Detecting wandering behavior based on GPS traces for elders with dementia , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[28]  Joel J. P. C. Rodrigues,et al.  Intelligent Mobile Video Surveillance System as a Bayesian Coalition Game in Vehicular Sensor Networks: Learning Automata Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[29]  Sooyeong Kwak,et al.  Loitering Detection Solution for CCTV Security System , 2014 .

[30]  Kazuhiko Shibuya,et al.  Technologies for the next generation of digital terrestrial television broadcasting — A study on spatially coupled LDPC codes , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[31]  Sapana K. Mishra,et al.  A Survey on Human Motion Detection and Surveillance , 2015 .

[32]  Chunxiao Liu,et al.  Anomaly detection based on maximum a posteriori , 2018, Pattern Recognit. Lett..

[33]  Min Sun,et al.  Loitering Detection Based on Trajectory Analysis , 2015, 2015 8th International Conference on Intelligent Computation Technology and Automation (ICICTA).

[34]  A. Hampapur,et al.  Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking , 2005, IEEE Signal Processing Magazine.

[35]  Qixiang Ye,et al.  Abnormal Behavior Detection via Sparse Reconstruction Analysis of Trajectory , 2011, 2011 Sixth International Conference on Image and Graphics.

[36]  Jang-Hee Yoo,et al.  Rectified Trajectory Analysis Based Abnormal Loitering Detection for Video Surveillance , 2013, 2013 1st International Conference on Artificial Intelligence, Modelling and Simulation.

[37]  Weidong Min,et al.  A New Approach to Fall Detection Based on the Human Torso Motion Model , 2017 .

[38]  Qu Zhon Analysis of Moving Object Trajectory Gridded and Hovering Behavior Detection Research , 2014 .

[39]  Jesse Hoey,et al.  An Ontological Representation Model to Tailor Ambient Assisted Interventions for Wandering , 2012, AAAI Fall Symposium: Artificial Intelligence for Gerontechnology.

[40]  Yu Zhang,et al.  Recognition of pedestrian activity based on dropped-object detection , 2018, Signal Process..

[41]  Yihong Gong,et al.  Online Multi-Target Tracking With Unified Handling of Complex Scenarios , 2015, IEEE Transactions on Image Processing.

[42]  Qing Han,et al.  A New Approach to Track Multiple Vehicles With the Combination of Robust Detection and Two Classifiers , 2018, IEEE Transactions on Intelligent Transportation Systems.

[43]  Antonio Fernández-Caballero,et al.  Identification of Loitering Human Behaviour in Video Surveillance Environments , 2015, IWINAC.

[44]  Yu Zhao,et al.  Abnormal Activity Detection Using Spatio-Temporal Feature and Laplacian Sparse Representation , 2015, ICONIP.

[45]  Sridha Sridharan,et al.  Dynamic texture reconstruction from sparse codes for unusual event detection in crowded scenes , 2011, J-MRE '11.

[46]  Y. Young,et al.  Who Is Responsible? A Man With Dementia Wanders From Home, Is Hit by a Train, and Dies. , 2018, Journal of the American Medical Directors Association.

[47]  Chokri Ben Amar,et al.  Video surveillance system based on a scalable application-oriented architecture , 2016, Multimedia Tools and Applications.

[48]  Xingshe Zhou,et al.  Disorientation detection by mining GPS trajectories for cognitively-impaired elders , 2015, Pervasive Mob. Comput..

[49]  Muhammad Hassan,et al.  A Review on Human Actions Recognition Using Vision Based Techniques , 2014 .

[50]  James M. Ferryman,et al.  Loitering Behaviour Detection of Boats at Sea , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[51]  Michael Elad,et al.  Sparse Coding with Anomaly Detection , 2013, Journal of Signal Processing Systems.

[52]  Toon Goedemé,et al.  Abnormal behavior detection in LWIR surveillance of railway platforms , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).