Exploring discriminative features for anomaly detection in public spaces

Context data, collected either from mobile devices or from user-generated social media content, can help identify abnormal behavioural patterns in public spaces (e.g., shopping malls, college campuses or downtown city areas). Spatiotemporal analysis of such data streams provides a compelling new approach towards automatically creating real-time urban situational awareness, especially about events that are unanticipated or that evolve very rapidly. In this work, we use real-life datasets collected via SMU's LiveLabs testbed or via SMU's Palanteer software, to explore various discriminative features (both spatial and temporal - e.g., occupancy volumes, rate of change in topic{specific tweets or probabilistic distribution of group sizes) for such anomaly detection. We show that such feature primitives fit into a future multi-layer sensor fusion framework that can provide valuable insights into mood and activities of crowds in public spaces.

[1]  Christopher Cheong,et al.  Social Media Data Mining: A Social Network Analysis Of Tweets During The 2010-2011 Australian Floods , 2011, PACIS.

[2]  Ee-Peng Lim,et al.  Palanteer: A Search Engine for Community Generated Microblogging Data , 2012, ICADL.

[3]  Charu C. Aggarwal,et al.  Outlier Detection for Temporal Data: A Survey , 2014, IEEE Transactions on Knowledge and Data Engineering.

[4]  Luc Van Gool,et al.  Hunting Nessie - Real-time abnormality detection from webcams , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Hsin-Hsi Chen,et al.  The Outreach of Digital Libraries: A Globalized Resource Network , 2012, Lecture Notes in Computer Science.

[6]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[7]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Archan Misra,et al.  LiveLabs: building an in-situ real-time mobile experimentation testbed , 2014, HotMobile.

[9]  F Cheong,et al.  Social Media Data Mining: A Social Network Analysis of Tweets During the Australian 2010-2011 Floods , 2011 .

[10]  Sridha Sridharan,et al.  An Efficient and Robust System for Multiperson Event Detection in Real-World Indoor Surveillance Scenes , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[12]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Archan Misra,et al.  GruMon: fast and accurate group monitoring for heterogeneous urban spaces , 2014, SenSys.