Understanding Crowd Behaviors in a Social Event by Passive WiFi Sensing and Data Mining

Understanding crowd behaviors in a large social event is crucial for event management. Passive WiFi sensing, by collecting WiFi probe requests sent from mobile devices, provides a better way to monitor crowds compared with people counters and cameras in terms of free interference, larger coverage, lower cost, and more information on people’s movement. In the existing studies, however, not enough attention has been paid to the thorough analysis and mining of collected data. Especially, the power of machine learning has not been fully exploited. In this article, therefore, we propose a comprehensive data analysis framework to fully analyze the collected probe requests to extract three types of patterns related to crowd behaviors in a large social event, with the help of statistics, visualization, and unsupervised machine learning. First, trajectories of the mobile devices are extracted from probe requests and analyzed to reveal the spatial patterns of the crowds’ movement. Hierarchical agglomerative clustering is adopted to find the interconnections between different locations. Next, $k$ -means and $k$ -shape clustering algorithms are applied to extract temporal visiting patterns of the crowds by days and locations, respectively. Finally, by combining with time, trajectories are transformed into spatiotemporal patterns, which reveal how trajectory duration changes over the length and how the overall trends of crowd movement change over time. The proposed data analysis framework is fully demonstrated using real-world data collected in a large social event. Results show that one can extract comprehensive patterns from data collected by a network of passive WiFi sensors.

[1]  Josep Blat,et al.  Analysis of pedestrian behaviors through non-invasive Bluetooth monitoring , 2017, ArXiv.

[2]  Salvatore Cuomo,et al.  Decision Making in IoT Environment through Unsupervised Learning , 2020, IEEE Intelligent Systems.

[3]  Yuren Zhou,et al.  Understanding Urban Human Mobility through Crowdsensed Data , 2018, IEEE Communications Magazine.

[4]  Luis Gravano,et al.  k-Shape: Efficient and Accurate Clustering of Time Series , 2016, SGMD.

[5]  Edward Verbree,et al.  Passive WiFi monitoring of the rhythm of the campus , 2015 .

[6]  Ciprian Dobre,et al.  Identifying Movements in Noisy Crowd Analytics Data , 2018, 2018 19th IEEE International Conference on Mobile Data Management (MDM).

[7]  Daniel Müllner,et al.  Modern hierarchical, agglomerative clustering algorithms , 2011, ArXiv.

[8]  Kaoru Sezaki,et al.  Using Mobile Sensing Technology for Capturing People Mobility Information , 2019, PredictGIS@SIGSPATIAL.

[9]  Wei Zhang,et al.  An Experimental Study for Tracking Crowd in Smart Cities , 2019, IEEE Systems Journal.

[10]  Tommi S. Jaakkola,et al.  Fast optimal leaf ordering for hierarchical clustering , 2001, ISMB.

[11]  Josep Blat,et al.  An Analysis of Visitors' Behavior in the Louvre Museum: A Study Using Bluetooth Data , 2014, ArXiv.

[12]  Kaan Ozbay,et al.  Estimating Pedestrian Densities, Wait Times, and Flows with Wi-Fi and Bluetooth Sensors , 2017 .

[13]  Wim Lamotte,et al.  WiFiPi: Involuntary tracking of visitors at mass events , 2013, 2013 IEEE 14th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[14]  Carlo Ratti,et al.  Lessons learned from longitudinal modeling of mobile-equipped visitors in a complex museum , 2019, Neural Computing and Applications.

[15]  Baek-Young Choi,et al.  ICE-MoCha: Intelligent Crowd Engineering using Mobility Characterization and Analytics , 2019, Sensors.

[16]  Paul Lukowicz,et al.  Monitoring crowd condition in public spaces by tracking mobile consumer devices with wifi interface , 2016, UbiComp Adjunct.

[17]  Mun Choon Chan,et al.  CrowdProbe: Non-invasive Crowd Monitoring with Wi-Fi Probe , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[18]  A. B. M. Musa,et al.  Tracking unmodified smartphones using wi-fi monitors , 2012, SenSys '12.

[19]  Nobuhiko Nishio,et al.  A pedestrian flow analysis system using Wi-Fi packet sensors to a real environment , 2014, UbiComp Adjunct.

[20]  Paul Lukowicz,et al.  Probing crowd density through smartphones in city-scale mass gatherings , 2013, EPJ Data Science.

[21]  Paul Lukowicz,et al.  Capturing crowd dynamics at large scale events using participatory GPS-localization , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[22]  Martin W. Traunmueller,et al.  Digital footprints: Using WiFi probe and locational data to analyze human mobility trajectories in cities , 2018, Comput. Environ. Urban Syst..

[23]  Mikkel Baun Kjærgaard,et al.  Analysis methods for extracting knowledge from large-scale WiFi monitoring to inform building facility planning , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[24]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[25]  Mikkel Baun Kjærgaard,et al.  Spatio-temporal facility utilization analysis from exhaustive WiFi monitoring , 2015, PERCOM 2015.

[26]  Philipp Marcus,et al.  Estimating crowd densities and pedestrian flows using wi-fi and bluetooth , 2014, MobiQuitous.

[27]  Luis Miranda-Moreno,et al.  Development and Testing of a Real-Time WiFi-Bluetooth System for Pedestrian Network Monitoring, Classification, and Data Extrapolation , 2019, IEEE Transactions on Intelligent Transportation Systems.

[28]  Javier Martinez Plume,et al.  Evaluation of the Use of a City Center through the Use of Bluetooth Sensors Network , 2019, Sustainability.

[29]  Philipp Scholl,et al.  Capturing Personal and Crowd Behavior with Wi-Fi Analytics , 2016, WPA '16.

[30]  Erik C. Rye,et al.  A Study of MAC Address Randomization in Mobile Devices and When it Fails , 2017, Proc. Priv. Enhancing Technol..

[31]  Shrikanth Narayanan,et al.  Toward Robust Interpretable Human Movement Pattern Analysis in a Workplace Setting , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Shaojie Tang,et al.  SNOW: Detecting Shopping Groups Using WiFi , 2018, IEEE Internet of Things Journal.

[33]  Mun Choon Chan,et al.  SocialProbe: Understanding Social Interaction Through Passive WiFi Monitoring , 2016, MobiQuitous.

[34]  Salvatore Cuomo,et al.  Exploring Unsupervised Learning Techniques for the Internet of Things , 2020, IEEE Transactions on Industrial Informatics.

[35]  Carlos Fernández-Llatas,et al.  Analyzing of Gender Behaviors from Paths Using Process Mining: A Shopping Mall Application , 2019, Sensors.

[36]  Gürkan Solmaz,et al.  CrowdEstimator: Approximating Crowd Sizes with Multi-modal Data for Internet-of-Things Services , 2018, MobiSys.