Anomaly detection mechanisms to find social events using cellular traffic data

Abstract The design of new tools to detect on-the-fly traffic anomaly without scalability problems is a key point to exploit the cellular system for monitoring social activities. To this goal, the paper proposes two methods based on the wavelet analysis of the cumulative cellular traffic. The utilisation of the wavelets permits to easily filter “normal” traffic anomalies such as the periodic trends present in the cellular traffic. The two presented approaches, denoted as Spatial Analysis (SA) and Time Analysis (TA), differ on how they consider the spatial information of the traffic data. We examine the performance of the considered algorithms using cellular traffic data acquired from one the most important Italian Mobile Network Operator in the city of Milan throughout December 2013. The results highlight the weak points of TA and some important features of SA. Both approaches overcome the performance of one reference algorithm present in literature. The strategy used in the SA emerges as the most suitable for exploiting the spatial correlation when we aim at the detection of the traffic anomaly focused on the localisation of social events.

[1]  Angelo Coluccia,et al.  Distribution-based anomaly detection in 3G mobile networks: from theory to practice , 2010, Int. J. Netw. Manag..

[2]  Kavé Salamatian,et al.  Combining filtering and statistical methods for anomaly detection , 2005, IMC '05.

[3]  Zbigniew Smoreda,et al.  D4D-Senegal: The Second Mobile Phone Data for Development Challenge , 2014, ArXiv.

[4]  Zhang Xiong,et al.  Recovering Individual's Commute Routes Based on Mobile Phone Data , 2017, Mob. Inf. Syst..

[5]  Irene Celino,et al.  Smart Urban Planning Support through Web Data Science on Open and Enterprise Data , 2015, WWW.

[6]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[7]  Anukool Lakhina,et al.  Multivariate Online Anomaly Detection Using Kernel Recursive Least Squares , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[8]  Licia Capra,et al.  Beyond the Baseline: Establishing the Value in Mobile Phone Based Poverty Estimates , 2016, WWW.

[9]  Mohiuddin Ahmed,et al.  A survey of network anomaly detection techniques , 2016, J. Netw. Comput. Appl..

[10]  Christian Callegari,et al.  WAVE-CUSUM: Improving CUSUM performance in network anomaly detection by means of wavelet analysis , 2012, Comput. Secur..

[11]  Christian Callegari,et al.  Inferring social information on foreign people from mobile traffic data , 2017, 2017 IEEE International Conference on Communications (ICC).

[12]  Richard G. Baraniuk,et al.  Network Traffic Modeling Using a Multifractal Wavelet Model , 2001 .

[13]  Fabio Ricciato,et al.  Road traffic estimation from cellular network monitoring: A hands-on investigation , 2009, 2009 IEEE 20th International Symposium on Personal, Indoor and Mobile Radio Communications.

[14]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[15]  Etienne Huens,et al.  Data for Development: the D4D Challenge on Mobile Phone Data , 2012, ArXiv.

[16]  Ruy Luiz Milidiú,et al.  Data stream anomaly detection through principal subspace tracking , 2010, SAC '10.

[17]  Pedro Casas,et al.  Machine-Learning Based Approaches for Anomaly Detection and Classification in Cellular Networks , 2016, TMA.

[18]  Paul Barford,et al.  A signal analysis of network traffic anomalies , 2002, IMW '02.

[19]  Fabio Ricciato,et al.  Exploiting Cellular Networks for Road Traffic Estimation: A Survey and a Research Roadmap , 2009, VTC Spring 2009 - IEEE 69th Vehicular Technology Conference.

[20]  A. L. Narasimha Reddy,et al.  Statistical techniques for detecting traffic anomalies through packet header data , 2008, TNET.

[21]  Engin Zeydan,et al.  Anomaly Detection In Cellular Network Data Using Big Data Analytics , 2014 .

[22]  Antonio Lima,et al.  Personalized routing for multitudes in smart cities , 2015, EPJ Data Science.

[23]  Boris N. Oreshkin,et al.  Machine learning approaches to network anomaly detection , 2007 .

[24]  Christian Callegari,et al.  A Methodological Overview on Anomaly Detection , 2013, Data Traffic Monitoring and Analysis.

[25]  Fabio Ricciato,et al.  Distribution-based anomaly detection via generalized likelihood ratio test: A general Maximum Entropy approach , 2013, Comput. Networks.

[26]  Ioannis Lambadaris,et al.  Studies in applying PCA and wavelet algorithms for network traffic anomaly detection , 2013, 2013 IEEE 14th International Conference on High Performance Switching and Routing (HPSR).

[27]  S. Kim,et al.  Wavelet Methods for the Detection of Anomalies and their Application to Network Traffic Analysis , 2006, Qual. Reliab. Eng. Int..

[28]  Vincent D. Blondel,et al.  A survey of results on mobile phone datasets analysis , 2015, EPJ Data Science.

[29]  Pedro Casas,et al.  RCATool - A Framework for Detecting and Diagnosing Anomalies in Cellular Networks , 2015, 2015 27th International Teletraffic Congress.

[30]  William Eberle,et al.  Detecting Anomalies in Mobile Telecommunication Networks Using a Graph Based Approach , 2015, FLAIRS.

[31]  Mark Crovella,et al.  Mining anomalies using traffic feature distributions , 2005, SIGCOMM '05.

[32]  Christian Callegari,et al.  An information-theoretic method for the detection of anomalies in network traffic , 2017, Comput. Secur..

[33]  Philippe Owezarski,et al.  UNADA: Unsupervised Network Anomaly Detection Using Sub-space Outliers Ranking , 2011, Networking.

[34]  J. E. Fowler,et al.  The redundant discrete wavelet transform and additive noise , 2005, IEEE Signal Processing Letters.

[35]  Helmut Hlavacs,et al.  Incident Detection from Cellular Network Signalling , 2012 .