Graph-based anomaly detection for smart cities: A survey

With increasing size, the problems a city faces (e.g., air pollution, traffic congestion or high energy consumption) increase, but so does the amount of implicitly available data. In order to leverage this data for smarter problem solutions, local authorities and businesses require sophisticated analysis preprocessing techniques. Recent work proposes modeling urban data as a graph and applying graph-based anomaly detection, which is traditionally used for fraud and intrusion detection. This demonstrates that a successful application of anomaly detection to selected sources of urban data is possible, but lacks an evaluation of the general applicability. In this survey, we discuss several homogeneous and heterogeneous graph models for urban data and suitable detection approaches.

[1]  Yingjie Zhou,et al.  Large-scale IP network behavior anomaly detection and identification using substructure-based approach and multivariate time series mining , 2012, Telecommun. Syst..

[2]  Philip S. Yu,et al.  GraphScope: parameter-free mining of large time-evolving graphs , 2007, KDD '07.

[3]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[4]  Diane J. Cook,et al.  Graph-based anomaly detection , 2003, KDD '03.

[5]  Steve Harenberg,et al.  Anomaly detection in dynamic networks: a survey , 2015 .

[6]  A. Barabasi,et al.  Quantifying social group evolution , 2007, Nature.

[7]  Tina Eliassi-Rad,et al.  Detecting Novel Discrepancies in Communication Networks , 2010, 2010 IEEE International Conference on Data Mining.

[8]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[9]  Michael Beigl,et al.  Urban Anomaly Detection: a Use-Case for Participatory Infra-Structure Monitoring , 2016, Urb-IoT.

[10]  Daniel B. Neill,et al.  Non-parametric scan statistics for event detection and forecasting in heterogeneous social media graphs , 2014, KDD.

[11]  Deepayan Chakrabarti,et al.  AutoPart: Parameter-Free Graph Partitioning and Outlier Detection , 2004, PKDD.

[12]  Ines Mergel,et al.  Distributed Democracy: SeeClickFix.Com for Crowdsourced Issue Reporting , 2012 .

[13]  Xing Xie,et al.  Discovering regions of different functions in a city using human mobility and POIs , 2012, KDD.

[14]  H. Kiers.  Towards a standardized notation and terminology in multiway analysis , 2000 .

[15]  Ambuj K. Singh,et al.  NetSpot: Spotting Significant Anomalous Regions on Dynamic Networks , 2013, SDM.

[16]  Christos Faloutsos,et al.  MultiAspectForensics: Pattern Mining on Large-Scale Heterogeneous Networks with Tensor Analysis , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[17]  Jiajie Xu,et al.  Traffic Aware Route Planning in Dynamic Road Networks , 2012, DASFAA.

[18]  Charu C. Aggarwal,et al.  Event Detection in Social Streams , 2012, SDM.

[19]  Nagiza F. Samatova,et al.  Community-based anomaly detection in evolutionary networks , 2012, Journal of Intelligent Information Systems.

[20]  Ananthram Swami,et al.  Com2: Fast Automatic Discovery of Temporal ('Comet') Communities , 2014, PAKDD.

[21]  Jimeng Sun,et al.  Beyond streams and graphs: dynamic tensor analysis , 2006, KDD '06.

[22]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[23]  Curtis B. Storlie,et al.  Scan Statistics for the Online Detection of Locally Anomalous Subgraphs , 2013, Technometrics.

[24]  Yanchi Liu,et al.  Diagnosing New York city's noises with ubiquitous data , 2014, UbiComp.

[25]  Paul Brown,et al.  Fix my street or else: using the internet to voice local public service concerns , 2007, ICEGOV '07.

[26]  C. Faloutsos,et al.  EVENT DETECTION IN TIME SERIES OF MOBILE COMMUNICATION GRAPHS , 2010 .

[27]  D. Hand,et al.  Bayesian anomaly detection methods for social networks , 2010, 1011.1788.

[28]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[29]  Michael Beigl,et al.  Anomaly Detection in Evolving Heterogeneous Graphs , 2017, 2017 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[30]  Daqing Zhang,et al.  From taxi GPS traces to social and community dynamics , 2013, ACM Comput. Surv..