On Real-Time Monitoring on Data Stream for Traffic Flow Anomalies

Activities held in cities often lead to crowd gathering, and activities involving large numbers of people may have hidden public safety risks. Therefore, detecting the aggregation of the population and discovering the anomalies of the human flows in a timely manner are of significance in urban public safety, traffic management, emergency control, and terrorism prevention. To detect abnormal crowds in urban areas, the paper presents an approach Pherkad/A and implements Pherkad/A in the corresponding tool (named Pherkad/T). Pherkad/A adapts a three-state MMPP (Markov-Modulated Poisson Process) model to take continuous flow data as input. It thus can detect two kinds of anomaly, i.e., flow increase and flow decrease in real time from incoming traffic flows. On the other hand, Pherkad/T permits users to specify their interested monitoring areas and time intervals and then report the anomaly results in a visualized way. Extensive experiments are conducted on the real data. The experimental results show that Pherkad/A has high accuracy in detecting traffic flow anomalies and Pherkad/T can respond various monitoring requirements in real time.

[1]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[2]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[3]  Lance Sherry,et al.  Anomaly detection in aircraft data using Recurrent Neural Networks (RNN) , 2016, 2016 Integrated Communications Navigation and Surveillance (ICNS).

[4]  Sanjay Chawla,et al.  Inferring the Root Cause in Road Traffic Anomalies , 2012, 2012 IEEE 12th International Conference on Data Mining.

[5]  Xing Wang,et al.  A Self-Learning and Online Algorithm for Time Series Anomaly Detection, with Application in CPU Manufacturing , 2016, CIKM.

[6]  David A. Clifton,et al.  A review of novelty detection , 2014, Signal Process..

[7]  Subutai Ahmad,et al.  Unsupervised real-time anomaly detection for streaming data , 2017, Neurocomputing.

[8]  Leonardo Aguayo,et al.  Time Series Clustering for Anomaly Detection Using Competitive Neural Networks , 2009, WSOM.

[9]  Saeed Amizadeh,et al.  Generic and Scalable Framework for Automated Time-series Anomaly Detection , 2015, KDD.

[10]  Padhraic Smyth,et al.  Adaptive event detection with time-varying poisson processes , 2006, KDD '06.

[11]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[12]  Charu C. Aggarwal,et al.  Outlier Detection for Temporal Data: A Survey , 2014, IEEE Transactions on Knowledge and Data Engineering.

[13]  Pavlos Protopapas,et al.  Finding anomalous periodic time series , 2009, Machine Learning.

[14]  Philip K. Chan,et al.  Modeling multiple time series for anomaly detection , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[15]  Padhraic Smyth,et al.  Learning to detect events with Markov-modulated poisson processes , 2007, TKDD.

[16]  J. Ma,et al.  Time-series novelty detection using one-class support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[17]  Hui Xiong,et al.  Catch Me If You Can: Detecting Pickpocket Suspects from Large-Scale Transit Records , 2016, KDD.

[18]  Lin Sun,et al.  iBOAT: Isolation-Based Online Anomalous Trajectory Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[19]  R. Lund,et al.  Changepoint Detection in Periodic and Autocorrelated Time Series , 2007 .

[20]  Junshui Ma,et al.  Online novelty detection on temporal sequences , 2003, KDD '03.

[21]  Lovekesh Vig,et al.  Long Short Term Memory Networks for Anomaly Detection in Time Series , 2015, ESANN.

[22]  Licia Capra,et al.  Urban Computing: Concepts, Methodologies, and Applications , 2014, TIST.

[23]  Masashi Sugiyama,et al.  Change-point detection in time-series data by relative density-ratio estimation , 2012 .

[24]  Eamonn J. Keogh,et al.  Finding the most unusual time series subsequence: algorithms and applications , 2006, Knowledge and Information Systems.