Modeling Daily Crime Events Prediction Using Seq2Seq Architecture

Early prediction of the crime occurrence reduces its impact. Several studies have been conducted to forecast crimes. However, these studies are not highly accurate, particularly in short-term forecasting such as over one week. To respond to this, we examine sequence to sequence (Seq2Seq) based encoder-decoder LSTM model using two real-world crime datasets of Brisbane and Chicago, extracted from the open data portal, to make one week ahead of total daily crime forecasting. We have built an ARIMA statistical model and three machine learning-based regression models that differ in their architecture, namely, simple RNN, LSTM, and Conv1D with a novel approach of walk-forward validation. Using a grid search strategy, the hyperparameters of the models are optimized. The obtained results demonstrate that the proposed Seq2Seq model is highly effective, if not superior, compared to its counterparts and other algorithms. This proposed model achieves state-of-the-art results with a relatively Root Mean Squared Error (RMSE) of 0.43 and 0.86 on both datasets, respectively.

[1]  Michael Y. Hu,et al.  Linear and nonlinear time series forecasting with artificial neural networks , 1998 .

[2]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[3]  Junliang Chen,et al.  A Hybrid Time Series Model based on Dilated Conv1D and LSTM with Applications to PM2.5 Forecasting , 2019, Aust. J. Intell. Inf. Process. Syst..

[4]  Jiangbin Zheng,et al.  Big Data Analytics and Mining for Crime Data Analysis, Visualization and Prediction , 2018, BICS.

[5]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[6]  Charles E. Catlett,et al.  Forecasting Crimes Using Autoregressive Models , 2016, 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[7]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[8]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[9]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[10]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[11]  Yoshua Bengio,et al.  Hierarchical Recurrent Neural Networks for Long-Term Dependencies , 1995, NIPS.

[12]  Guoqiang Peter Zhang,et al.  Neural network forecasting for seasonal and trend time series , 2005, Eur. J. Oper. Res..

[13]  Alex Pentland,et al.  Once Upon a Crime: Towards Crime Prediction from Demographics and Mobile Data , 2014, ICMI.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[16]  Wei Ding,et al.  Crime Forecasting Using Data Mining Techniques , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[17]  Peng Chen,et al.  Forecasting Crime Using the ARIMA Model , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.