Neural Network based Continuous Conditional Random Field for Fine-grained Crime Prediction

Crime prediction has always been a crucial issue for public safety, and recent works have shown the effectiveness of taking spatial correlation, such as region similarity or interaction, for fine-grained crime modeling. In our work, we seek to reveal the relationship across regions for crime prediction using Continuous Conditional Random Field (CCRF). However, conventional CCRF would become impractical when facing a dense graph considering all relationship between regions. To deal with it, in this paper, we propose a Neural Network based CCRF (NN-CCRF) model that formulates CCRF into an end-to-end neural network framework, which could reduce the complexity in model training and improve the overall performance. We integrate CCRF with NN by introducing a Long Short-Term Memory (LSTM) component to learn the non-linear mapping from inputs to outputs of each region, and a modified Stacked Denoising AutoEncoder (SDAE) component for pairwise interactions modeling between regions. Experiments conducted on two different real-world datasets demonstrate the superiority of our proposed model over the state-of-the-art methods.

[1]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[2]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[3]  François Chollet,et al.  Deep Learning with Python , 2017 .

[4]  Bin Guo,et al.  Personalized Travel Package With Multi-Point-of-Interest Recommendation Based on Crowdsourced User Footprints , 2016, IEEE Transactions on Human-Machine Systems.

[5]  Tong Wang,et al.  Learning to Detect Patterns of Crime , 2013, ECML/PKDD.

[6]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[7]  Zoran Obradovic,et al.  Continuous Conditional Random Fields for Efficient Regression in Large Fully Connected Graphs , 2013, AAAI.

[8]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[9]  Nicu Sebe,et al.  Multi-scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Bin Guo,et al.  Identifying On-Site Users for Social Events: Mobility, Content, and Social Relationship , 2018, IEEE Transactions on Mobile Computing.

[11]  Hui Xiong,et al.  Rebalancing Bike Sharing Systems: A Multi-source Data Smart Optimization , 2016, KDD.

[12]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[13]  Hui Xiong,et al.  Catch Me If You Can: Detecting Pickpocket Suspects from Large-Scale Transit Records , 2016, KDD.

[14]  Hui Xiong,et al.  An Integrated Model for Crime Prediction Using Temporal and Spatial Factors , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Jiliang Tang,et al.  Modeling Temporal-Spatial Correlations for Crime Prediction , 2017, CIKM.

[17]  Hui Xiong,et al.  Sparse Real Estate Ranking with Online User Reviews and Offline Moving Behaviors , 2014, 2014 IEEE International Conference on Data Mining.

[18]  Hui Xiong,et al.  Joint Representation Learning for Multi-Modal Transportation Recommendation , 2019, AAAI.

[19]  Peter Robinson,et al.  Continuous Conditional Neural Fields for Structured Regression , 2014, ECCV.

[20]  Tao Mei,et al.  Shop-Type Recommendation Leveraging the Data from Social Media and Location-Based Services , 2016, ACM Trans. Knowl. Discov. Data.

[21]  Daniel Kifer,et al.  Crime Rate Inference with Big Data , 2016, KDD.

[22]  Bin Guo,et al.  Moving Destination Prediction Using Sparse Dataset , 2017, ACM Trans. Knowl. Discov. Data.

[23]  Tao Qin,et al.  Global Ranking Using Continuous Conditional Random Fields , 2008, NIPS.