Predicting user routines with masked dilated convolutions

Predicting users daily location visits - when and where they will go, and how long they will stay - is key for making effective location-based recommendations. Knowledge of an upcoming day allows the suggestion of relevant alternatives (e.g., a new coffee shop on the way to work) in advance, prior to a visit. This helps users make informed decisions and plan accordingly. People's visit routines, or just routines, can vary significantly from day to day, and visits from earlier in the day, week, or month may affect subsequent choices. Traditionally, routine prediction has been modeled with sequence methods, such as HMMs or more recently with RNN-based architectures. However, the problem with such architectures is that their predictive performance degrades when increasing the number of historical observations in the routine sequence. In this paper, we propose Masked-TCN (MTCN), a novel method based on time-dilated convolutional networks. The method implements custom dilations and masking which can process effectively long routine sequences, identifying recurring patterns at different resolution - hourly, daily, weekly, monthly. We demonstrate that MTCN achieves 8% improvement in accuracy over current state-of-the-art solutions on a large data set of visit routines.

[1]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[2]  Fei Wu,et al.  Where Did You Go: Personalized Annotation of Mobility Records , 2016, CIKM.

[3]  Sajjad Ahmad Madani,et al.  A comparative study of location-based recommendation systems , 2017, The Knowledge Engineering Review.

[4]  Derya Birant,et al.  ST-DBSCAN: An algorithm for clustering spatial-temporal data , 2007, Data Knowl. Eng..

[5]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[6]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[7]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[8]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[9]  Omar Alonso,et al.  Urban Maps of Social Activity , 2018, International Conference on Web and Social Media.

[10]  Michael Beigl,et al.  A Seq2Seq learning approach for modeling semantic trajectories and predicting the next location , 2018, SIGSPATIAL/GIS.

[11]  J. Antonio García-Macías,et al.  Learning and user adaptation in location forecasting , 2013, UbiComp.

[12]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.

[13]  Rodrygo L. T. Santos,et al.  Context-Aware Event Recommendation in Event-based Social Networks , 2015, RecSys.

[14]  Shashi Shekhar,et al.  Spatial Databases: A Tour , 2003 .

[15]  Wilson L. Taylor,et al.  “Cloze Procedure”: A New Tool for Measuring Readability , 1953 .