Semantics-Aware Hidden Markov Model for Human Mobility

Understanding human mobility benefits numerous applications such as urban planning, traffic control and city management. In this paper, we propose a novel semantics-aware mobility model that captures human mobility motivation using large-scale semantic-rich spatial-temporal data from location-based social networks. In our system, we first develop a multimodal embedding method to project user, location, time, and activity on the same embedding space in an unsupervised way while preserving original trajectory semantics. Then, we use hidden Markov model to learn latent states and transitions between them in the embedding space, which is the location embedding vector, to jointly consider spatial, temporal, and user motivations. In order to tackle the sparsity of individual mobility data, we further propose a von Mises-Fisher mixture clustering for user grouping so as to learn a reliable and fine-grained model for groups of users sharing mobility similarity. We evaluate our proposed method on two large-scale real-world datasets, where we validate the ability of our method to produce high-quality mobility models. We also conduct extensive experiments on the specific task of location prediction. The results show that our model outperforms state-of-the-art mobility models with higher prediction accuracy and much higher efficiency

[1]  Yong Li,et al.  Detecting Popular Temporal Modes in Population-scale Unlabelled Trajectory Data , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  Ling Chen,et al.  Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[3]  Siddharth Gupta,et al.  The TimeGeo modeling framework for urban mobility without travel surveys , 2016, Proceedings of the National Academy of Sciences.

[4]  Hao Wang,et al.  PME: Projected Metric Embedding on Heterogeneous Networks for Link Prediction , 2018, KDD.

[5]  Michael R. Lyu,et al.  Geo-Teaser: Geo-Temporal Sequential Embedding Rank for Point-of-interest Recommendation , 2016, WWW.

[6]  Weitong Chen,et al.  Learning Graph-based POI Embedding for Location-based Recommendation , 2016, CIKM.

[7]  Nadia Magnenat-Thalmann,et al.  Who, where, when and what: discover spatio-temporal topics for twitter users , 2013, KDD.

[8]  Nematollah Batmanghelich,et al.  Nonparametric Spherical Topic Modeling with Word Embeddings , 2016, ACL.

[9]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  T. Geisel,et al.  The scaling laws of human travel , 2006, Nature.

[11]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[12]  Prithwish Basu,et al.  Discovering Latent Semantic Structure in Human Mobility Traces , 2015, EWSN.

[13]  Claudio Moraga,et al.  The Influence of the Sigmoid Function Parameters on the Speed of Backpropagation Learning , 1995, IWANN.

[14]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[15]  Xiaoming Fu,et al.  Trajectory Recovery From Ash: User Privacy Is NOT Preserved in Aggregated Mobility Data , 2017, WWW.

[16]  Silvia Santini,et al.  The influence of temporal and spatial features on the performance of next-place prediction algorithms , 2013, UbiComp.

[17]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[18]  Stefano Spaccapietra,et al.  Semantic trajectories modeling and analysis , 2013, CSUR.

[19]  Xin Lu,et al.  Approaching the Limit of Predictability in Human Mobility , 2013, Scientific Reports.

[20]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Inderjit S. Dhillon,et al.  Clustering on the Unit Hypersphere using von Mises-Fisher Distributions , 2005, J. Mach. Learn. Res..

[22]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[23]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[24]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[25]  Mikolaj Morzy,et al.  Mining Frequent Trajectories of Moving Objects for Location Prediction , 2007, MLDM.

[26]  Zhe Zhu,et al.  What's Your Next Move: User Activity Prediction in Location-based Social Networks , 2013, SDM.

[27]  Bruno Martins,et al.  Predicting future locations with hidden Markov models , 2012, UbiComp.

[28]  Yong Li,et al.  Habit2vec: Trajectory Semantic Embedding for Living Pattern Recognition in Population , 2020, IEEE Transactions on Mobile Computing.

[29]  Liyuan Liu,et al.  TrioVecEvent: Embedding-Based Online Local Event Detection in Geo-Tagged Tweet Streams , 2017, KDD.

[30]  Chao Zhang,et al.  Trajectory clustering via deep representation learning , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[31]  Nicholas Jing Yuan,et al.  Regularity and Conformity: Location Prediction Using Heterogeneous Mobility Data , 2015, KDD.

[32]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[33]  Jiliang Tang,et al.  Mobile Location Prediction in Spatio-Temporal Context , 2012 .

[34]  Albert-László Barabási,et al.  Understanding individual human mobility patterns , 2008, Nature.

[35]  Nicholas R. Jennings,et al.  Modelling heterogeneous location habits in human populations for location prediction under data sparsity , 2013, UbiComp.

[36]  Qiaozhu Mei,et al.  PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks , 2015, KDD.

[37]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[38]  Alexandre Proutière,et al.  Cluster-aided mobility predictions , 2015, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[39]  Luming Zhang,et al.  GMove: Group-Level Mobility Modeling Using Geo-Tagged Social Media , 2016, KDD.

[40]  Hongzhi Shi,et al.  Discovering Periodic Patterns for Large Scale Mobile Traffic Data: Method and Applications , 2018, IEEE Transactions on Mobile Computing.

[41]  Michael R. Lyu,et al.  STELLAR: Spatial-Temporal Latent Ranking for Successive Point-of-Interest Recommendation , 2016, AAAI.

[42]  Zi Huang,et al.  Joint Event-Partner Recommendation in Event-Based Social Networks , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[43]  Vassilis Kostakos,et al.  Semantics-Aware Hidden Markov Model for Human Mobility , 2019, IEEE Transactions on Knowledge and Data Engineering.

[44]  Krzysztof Janowicz,et al.  From ITDL to Place2Vec: Reasoning About Place Type Similarity and Relatedness by Learning Embeddings From Augmented Spatial Contexts , 2017, SIGSPATIAL/GIS.

[45]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[46]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[47]  Shaowen Wang,et al.  Regions, Periods, Activities: Uncovering Urban Dynamics via Cross-Modal Representation Learning , 2017, WWW.

[48]  Anna Monreale,et al.  WhereNext: a location predictor on trajectory pattern mining , 2009, KDD.

[49]  Bei Liu,et al.  Spatiotemporal Representation Learning for Translation-Based POI Recommendation , 2019, ACM Trans. Inf. Syst..

[50]  Aniket Kittur,et al.  Bridging the gap between physical location and online social networks , 2010, UbiComp.