Activity Trajectory Generation via Modeling Spatiotemporal Dynamics

Human daily activities, such as working, eating out, and traveling, play an essential role in contact tracing and modeling the diffusion patterns of the COVID-19 pandemic. However, individual-level activity data collected from real scenarios are highly limited due to privacy issues and commercial concerns. In this paper, we present a novel framework based on generative adversarial imitation learning, to generate artificial activity trajectories that retain both the fidelity and utility of the real-world data. To tackle the inherent randomness and sparsity of irregular-sampled activities, we innovatively capture the spatiotemporal dynamics underlying trajectories by leveraging neural differential equations. We incorporate the dynamics of continuous flow between consecutive activities and instantaneous updates at observed activity points in temporal evolution and spatial transformation. Extensive experiments on two real-world datasets show that our proposed framework achieves superior performance over state-of-the-art baselines in terms of improving the data fidelity and data utility in facilitating practical applications. Moreover, we apply the synthetic data to model the COVID-19 spreading, and it achieves better performance by reducing the simulation MAPE over the baseline by more than 50%. The source code is available online: https://github.com/tsinghua-fib-lab/Activity-Trajectory-Generation.

[1]  Q. Ye,et al.  The emergence and epidemic characteristics of the highly mutated SARS‐CoV‐2 Omicron variant , 2022, Journal of medical virology.

[2]  K. Sneppen,et al.  Differences in social activity increase efficiency of contact tracing , 2021, The European Physical Journal B.

[3]  Hengliang Luo,et al.  User Consumption Intention Prediction in Meituan , 2021, KDD.

[4]  Guojie Song,et al.  Spatial-Temporal Graph ODE Networks for Traffic Flow Forecasting , 2021, KDD.

[5]  Jie Feng,et al.  Learning to Simulate Human Mobility , 2020, KDD.

[6]  Yanhua Li,et al.  xGAIL: Explainable Generative Adversarial Imitation Learning for Explainable Human Decision Analysis , 2020, KDD.

[7]  Hwasoo Yeo,et al.  TrajGAIL: Generating urban vehicle trajectories using generative adversarial imitation learning , 2020, Transportation Research Part C: Emerging Technologies.

[8]  Maximilian Nickel,et al.  Riemannian Continuous Normalizing Flows , 2020, NeurIPS.

[9]  A. Tatem,et al.  Effect of non-pharmaceutical interventions to contain COVID-19 in China , 2020, Nature.

[10]  Lizhen Wang,et al.  Prevalent Co-Visiting Patterns Mining from Location-Based Social Networks , 2019, 2019 20th IEEE International Conference on Mobile Data Management (MDM).

[11]  Austin R. Benson,et al.  Neural Jump Stochastic Differential Equations , 2019, NeurIPS.

[12]  Philippe Cudré-Mauroux,et al.  Revisiting User Mobility and Social Relationships in LBSNs: A Hypergraph Embedding Approach , 2019, WWW.

[13]  Qiang Gao,et al.  Predicting Human Mobility via Variational Attention , 2019, WWW.

[14]  Kyung-Yong Chung,et al.  Prediction Model of User Physical Activity using Data Characteristics-based Long Short-term Memory Recurrent Neural Networks , 2019, KSII Trans. Internet Inf. Syst..

[15]  O. Pybus,et al.  Precision epidemiology for infectious disease control , 2019, Nature Medicine.

[16]  David S. Rosenblum,et al.  A Non-Parametric Generative Model for Human Trajectories , 2018, IJCAI.

[17]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[18]  Jean-François Paiement,et al.  A Generative Model of Urban Activities from Cellular Data , 2018, IEEE Transactions on Intelligent Transportation Systems.

[19]  Xiping Liu,et al.  POI Recommendation of Location-Based Social Networks Using Tensor Factorization , 2018, 2018 19th IEEE International Conference on Mobile Data Management (MDM).

[20]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[21]  Jun Zhu,et al.  Understanding Human Behaviors in Crowds by Imitating the Decision-Making Process , 2018, AAAI.

[22]  Maziar Raissi,et al.  Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations , 2018, J. Mach. Learn. Res..

[23]  Bin Dong,et al.  PDE-Net: Learning PDEs from Data , 2017, ICML.

[24]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[25]  Stefano Ermon,et al.  Flow-GAN: Combining Maximum Likelihood and Adversarial Learning in Generative Models , 2017, AAAI.

[26]  Weinan Zhang,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[27]  Siddharth Gupta,et al.  The TimeGeo modeling framework for urban mobility without travel surveys , 2016, Proceedings of the National Academy of Sciences.

[28]  Stefano Ermon,et al.  Generative Adversarial Imitation Learning , 2016, NIPS.

[29]  Nabiha Asghar,et al.  Yelp Dataset Challenge: Review Rating Prediction , 2016, ArXiv.

[30]  Le Song,et al.  A Stochastic Differential Equation Framework for Guiding Online User Activities in Closed Loop , 2016, AISTATS.

[31]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[32]  Wei Xu,et al.  Bidirectional LSTM-CRF Models for Sequence Tagging , 2015, ArXiv.

[33]  Daqing Zhang,et al.  Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[35]  Cecilia Mascolo,et al.  Mining User Mobility Features for Next Place Prediction in Location-Based Services , 2012, 2012 IEEE 12th International Conference on Data Mining.

[36]  James B. D. Joshi,et al.  Exploring trajectory-driven local geographic topics in foursquare , 2012, UbiComp.

[37]  Cecilia Mascolo,et al.  Exploiting Semantic Annotations for Clustering Geographic Areas and Users in Location-based Social Networks , 2011, The Social Mobile Web.

[38]  Cecilia Mascolo,et al.  An Empirical Study of Geographic User Activity Patterns in Foursquare , 2011, ICWSM.

[39]  Mats Börjesson,et al.  A prospective study of leisure-time physical activity and mental health in Swedish health care workers and social insurance officers. , 2010, Preventive medicine.

[40]  Chaoming Song,et al.  Modelling the scaling properties of human mobility , 2010, 1010.0436.

[41]  Flemming Topsøe,et al.  Jensen-Shannon divergence and Hilbert space embedding , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[42]  Serge P. Hoogendoorn,et al.  Pedestrian route-choice and activity scheduling theory and models , 2004 .

[43]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[44]  Anthony W. Leung,et al.  Systems of Nonlinear Partial Differential Equations: Applications to Biology and Engineering , 1989 .

[45]  D. S. Jones,et al.  Differential Equations and Mathematical Biology , 1983 .

[46]  V. Korolyuk,et al.  Semi-markov processes and their applications , 1975 .

[47]  Varun Shankar Learning non-linear spatio-temporal dynamics with convolutional Neural ODEs , 2020 .

[48]  Zhe Zhu,et al.  What's Your Next Move: User Activity Prediction in Location-based Social Networks , 2013, SDM.

[49]  Peter J. Diggle,et al.  Spatio-Temporal Point Processes: Methods and Applications , 2005 .

[50]  Boris Rozovskii,et al.  Stochastic Navier-Stokes Equations for Turbulent Flows , 2004, SIAM J. Math. Anal..

[51]  H. White Maximum Likelihood Estimation of Misspecified Models , 1982 .