Modeling Trajectories with Neural Ordinary Differential Equations

Recent advances in location-acquisition techniques have generated massive spatial trajectory data. Recurrent Neural Networks (RNNs) are modern tools for modeling such trajectory data. After revisiting RNN-based methods for trajectory modeling, we expose two common critical drawbacks in the existing uses. First, RNNs are discrete-time models that only update the hidden states upon the arrival of new observations, which makes them an awkward fit for learning real-world trajectories with continuous-time dynamics. Second, real-world trajectories are never perfectly accurate due to unexpected sensor noise. Most RNN-based approaches are deterministic and thereby vulnerable to such noise. To tackle these challenges, we devise a novel method entitled TrajODE for more natural modeling of trajectories. It combines the continuous-time characteristic of Neural Ordinary Differential Equations (ODE) with the robustness of stochastic latent spaces. Extensive experiments on the task of trajectory classification demonstrate the superiority of our framework against the RNN counterparts.

[1]  Wei-Ying Ma,et al.  Understanding mobility based on GPS data , 2008, UbiComp.

[2]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[3]  David Duvenaud,et al.  Latent Ordinary Differential Equations for Irregularly-Sampled Time Series , 2019, NeurIPS.

[4]  Ickjai Lee,et al.  End-to-end trajectory transportation mode classification using Bi-LSTM recurrent neural network , 2017, 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Edward De Brouwer,et al.  GRU-ODE-Bayes: Continuous modeling of sporadically-observed time series , 2019, NeurIPS.

[7]  Ying Tan,et al.  Variational Autoencoder for Semi-Supervised Text Classification , 2017, AAAI.

[8]  Shakir Mohamed,et al.  Variational Inference with Normalizing Flows , 2015, ICML.

[9]  Mathias Lechner,et al.  Learning Long-Term Dependencies in Irregularly-Sampled Time Series , 2020, NeurIPS.

[10]  Yu Zheng,et al.  Inferring Traffic Cascading Patterns , 2017, SIGSPATIAL/GIS.

[11]  Weiwei Sun,et al.  Modeling Trajectories with Recurrent Neural Networks , 2017, IJCAI.

[12]  Deng Cai,et al.  What to Do Next: Modeling User Behaviors by Time-LSTM , 2017, IJCAI.

[13]  Fang Zhao,et al.  Toward Transportation Mode Recognition Using Deep Convolutional and Long Short-Term Memory Recurrent Neural Networks , 2019, IEEE Access.

[14]  Xing Xie,et al.  GeoLife: A Collaborative Social Networking Service among User, Location and Trajectory , 2010, IEEE Data Eng. Bull..

[15]  Roger Zimmermann,et al.  Grab-Posisi: An Extensive Real-Life GPS Trajectory Dataset in Southeast Asia , 2019, PredictGIS@SIGSPATIAL.

[16]  Cheng Long,et al.  Learning to Generate Maps from Trajectories , 2020, AAAI.

[17]  Ickjai Lee,et al.  Spatio-Temporal GRU for Trajectory Classification , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[18]  Yang Feng,et al.  Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications , 2018, WWW.

[19]  Xing Xie,et al.  Learning transportation mode from raw gps data for geographic applications on the web , 2008, WWW.

[20]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[21]  Yan Liu,et al.  Recurrent Neural Networks for Multivariate Time Series with Missing Values , 2016, Scientific Reports.

[22]  Kunpeng Zhang,et al.  Forecasting the Evolution of Hydropower Generation , 2020, KDD.