Modeling Trajectories with Multi-task Learning

With the increasing popularity of GPS modules, there are various urban applications relying on trajectory data modeling. In this work, we study the problem to model the vehicle trajectories by predicting the next road segment given a partial trajectory. Existing methods that model trajectories with Markov chain or recurrent neural network suffer from issues of modeling, context and semantics. In this paper, we propose a new trajectory modeling framework called Multi-task Modeling for Trajectories (MMTraj), which avoids these issues. Specifically, MMTraj uses multi-head self-attention networks for sequential modeling, captures the overall road network as the context information for road segment embedding, and performs an auxiliary task of predicting the trajectory destination to better guide the main trajectory modeling task (controlled by a carefully designed gating mechanism). Extensive experiments conducted on real-world datasets demonstrate the superiority of the proposed method over the baseline methods.

[1]  Zhifeng Bao,et al.  Robust Road Network Representation Learning: When Traffic Patterns Meet Traveling Semantics , 2021, CIKM.

[2]  Jie Bao,et al.  MTrajRec: Map-Constrained Trajectory Recovery via Seq2Seq Multi-task Learning , 2021, KDD.

[3]  Cheng Long,et al.  Generating Full Spatiotemporal Vehicular Paths: A Data Fusion Approach , 2020, CIKM.

[4]  Haifeng Wang,et al.  ConSTGAT: Contextual Spatial-Temporal Graph Attention Network for Travel Time Estimation at Baidu Maps , 2020, KDD.

[5]  Jingyuan Wang,et al.  Learning Effective Road Network Representation with Hierarchical Graph Neural Networks , 2020, KDD.

[6]  Rui Jiang,et al.  Trajectory data-based traffic flow studies: A revisit , 2020 .

[7]  Christian S. Jensen,et al.  Graph Convolutional Networks for Road Networks , 2019, SIGSPATIAL/GIS.

[8]  Harris Georgiou,et al.  Semantic-aware aircraft trajectory prediction using flight plans , 2019, International Journal of Data Science and Analytics.

[9]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[10]  Yansong Feng,et al.  Graph2Seq: Graph to Sequence Learning with Attention-based Neural Networks , 2018, ArXiv.

[11]  Xin Wang,et al.  Personalized travel route recommendation using collaborative filtering based on GPS trajectories , 2018, Int. J. Digit. Earth.

[12]  Weiwei Sun,et al.  Modeling Trajectories with Recurrent Neural Networks , 2017, IJCAI.

[13]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[14]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[15]  Weiwei Sun,et al.  Probabilistic Robust Route Recovery with Spatio-Temporal Dynamics , 2016, KDD.

[16]  Geoffrey E. Hinton,et al.  Layer Normalization , 2016, ArXiv.

[17]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Anind K. Dey,et al.  Modeling and Understanding Human Routine Behavior , 2016, CHI.

[19]  Lionel M. Ni,et al.  Modeling heterogeneous routing decisions in trajectories for driving experience learning , 2014, UbiComp.

[20]  Vinay Kolar,et al.  Map matching: facts and myths , 2013, SIGSPATIAL/GIS.

[21]  Xuan Song,et al.  Modeling and probabilistic reasoning of population evacuation during large-scale disaster , 2013, KDD.

[22]  Alex Graves Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[23]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[24]  John Krumm,et al.  Hidden Markov map matching through noise and sparseness , 2009, GIS.

[25]  Qing Liu,et al.  A Hybrid Prediction Model for Moving Objects , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[26]  Eyal Amir,et al.  Bayesian Inverse Reinforcement Learning , 2007, IJCAI.

[27]  R. R. Joshi,et al.  A new approach to map matching for in-vehicle navigation systems: the rotational variation metric , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[28]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[29]  Xing Xie,et al.  T-Drive: Enhancing Driving Directions with Taxi Drivers' Intelligence , 2013, IEEE Transactions on Knowledge and Data Engineering.

[30]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .