Semi-Supervised Deep Learning Approach for Transportation Mode Identification Using GPS Trajectory Data

Identification of travelers’ transportation modes is a fundamental step for various problems that arise in the domain of transportation such as travel demand analysis, transport planning, and traffic management. In this paper, we aim to identify travelers’ transportation modes purely based on their GPS trajectories. First, a segmentation process is developed to partition a user's trip into GPS segments with only one transportation mode. A majority of studies have proposed mode inference models based on hand-crafted features, which might be vulnerable to traffic and environmental conditions. Furthermore, the classification task in almost all models have been performed in a supervised fashion while a large amount of unlabeled GPS trajectories has remained unused. Accordingly, we propose a deep SEmi-Supervised Convolutional Autoencoder (SECA) architecture that can not only automatically extract relevant features from GPS segments but also exploit useful information in unlabeled data. The SECA integrates a convolutional-deconvolutional autoencoder and a convolutional neural network into a unified framework to concurrently perform supervised and unsupervised learning. The two components are simultaneously trained using both labeled and unlabeled GPS segments, which have already been converted into an efficient representation for the convolutional operation. An optimum schedule for varying the balancing parameters between reconstruction and classification errors are also implemented. The performance of the proposed SECA model, trip segmentation, the method for converting a raw trajectory into a new representation, the hyperparameter schedule, and the model configuration are evaluated by comparing to several baselines and alternatives for various amounts of labeled and unlabeled data. Our experimental results demonstrate the superiority of the proposed model over the state-of-the-art semi-supervised and supervised methods with respect to metrics such as accuracy and F-measure.

[1]  Ahmed El-Geneidy,et al.  Travel mode choice and transit route choice behavior in Montreal: insights from McGill University members commute patterns , 2012, Public Transp..

[2]  Kevin Heaslip,et al.  Transport-domain applications of widely used data sources in the smart transportation: A survey , 2018, ArXiv.

[3]  Nicolas Vayatis,et al.  A review of change point detection methods , 2018, ArXiv.

[4]  Tak-Chung Fu,et al.  An evolutionary approach to pattern-based time series segmentation , 2004, IEEE Transactions on Evolutionary Computation.

[5]  Marc'Aurelio Ranzato,et al.  Semi-supervised learning of compact document representations with deep networks , 2008, ICML '08.

[6]  Jia Yuan Yu,et al.  Semi-Supervised travel mode detection from smartphone data , 2017, 2017 International Smart Cities Conference (ISC2).

[7]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[8]  Tong Zhang,et al.  Supervised and Semi-Supervised Text Categorization using LSTM for Region Embeddings , 2016, ICML.

[9]  Ramayya Krishnan,et al.  Fraud Detection From Taxis' Driving Behaviors , 2014, IEEE Transactions on Vehicular Technology.

[10]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[11]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[12]  Kevin Heaslip,et al.  Inferring transportation modes from GPS trajectories using a convolutional neural network , 2018, ArXiv.

[13]  Linlin Wu,et al.  Travel Mode Detection Based on GPS Raw Data Collected by Smartphones: A Systematic Review of the Existing Methodologies , 2016, Inf..

[14]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[15]  Ilias N. Tziavos,et al.  Applications of GPS technology in the land transportation system , 2004, Eur. J. Oper. Res..

[16]  Andrei Lobov,et al.  Travel mode estimation for multi-modal journey planner , 2017 .

[17]  Yoshua Bengio,et al.  Semi-supervised Learning by Entropy Minimization , 2004, CAP.

[18]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[19]  Huachun Tan,et al.  Short-term traffic flow forecasting with spatial-temporal correlation in a hybrid deep learning framework , 2016, ArXiv.

[20]  Kevin Heaslip,et al.  Developing a Twitter-based traffic event detection model using deep learning architectures , 2019, Expert Syst. Appl..

[21]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[22]  Wen-Chih Peng,et al.  Public Transportation Mode Detection from Cellular Data , 2017, CIKM.

[23]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[24]  Jeffrey Pennington,et al.  Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions , 2011, EMNLP.

[25]  Yuki Endo,et al.  Deep Feature Extraction from Trajectories for Transportation Mode Estimation , 2016, PAKDD.

[26]  Hao Wang,et al.  Detecting Transportation Modes Using Deep Neural Network , 2017, IEICE Trans. Inf. Syst..

[27]  Chao Zhang,et al.  Trajectory clustering via deep representation learning , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[28]  Wei-Ying Ma,et al.  Geolife GPS trajectory dataset - User Guide , 2011 .

[29]  Dong-Hyun Lee,et al.  Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks , 2013 .

[30]  Xing Xie,et al.  Learning transportation mode from raw gps data for geographic applications on the web , 2008, WWW.

[31]  Wei-Ying Ma,et al.  Understanding mobility based on GPS data , 2008, UbiComp.

[32]  Guoyin Wang,et al.  Deconvolutional Paragraph Representation Learning , 2017, NIPS.

[33]  Zhezhuang Xu,et al.  Learning Transportation Modes From Smartphone Sensors Based on Deep Neural Network , 2017, IEEE Sensors Journal.

[34]  Omar Bagdadi,et al.  Development of a method for detecting jerks in safety critical events. , 2013, Accident; analysis and prevention.

[35]  Yang Wang,et al.  Identifying Different Transportation Modes from Trajectory Data Using Tree-Based Ensemble Classifiers , 2017, ISPRS Int. J. Geo Inf..

[36]  Weiwei Sun,et al.  Modeling Trajectories with Recurrent Neural Networks , 2017, IJCAI.

[37]  P. Fearnhead,et al.  Optimal detection of changepoints with a linear computational cost , 2011, 1101.1438.

[38]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[39]  Wen-Jing Hsu,et al.  Mining GPS data for mobility patterns: A survey , 2014, Pervasive Mob. Comput..

[40]  T. Vincenty DIRECT AND INVERSE SOLUTIONS OF GEODESICS ON THE ELLIPSOID WITH APPLICATION OF NESTED EQUATIONS , 1975 .

[41]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[42]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[43]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..