Semi-Supervised Deep Learning Approach for Transportation Mode Identification Using GPS Trajectory Data

Identification of travelers’ transportation modes is a fundamental step for various problems that arise in the domain of transportation such as travel demand analysis, transport planning, and traffic management. In this paper, we aim to identify travelers’ transportation modes purely based on their GPS trajectories. First, a segmentation process is developed to partition a user's trip into GPS segments with only one transportation mode. A majority of studies have proposed mode inference models based on hand-crafted features, which might be vulnerable to traffic and environmental conditions. Furthermore, the classification task in almost all models have been performed in a supervised fashion while a large amount of unlabeled GPS trajectories has remained unused. Accordingly, we propose a deep SEmi-Supervised Convolutional Autoencoder (SECA) architecture that can not only automatically extract relevant features from GPS segments but also exploit useful information in unlabeled data. The SECA integrates a convolutional-deconvolutional autoencoder and a convolutional neural network into a unified framework to concurrently perform supervised and unsupervised learning. The two components are simultaneously trained using both labeled and unlabeled GPS segments, which have already been converted into an efficient representation for the convolutional operation. An optimum schedule for varying the balancing parameters between reconstruction and classification errors are also implemented. The performance of the proposed SECA model, trip segmentation, the method for converting a raw trajectory into a new representation, the hyperparameter schedule, and the model configuration are evaluated by comparing to several baselines and alternatives for various amounts of labeled and unlabeled data. Our experimental results demonstrate the superiority of the proposed model over the state-of-the-art semi-supervised and supervised methods with respect to metrics such as accuracy and F-measure.

[1]  Kevin Heaslip,et al.  Developing a Twitter-based traffic event detection model using deep learning architectures , 2019, Expert Syst. Appl..

[2]  Kevin Heaslip,et al.  Inferring transportation modes from GPS trajectories using a convolutional neural network , 2018, ArXiv.

[3]  Kevin Heaslip,et al.  Transport-domain applications of widely used data sources in the smart transportation: A survey , 2018, ArXiv.

[4]  Nicolas Vayatis,et al.  A review of change point detection methods , 2018, ArXiv.

[5]  Wen-Chih Peng,et al.  Public Transportation Mode Detection from Cellular Data , 2017, CIKM.

[6]  Zhezhuang Xu,et al.  Learning Transportation Modes From Smartphone Sensors Based on Deep Neural Network , 2017, IEEE Sensors Journal.

[7]  Jia Yuan Yu,et al.  Semi-Supervised travel mode detection from smartphone data , 2017, 2017 International Smart Cities Conference (ISC2).

[8]  Andrei Lobov,et al.  Travel mode estimation for multi-modal journey planner , 2017 .

[9]  Weiwei Sun,et al.  Modeling Trajectories with Recurrent Neural Networks , 2017, IJCAI.

[10]  Kerry Cullen Parts , 2017 .

[11]  Guoyin Wang,et al.  Deconvolutional Paragraph Representation Learning , 2017, NIPS.

[12]  Chao Zhang,et al.  Trajectory clustering via deep representation learning , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[13]  Hao Wang,et al.  Detecting Transportation Modes Using Deep Neural Network , 2017, IEICE Trans. Inf. Syst..

[14]  Yang Wang,et al.  Identifying Different Transportation Modes from Trajectory Data Using Tree-Based Ensemble Classifiers , 2017, ISPRS Int. J. Geo Inf..

[15]  Linlin Wu,et al.  Travel Mode Detection Based on GPS Raw Data Collected by Smartphones: A Systematic Review of the Existing Methodologies , 2016, Inf..

[16]  Yuki Endo,et al.  Deep Feature Extraction from Trajectories for Transportation Mode Estimation , 2016, PAKDD.

[17]  Tong Zhang,et al.  Supervised and Semi-Supervised Text Categorization using LSTM for Region Embeddings , 2016, ICML.

[18]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[21]  Jeffrey Pennington,et al.  Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions , 2011, EMNLP.

[22]  Wei-Ying Ma,et al.  Geolife GPS trajectory dataset - User Guide , 2011 .

[23]  P. Fearnhead,et al.  Optimal detection of changepoints with a linear computational cost , 2011, 1101.1438.

[24]  Xavier Glorot,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[26]  Wei-Ying Ma,et al.  Understanding mobility based on GPS data , 2008, UbiComp.

[27]  Marc'Aurelio Ranzato,et al.  Semi-supervised learning of compact document representations with deep networks , 2008, ICML '08.

[28]  Xing Xie,et al.  Learning transportation mode from raw gps data for geographic applications on the web , 2008, WWW.

[29]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[30]  Tak-Chung Fu,et al.  An evolutionary approach to pattern-based time series segmentation , 2004, IEEE Transactions on Evolutionary Computation.

[31]  T. Vincenty DIRECT AND INVERSE SOLUTIONS OF GEODESICS ON THE ELLIPSOID WITH APPLICATION OF NESTED EQUATIONS , 1975 .

[32]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[33]  A. Várhelyi,et al.  Development of a method for detecting jerks in safety critical events. , 2013, Accident; analysis and prevention.

[34]  Dong-Hyun Lee,et al.  Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks , 2013 .