The Devil is in the Details: An Efficient Convolutional Neural Network for Transport Mode Detection

Transport mode detection is a classification problem aiming to design an algorithm that can infer the transport mode of a user given multimodal signals (GPS and/or inertial sensors). It has many applications, such as carbon footprint tracking, mobility behaviour analysis, or real-time door-to-door smart planning. Most current approaches rely on a classification step using Machine Learning techniques, and, like in many other classification problems, deep learning approaches usually achieve better results than traditional machine learning ones using handcrafted features. Deep models, however, have a notable downside: they are usually heavy, both in terms of memory space and processing cost. We show that a small, optimized model can perform as well as a current deep model. During our experiments on the GeoLife and SHL 2018 datasets, we obtain models with tens of thousands of parameters, that is, 10 to 1,000 times less parameters and operations than networks from the state of the art, which still reach a comparable performance. We also show, using the aforementioned datasets, that the current preprocessing used to deal with signals of different lengths is suboptimal, and we provide better replacements. Finally, we introduce a way to use signals with different lengths with the lighter Convolutional neural networks, without using the heavier Recurrent Neural Networks.

[1]  Xing Xie,et al.  Learning transportation mode from raw gps data for geographic applications on the web , 2008, WWW.

[2]  Xiaoshuai Sun,et al.  Two-Stream 3-D convNet Fusion for Action Recognition in Videos With Arbitrary Size and Length , 2018, IEEE Transactions on Multimedia.

[3]  Robert Weibel,et al.  Revealing the physics of movement: Comparing the similarity of movement characteristics of different types of moving objects , 2009, Comput. Environ. Urban Syst..

[4]  Peter Widhalm,et al.  Top in the Lab, Flop in the Field?: Evaluation of a Sensor-based Travel Activity Classifier with the SHL Dataset , 2018, UbiComp/ISWC Adjunct.

[5]  Fei Su,et al.  A Method of Traffic Travel Status Segmentation Based on Position Trajectories , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[6]  Yang Wang,et al.  Identifying Different Transportation Modes from Trajectory Data Using Tree-Based Ensemble Classifiers , 2017, ISPRS Int. J. Geo Inf..

[7]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[8]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Di Wu,et al.  LSTM Learning With Bayesian and Gaussian Processing for Anomaly Detection in Industrial IoT , 2020, IEEE Transactions on Industrial Informatics.

[10]  Ickjai Lee,et al.  End-to-end trajectory transportation mode classification using Bi-LSTM recurrent neural network , 2017, 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE).

[11]  Hao Wang,et al.  Detecting Transportation Modes Using Deep Neural Network , 2017, IEICE Trans. Inf. Syst..

[12]  Chen Wang,et al.  Classifying transportation mode and speed from trajectory data via deep multi-scale learning , 2019, Comput. Networks.

[13]  Masaki Shuzo,et al.  Application of CNN for Human Activity Recognition with FFT Spectrogram of Acceleration and Gyro Sensors , 2018, UbiComp/ISWC Adjunct.

[14]  Stephan Clemencon,et al.  Transport Mode Detection when Fine-grained and Coarse-grained Data Meet , 2018, 2018 3rd IEEE International Conference on Intelligent Transportation Engineering (ICITE).

[15]  Ronan Sicre,et al.  Particular object retrieval with integral max-pooling of CNN activations , 2015, ICLR.

[16]  Zhu Xiao,et al.  Exploring Individual Travel Patterns Across Private Car Trajectory Data , 2020, IEEE Transactions on Intelligent Transportation Systems.

[17]  Lin Wang,et al.  Summary of the Sussex-Huawei Locomotion-Transportation Recognition Challenge , 2018, UbiComp/ISWC Adjunct.

[18]  Yuki Endo,et al.  Classifying spatial trajectories using representation learning , 2016, International Journal of Data Science and Analytics.

[19]  Wei-Ying Ma,et al.  Understanding mobility based on GPS data , 2008, UbiComp.

[20]  Elmar Brockfeld,et al.  Evaluation of a transport mode detection using fuzzy rules , 2017 .

[21]  James J. Q. Yu,et al.  Travel Mode Identification With GPS Trajectories Using Wavelet Transform and Deep Learning , 2021, IEEE Transactions on Intelligent Transportation Systems.

[22]  P. Fearnhead,et al.  Optimal detection of changepoints with a linear computational cost , 2011, 1101.1438.

[23]  Mohammad Etemad,et al.  Transportation Modes Classification Using Feature Engineering , 2018, ArXiv.

[24]  Shigeng Zhang,et al.  Towards Real-time Cooperative Deep Inference over the Cloud and Edge End Devices , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[25]  Mohsen Rezaie,et al.  Knowledge inference from smartphone GPS data , 2018 .

[26]  Xing Xie,et al.  Understanding transportation modes based on GPS data for web applications , 2010, TWEB.

[27]  Norbert Brändle,et al.  Supporting large-scale travel surveys with smartphones – A practical approach , 2014 .

[28]  Kevin Heaslip,et al.  Inferring transportation modes from GPS trajectories using a convolutional neural network , 2018, ArXiv.

[29]  Shangguang Wang,et al.  Learning Transportation Annotated Mobility Profiles from GPS Data for Context-Aware Mobile Services , 2016, 2016 IEEE International Conference on Services Computing (SCC).

[30]  Andrei Lobov,et al.  Travel mode estimation for multi-modal journey planner , 2017 .

[31]  Chandan K. Reddy,et al.  Semi-Supervised Deep Learning Approach for Transportation Mode Identification Using GPS Trajectory Data , 2020, IEEE Transactions on Knowledge and Data Engineering.

[32]  Albert-László Barabási,et al.  Understanding individual human mobility patterns , 2008, Nature.

[33]  Albert-László Barabási,et al.  Limits of Predictability in Human Mobility , 2010, Science.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Xing Xie,et al.  Mining interesting locations and travel sequences from GPS trajectories , 2009, WWW '09.

[36]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[37]  Sidharta Gautama,et al.  A methodology for train trip identification in mobility campaigns based on smart-phones , 2017, 2017 IEEE First Summer School on Smart Cities (S3C).