Clustering Noisy Trajectories via Robust Deep Attention Auto-Encoders

Trajectory clustering aims at grouping similar trajectories into one cluster. It is an efficient way of finding the representative path or common trend shared by different moving objects, and also provides a foundation for movement pattern mining, anomaly detection and other applications. Existing trajectory clustering studies mainly rely on feature selection and similarity measurement based on their geographical and spatial properties. However, one obstacle hindering their wide usage is the problem of clustering accuracy in the presence of noisy or incomplete sensing data, due to limited sensory device quantity, communication errors, sensor failures, and sensor vacancy. This paper proposes an error-tolerant trajectory clustering approach by incorporating denoising methods.We propose the Robust Deep Attention Auto-encoders model (called Robust DAA) to learn the representations of low-dimensional denoising trajectories with three novel features. First, we present the deep attention auto-encoders by integrating the attention mechanism into the classical deep auto-encoder, which is capable of enhancing feature propagation and feature selection. Second, we train the deep attention auto-encoder by applying proximal method, back propagation and the Alternating Direction of Method of Multipliers (ADMM). As a result, our Robust DAA can reduce the negative influence of the noise on trajectory data. Finally, we perform clustering over the low-dimensional denoising representations using traditional clustering algorithms and demonstrates the quality of the clustering results by comparing our approach with existing representative methods. Extensive experiments are conducted on both synthetic datasets and real datasets. The results show that our approach outperforms the existing models in terms of accuracy, precision, recall and f1-score.

[1]  Wei-Ying Ma,et al.  Understanding mobility based on GPS data , 2008, UbiComp.

[2]  Keqin Li,et al.  GOI: A Novel Design for Vehicle Positioning and Trajectory Prediction Under Urban Environments , 2018, IEEE Sensors Journal.

[3]  Jae-Gil Lee,et al.  Incremental Clustering for Trajectories , 2010, DASFAA.

[4]  Wei Zhang,et al.  PRED: Periodic Region Detection for Mobility Modeling of Social Media Users , 2017, WSDM.

[5]  Jean-Michel Loubes,et al.  Review and Perspective for Distance Based Trajectory Clustering , 2015, ArXiv.

[6]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[7]  Yuki Endo,et al.  Deep Feature Extraction from Trajectories for Transportation Mode Estimation , 2016, PAKDD.

[8]  Ling Liu,et al.  NEAT: Road Network Aware Trajectory Clustering , 2012, 2012 IEEE 32nd International Conference on Distributed Computing Systems.

[9]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[10]  Zhongfei Zhang,et al.  Semisupervised Autoencoder for Sentiment Analysis , 2015, AAAI.

[11]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Yu Zheng,et al.  Trajectory Data Mining , 2015, ACM Trans. Intell. Syst. Technol..

[13]  Jae-Gil Lee,et al.  Trajectory clustering: a partition-and-group framework , 2007, SIGMOD '07.

[14]  Vania Bogorny,et al.  A clustering-based approach for discovering interesting places in trajectories , 2008, SAC '08.

[15]  Xing Xie,et al.  Learning transportation mode from raw gps data for geographic applications on the web , 2008, WWW.

[16]  Sebastian Nowozin,et al.  Multi-Level Variational Autoencoder: Learning Disentangled Representations from Grouped Observations , 2017, AAAI.

[17]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[18]  Jie Zhao,et al.  A review of moving object trajectory clustering algorithms , 2016, Artificial Intelligence Review.

[19]  Randy C. Paffenroth,et al.  Anomaly Detection with Robust Deep Autoencoders , 2017, KDD.

[20]  Xing Xie,et al.  Understanding transportation modes based on GPS data for web applications , 2010, TWEB.

[21]  Lidan Shou,et al.  Splitter: Mining Fine-Grained Sequential Patterns in Semantic Trajectories , 2014, Proc. VLDB Endow..

[22]  Chao Zhang,et al.  Trajectory clustering via deep representation learning , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[23]  Wang-Chien Lee,et al.  Clustering and aggregating clues of trajectories for mining trajectory patterns and routes , 2015, The VLDB Journal.

[24]  Dit-Yan Yeung,et al.  Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks , 2016, NIPS.

[25]  Charu C. Aggarwal,et al.  Learning Deep Network Representations with Adversarially Regularized Autoencoders , 2018, KDD.

[26]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[27]  Jiannong Cao,et al.  Recover Corrupted Data in Sensor Networks: A Matrix Completion Solution , 2017, IEEE Transactions on Mobile Computing.

[28]  Yun He,et al.  A Density-Based Clustering Algorithm with Sampling for Travel Behavior Analysis , 2016, IDEAL.

[29]  Licia Capra,et al.  Urban Computing: Concepts, Methodologies, and Applications , 2014, TIST.

[30]  Dustin Tran,et al.  Image Transformer , 2018, ICML.

[31]  Karen Simonyan,et al.  Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders , 2017, ICML.

[32]  Wei Cao,et al.  When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks , 2018, AAAI.

[33]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.