Spatiotemporal Capsule Neural Network for Vehicle Trajectory Prediction

Through advancement of the Vehicle-to-Everything (V2X) network, road safety, energy consumption, and traffic efficiency can be significantly improved. An accurate vehicle trajectory prediction benefits communication traffic management and network resource allocation for the real-time application of the V2X network. Recurrent neural networks and their variants have been reported in recent research to predict vehicle mobility. However, the spatial attribute of vehicle movement behavior has been overlooked, resulting in incomplete information utilization. To bridge this gap, we put forward for the first time a hierarchical trajectory prediction structure using the capsule neural network (CapsNet) with three sequential components. First, the geographic information is transformed into a grid map presentation, describing vehicle mobility distribution spatially and temporally. Second, CapsNet serves as the core model to embed local temporal and global spatial correlation through hierarchical capsules. Finally, extensive experiments conducted on actual taxi mobility data collected in Porto city (Portugal) and Singapore show that the proposed method outperforms the state-of-the-art methods.

[1]  Xiaoli Li,et al.  Slow-Varying Dynamics-Assisted Temporal Capsule Network for Machinery Remaining Useful Life Estimation , 2022, IEEE Transactions on Cybernetics.

[2]  D. F. Llorca,et al.  Vehicle trajectory prediction on highways using bird eye view representations and deep learning , 2022, Applied Intelligence.

[3]  Wali Ullah Khan,et al.  Task Offloading and Resource Allocation for IoV Using 5G NR-V2X Communication , 2022, IEEE Internet of Things Journal.

[4]  T. Luan,et al.  Collaborative Driving: Learning-Aided Joint Topology Formulation and Beamforming , 2022, IEEE Vehicular Technology Magazine.

[5]  Keqiang Li,et al.  A probabilistic architecture of long-term vehicle trajectory prediction for autonomous driving , 2022, Engineering.

[6]  Wayes Tushar,et al.  IIoT-Enabled Health Monitoring for Integrated Heat Pump System Using Mixture Slow Feature Analysis , 2021, IEEE Transactions on Industrial Informatics.

[7]  Omar Y. Al-Jarrah,et al.  Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review , 2019, ArXiv.

[8]  Bo Li,et al.  Mobility-aware dynamic offloading strategy for C-V2X under multi-access edge computing , 2021, Phys. Commun..

[9]  Chau Yuen,et al.  Lithium-ion Battery State of Health Estimation based on Cycle Synchronization using Dynamic Time Warping , 2021, IECON 2021 – 47th Annual Conference of the IEEE Industrial Electronics Society.

[10]  W. Zhuang,et al.  Learning-Based Computing Task Offloading for Autonomous Driving: A Load Balancing Perspective , 2021, ICC 2021 - IEEE International Conference on Communications.

[11]  Rodolfo Oliveira,et al.  Vehicle Trajectory Prediction based on LSTM Recurrent Neural Networks , 2021, 2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring).

[12]  Chau Yuen,et al.  Intelligent Spectrum Learning for Wireless Networks With Reconfigurable Intelligent Surfaces , 2021, IEEE Transactions on Vehicular Technology.

[13]  Yan Qin,et al.  Transfer Learning-Based State of Charge Estimation for Lithium-Ion Battery at Varying Ambient Temperatures , 2021, IEEE Transactions on Industrial Informatics.

[14]  Yan Qin,et al.  Time-Series Regeneration With Convolutional Recurrent Generative Adversarial Network for Remaining Useful Life Estimation , 2021, IEEE Transactions on Industrial Informatics.

[15]  Bo Yang,et al.  Edge Intelligence for Autonomous Driving in 6G Wireless System: Design Challenges and Solutions , 2020, IEEE Wireless Communications.

[16]  Anuradha Bhamidipaty,et al.  A Transformer-based Framework for Multivariate Time Series Representation Learning , 2020, KDD.

[17]  Chau Yuen,et al.  Intelligent Task Offloading for Heterogeneous V2X Communications , 2020, IEEE Transactions on Intelligent Transportation Systems.

[18]  Mauro Conti,et al.  Privacy for 5G-Supported Vehicular Networks , 2021, IEEE Open Journal of the Communications Society.

[19]  Rodolfo Oliveira,et al.  A Comparative Evaluation of Probabilistic and Deep Learning Approaches for Vehicular Trajectory Prediction , 2021, IEEE Open Journal of Vehicular Technology.

[20]  Rodolfo Oliveira,et al.  An Adaptive Learning-Based Approach for Vehicle Mobility Prediction , 2021, IEEE Access.

[21]  Wei Liu,et al.  Vehicle-Assisted Data Delivery in Smart City: A Deep Learning Approach , 2020, IEEE Transactions on Vehicular Technology.

[22]  Yong Liang Guan,et al.  Communication and Computing Resource Optimization for Connected Autonomous Driving , 2020, IEEE Transactions on Vehicular Technology.

[23]  Sibin Mohan,et al.  Securing Vehicle-to-Everything (V2X) Communication Platforms , 2020, IEEE Transactions on Intelligent Vehicles.

[24]  Nazanin Rahnavard,et al.  Subspace Capsule Network , 2020, AAAI.

[25]  Li-Chun Wang,et al.  Mobility Predictions for IoT Devices Using Gated Recurrent Unit Network , 2020, IEEE Internet of Things Journal.

[26]  Enrique López Droguett,et al.  A novel deep capsule neural network for remaining useful life estimation , 2020, Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability.

[27]  Roger Zimmermann,et al.  Grab-Posisi: An Extensive Real-Life GPS Trajectory Dataset in Southeast Asia , 2019, PredictGIS@SIGSPATIAL.

[28]  Miaowen Wen,et al.  MBID: Micro-Blockchain-Based Geographical Dynamic Intrusion Detection for V2X , 2019, IEEE Communications Magazine.

[29]  Wei Liu,et al.  Edge-Assisted Vehicle Mobility Prediction to Support V2X Communications , 2019, IEEE Transactions on Vehicular Technology.

[30]  Hwasoo Yeo,et al.  Attention-based Recurrent Neural Network for Urban Vehicle Trajectory Prediction , 2018, ANT/EDI40.

[31]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[32]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[33]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[34]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[35]  Steven E. Shladover,et al.  Potential Cyberattacks on Automated Vehicles , 2015, IEEE Transactions on Intelligent Transportation Systems.

[36]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[37]  Bo Li,et al.  Trajectory Improves Data Delivery in Urban Vehicular Networks , 2014, IEEE Transactions on Parallel and Distributed Systems.

[38]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.