Motion trajectory prediction based on a CNN-LSTM sequential model

Accurate monitoring the surrounding environment is an important research direction in the field of unmanned systems such as bio-robotics, and has attracted much research attention in recent years. The trajectories of surrounding vehicles should be predicted accurately in space and time to realize active defense and running safety of an unmanned system. However, there is uncertainty and uncontrollability in the process of trajectory prediction of surrounding obstacles. In this study, we propose a trajectory prediction method based on a sequential model, that fuses two neural networks of a convolutional neural network (CNN) and a long short-term memory network (LSTM). First, a box plot is used to detect and eliminate abnormal values of vehicle trajectories, and valid trajectory data are obtained. Second, the trajectories of surrounding vehicles are predicted by merging the characteristics of CNN space expansion and LSTM time expansion; the hyper-parameters of the model are optimized according to a grid search algorithm, which satisfies the double-precision prediction requirement in space and time. Finally, data from next generation simulation (NGSIM) and Creteil roundabout in France are taken as test cases; the correctness and rationality of the method are verified by prediction error indicators. Experimental results demonstrate that the proposed CNN-LSTM method is more accurate and features a shorter time cost, which meets the prediction requirements and provides an effective method for the safe operation of unmanned systems.

[1]  Mohan M. Trivedi,et al.  Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[2]  Yuan Cao,et al.  Storage Aided System Property Enhancing and Hybrid Robust Smoothing for Large-Scale PV Systems , 2017, IEEE Transactions on Smart Grid.

[3]  Jiqiang Liu,et al.  Assessing Optimizer Impact on DNN Model Sensitivity to Adversarial Examples , 2019, IEEE Access.

[4]  Chunhui Zhao,et al.  A Fine-Grained Adversarial Network Method for Cross-Domain Industrial Fault Diagnosis , 2020, IEEE Transactions on Automation Science and Engineering.

[5]  Chung Choo Chung,et al.  Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecture , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[6]  K. Kinzler,et al.  14-3-3σ is required to prevent mitotic catastrophe after DNA damage , 1999, Nature.

[7]  Véronique Berge-Cherfaoui,et al.  Vehicle trajectory prediction based on motion model and maneuver recognition , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Chung Choo Chung,et al.  Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[11]  Yuan Cao,et al.  Application of fuzzy predictive control technology in automatic train operation , 2018, Cluster Computing.

[12]  Wu Pei-ju Trajectory prediction method for high precision servo control system , 2014 .

[13]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[14]  Wei He,et al.  Adaptive Fuzzy Neural Network Control for a Constrained Robot Using Impedance Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Florent Altché,et al.  An LSTM network for highway trajectory prediction , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[16]  Junzhi Yu,et al.  Development and path planning of a novel unmanned surface vehicle system and its application to exploitation of Qarhan Salt Lake , 2018, Science China Information Sciences.

[17]  Shasha Li,et al.  A motion simulation model for road network based crowdsourced map datum , 2020, J. Intell. Fuzzy Syst..

[18]  Jing Yang,et al.  An improved deep network for intelligent diagnosis of machinery faults with similar features , 2019, IEEJ Transactions on Electrical and Electronic Engineering.

[19]  M. Treiber,et al.  Estimating Acceleration and Lane-Changing Dynamics Based on NGSIM Trajectory Data , 2007 .

[20]  Yuan Cao,et al.  Research on dynamic nonlinear input prediction of fault diagnosis based on fractional differential operator equation in high-speed train control system. , 2019, Chaos.

[21]  Guo Xie,et al.  Fault Diagnosis of Train Plug Door Based on a Hybrid Criterion for IMFs Selection and Fractional Wavelet Package Energy Entropy , 2019, IEEE Transactions on Vehicular Technology.

[22]  Yu Liu,et al.  Challenges and countermeasures of interaction in autonomous vehicles , 2018, Science China Information Sciences.

[23]  Kaixiang Peng,et al.  Adaptive Neural Control for Robotic Manipulators With Output Constraints and Uncertainties , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Xin Li,et al.  Estimating the Probability Density Function of Remaining Useful Life for Wiener Degradation Process with Uncertain Parameters , 2019, International Journal of Control, Automation and Systems.

[25]  M. Treiber,et al.  Estimating Acceleration and Lane-Changing Dynamics from Next Generation Simulation Trajectory Data , 2008, 0804.0108.

[26]  Louis Alberto Gutierrez Trajectory Prediction Algorithm Based on Gaussian Mixture Model , 2015 .

[27]  Shaojie Qiao,et al.  A Self-Adaptive Parameter Selection Trajectory Prediction Approach via Hidden Markov Models , 2015, IEEE Transactions on Intelligent Transportation Systems.

[28]  Chunhui Zhao,et al.  Online Fault Diagnosis for Industrial Processes With Bayesian Network-Based Probabilistic Ensemble Learning Strategy , 2019, IEEE Transactions on Automation Science and Engineering.

[29]  Xin Li,et al.  Remaining useful life prediction of lithium‐ion battery based on an improved particle filter algorithm , 2020 .

[30]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[31]  Guo Xie,et al.  Adaptive Transition Probability Matrix-Based Parallel IMM Algorithm , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Adaptive Identification of Time-varying Environmental Parameters in Train Dynamics Model , 2020 .

[33]  Shuang Zhang,et al.  Control Design for Nonlinear Flexible Wings of a Robotic Aircraft , 2017, IEEE Transactions on Control Systems Technology.

[34]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[35]  Youmin Zhang,et al.  Deep model integrated with data correlation analysis for multiple intermittent faults diagnosis. , 2019, ISA transactions.