Comparative Study of Markov Chain With Recurrent Neural Network for Short Term Velocity Prediction Implemented on an Embedded System

Short-term prediction models for an ego-vehicle’s speed contributes to the improvement of vehicle safety, driveability, and fuel economy. To achieve these desired outcomes, an accurate forward speed prediction model and its successful implementation in a real system is a prerequisite. This paper compares six velocity prediction models based on two types of data-driven models, a Markov chain and a Recurrent Neural Network (RNN), by implementing them in an embedded system to evaluate their prediction accuracy and execution time. The inputs to each model are the driving information acquired on a specific route, such as internal vehicle information, relative speed and distance to the vehicle in the front of the ego-vehicle, and ego-vehicle’s location estimated by the GPS signal along with the B-spline roadway model. The proposed prediction models predict the velocity profile of the ego-vehicle up to the prediction horizon of 150 m. The parameters of the proposed models have been optimized using Hyper-parameter Optimization via Radial basis function and Dynamic coordinate search. By applying real driving data, the Markov chain-based models show slightly lower prediction accuracy but shorter execution time than those of the RNN-based models.

[1]  Kyoungho Ahn,et al.  Predictive eco-cruise control: Algorithm and potential benefits , 2011, 2011 IEEE Forum on Integrated and Sustainable Transportation Systems.

[2]  Ardalan Vahidi,et al.  Predictive Cruise Control: Utilizing Upcoming Traffic Signal Information for Improving Fuel Economy and Reducing Trip Time , 2011, IEEE Transactions on Control Systems Technology.

[3]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[4]  Wencong Su,et al.  Distance-Based Ecological Driving Scheme Using a Two-Stage Hierarchy for Long-Term Optimization and Short-Term Adaptation , 2017, IEEE Transactions on Vehicular Technology.

[5]  Myoungho Sunwoo,et al.  Semantic segmentation-based parking space detection with standalone around view monitoring system , 2018, Machine Vision and Applications.

[6]  Huei Peng,et al.  A stochastic control strategy for hybrid electric vehicles , 2004, Proceedings of the 2004 American Control Conference.

[7]  Jinjun Tang,et al.  Evaluation of Short-Term Freeway Speed Prediction Based on Periodic Analysis Using Statistical Models and Machine Learning Models , 2020 .

[8]  Taimoor Akhtar,et al.  Efficient Hyperparameter Optimization for Deep Learning Algorithms Using Deterministic RBF Surrogates , 2016, AAAI.

[9]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[10]  Dimitar Filev,et al.  A generalized Markov Chain modeling approach for on board applications , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[11]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[12]  Shaohang Xu,et al.  Short-term Vehicle Speed Prediction Based on Convolutional Bidirectional LSTM Networks , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Giorgio Rizzoni,et al.  Energy-Optimal Control of Plug-in Hybrid Electric Vehicles for Real-World Driving Cycles , 2011, IEEE Transactions on Vehicular Technology.

[15]  Kaijiang Yu,et al.  Model Predictive Control for Hybrid Electric Vehicle Platooning Using Slope Information , 2016, IEEE Transactions on Intelligent Transportation Systems.

[16]  Manoranjan Parida,et al.  Short Term Traffic Flow Prediction for a Non Urban Highway Using Artificial Neural Network , 2013 .

[17]  Dimitar Filev,et al.  Design of a fuel economy oriented vehicle longitudinal speed controller with optimal gear sequence , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[18]  Myoungho Sunwoo,et al.  Ego-Vehicle Speed Prediction Using a Long Short-Term Memory Based Recurrent Neural Network , 2019, International Journal of Automotive Technology.

[19]  Dimitar Filev,et al.  Generalized Markov Models for Real-Time Modeling of Continuous Systems , 2014, IEEE Transactions on Fuzzy Systems.

[20]  Dimitar Filev,et al.  Vehicle speed prediction using a cooperative method of fuzzy Markov model and auto-regressive model , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[21]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[22]  Xun Gong,et al.  Vehicle Velocity Prediction and Energy Management Strategy Part 1: Deterministic and Stochastic Vehicle Velocity Prediction Using Machine Learning , 2019, SAE Technical Paper Series.

[23]  Myoungho Sunwoo,et al.  Ego-Vehicle Speed Prediction Using Fuzzy Markov Chain With Speed Constraints , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[24]  Myoungho Sunwoo,et al.  Curvilinear-Coordinate-Based Object and Situation Assessment for Highly Automated Vehicles , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  Dimitar Filev,et al.  Analytical Solution to the Minimum Energy Consumption Based Velocity Profile Optimization Problem With Variable Road Grade , 2014 .

[26]  J. Mikael Eklund,et al.  Obstacle Avoidance in Real Time With Nonlinear Model Predictive Control of Autonomous Vehicles , 2017, Canadian Journal of Electrical and Computer Engineering.

[27]  Namwook Kim,et al.  Route-Based Online Energy Management of a PHEV and Sensitivity to Trip Prediction , 2014, 2014 IEEE Vehicle Power and Propulsion Conference (VPPC).

[28]  Huei Peng,et al.  Modeling and Control of a Power-Split Hybrid Vehicle , 2008, IEEE Transactions on Control Systems Technology.

[29]  Ilya Kolmanovsky,et al.  Optimization of powertrain operating policy for feasibility assessment and calibration: stochastic dynamic programming approach , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[30]  Fathi M. Salem,et al.  Gate-variants of Gated Recurrent Unit (GRU) neural networks , 2017, 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS).

[31]  Dongpu Cao,et al.  Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle , 2017, IEEE/ASME Transactions on Mechatronics.

[32]  Xiaosong Hu,et al.  Velocity Predictors for Predictive Energy Management in Hybrid Electric Vehicles , 2015, IEEE Transactions on Control Systems Technology.

[33]  Chao Chen,et al.  Short‐Term Traffic Speed Prediction for an Urban Corridor , 2017, Comput. Aided Civ. Infrastructure Eng..

[34]  Yuan Ma,et al.  Vehicle Speed Prediction Using Deep Learning , 2015, 2015 IEEE Vehicle Power and Propulsion Conference (VPPC).

[35]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[36]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[37]  Bin Ran,et al.  A hybrid deep learning based traffic flow prediction method and its understanding , 2018 .

[38]  Eleni I. Vlahogianni,et al.  Short-term traffic forecasting: Where we are and where we’re going , 2014 .

[39]  Dimitar Filev,et al.  Vehicle Speed Prediction in a Convoy Using V2V Communication , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[40]  Myoungho Sunwoo,et al.  Vehicle Speed Prediction Using a Markov Chain With Speed Constraints , 2019, IEEE Transactions on Intelligent Transportation Systems.

[41]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[42]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[43]  Eleni I. Vlahogianni,et al.  Short‐term traffic forecasting: Overview of objectives and methods , 2004 .

[44]  Li Li,et al.  Using LSTM and GRU neural network methods for traffic flow prediction , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[45]  Fengchun Sun,et al.  Investigating adaptive-ECMS with velocity forecast ability for hybrid electric vehicles , 2017 .

[46]  Yi Lu Murphey,et al.  Real time vehicle speed prediction using a Neural Network Traffic Model , 2011, The 2011 International Joint Conference on Neural Networks.

[47]  Duanfeng Chu,et al.  A method of vehicle motion prediction and collision risk assessment with a simulated vehicular cyber physical system , 2014 .

[48]  J. Kearney,et al.  Robust and Efficient Computation of the Closest Point on a Spline Curve , 2002 .

[49]  Myoungho Sunwoo,et al.  Generation of a Precise Roadway Map for Autonomous Cars , 2014, IEEE Transactions on Intelligent Transportation Systems.