Modeling and Prediction of Human Behaviors based on Driving Data using Multi-Layer HMMs

Understanding and predicting of human driving behavior play an important role in the development of Advanced Driver Assistance Systems (ADAS) for assisting drivers. In this contribution, a Multi-Layer (3-layer) Hidden Markov Models (HMM) approach is proposed and developed for predicting human driving behavior. For a single HMM, more inputs will cause a longer training time, higher complexity, and even overfitting. The proposed method can fit to complex situations, also when more inputs are considered. In this contribution the first layer is considered to predict driving behavior in certain single working cases, i.e. each input variable is used to train a single model independently in the first layer. The outputs are combined into different models containing different information in the second and third layers. All HMMs in combination with a prefilter are used to predict driving behavior in parallel. Lane changing, as a usual driving maneuver, will be used as representative example task to be predicted. Based on observations (training), the HMM algorithm calculates the most probable driving behavior through the observation sequences. Furthermore, the observed sequences are also used for training of HMM during modeling process.To define model parameters and to improve the model performance NSGA-II is used. Using experimental data taken from driving simulator, it can be concluded that selecting optimal parameters increase the performance of driving behavior prediction. The effectiveness of the suggested Multi-Layer HMMs has been successfully proved based on experiments. The results show that the newly introduced approach outperforms alternative approaches applied to the same data set.

[1]  Chandra R. Bhat,et al.  Analytic methods in accident research: Methodological frontier and future directions , 2014 .

[2]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[3]  Evangelos Bekiaris,et al.  Modelling Driver Behaviour in European Union and International Projects , 2007 .

[4]  Weihua Sheng,et al.  A Hidden Markov Model based driver intention prediction system , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[5]  Chang Wang,et al.  Driving intention recognition and behaviour prediction based on a double-layer hidden Markov model , 2012, Journal of Zhejiang University SCIENCE C.

[6]  P. Boyraz,et al.  Signal Modelling and Hidden Markov Models for Driving Manoeuvre Recognition and Driver Fault Diagnosis in an urban road scenario , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[7]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[8]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[9]  Dirk Söffker,et al.  Improved Driving Behaviors Prediction Based on Fuzzy Logic-Hidden Markov Model (FL-HMM) , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[10]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[11]  Fengjun Yan,et al.  Lane changing prediction at highway lane drops using support vector machine and artificial neural network classifiers , 2016, 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[12]  Dirk Söffker,et al.  Prediction of human driver behaviors based on an improved HMM approach , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[13]  Masayoshi Tomizuka,et al.  An Overview on Study of Identification of Driver Behavior Characteristics for Automotive Control , 2014 .

[14]  Vijay Gadepally,et al.  Driver/vehicle state estimation and detection , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[15]  Rüdiger Dillmann,et al.  Learning context sensitive behavior models from observations for predicting traffic situations , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[16]  Ryan P. Adams,et al.  The Segmented iHMM: A Simple, Efficient Hierarchical Infinite HMM , 2016, ICML.

[17]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.