Early Recognition of Driving Intention for Lane Change Based on Recurrent Hidden Semi-Markov Model

Timely recognition of driving intention is crucial in the design of a safe and effective driving assistance system. This study proposes an efficient recognition approach based on Nonlinear Polynomial Regression (NPR) and Recurrent Hidden Semi-Markov Model (R-HSMM) to recognize the driver lane-change intention accurately in the early stage. The NPR model is utilized to transform the input signal amplitude into the standard form in order to improve system adaptability. Besides, an unsupervised time-series segmentation method named the Toeplitz Inverse Covariance-based Clustering (TICC) is applied to label the driving data automatically. The R-HSMM is utilized as a time-series classifier to classify the driving intention during the lane-change process into predefined categories based on the signals processed by the NPR. The proposed method is verified by the experiments with a driving simulator. The experimental results show that the proposed method can recognize driver intention earlier than the popular recognition methods, and also can reduce the number of false warnings during the lane-change process, which has great significance for driving safety improvement. Moreover, the proposed method can adapt well to various vehicle speeds achieving stable recognition performance.

[1]  John H. L. Hansen,et al.  Lane-Change Detection From Steering Signal Using Spectral Segmentation and Learning-Based Classification , 2017, IEEE Transactions on Intelligent Vehicles.

[2]  Stephen P. Boyd,et al.  Toeplitz Inverse Covariance-Based Clustering of Multivariate Time Series Data , 2017, KDD.

[3]  Yunfeng Ai,et al.  Driver Lane Change Intention Inference for Intelligent Vehicles: Framework, Survey, and Challenges , 2019, IEEE Transactions on Vehicular Technology.

[4]  Efstathios Velenis,et al.  An ensemble deep learning approach for driver lane change intention inference , 2020, Transportation Research Part C: Emerging Technologies.

[5]  Edward Tunstel,et al.  Identification of anomalies in lane change behavior using one-class SVM , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Xinglong Zhang,et al.  Minimum Time Lane Changing Problem of Vehicle Handling Inverse Dynamics Considering the Driver’s Intention , 2019 .

[7]  Chang Wang,et al.  Driving intention identification and maneuvering behavior prediction of drivers on cornering , 2009, 2009 International Conference on Mechatronics and Automation.

[8]  Weiwen Deng,et al.  Personalized Lane-Change Assistance System With Driver Behavior Identification , 2018, IEEE Transactions on Vehicular Technology.

[9]  Fatemeh Afghah,et al.  Driver behavior modeling near intersections using support vector machines based on statistical feature extraction , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[10]  Kuriakose Athappilly,et al.  A comparative predictive analysis of neural networks (NNs), nonlinear regression and classification and regression tree (CART) models , 2005, Expert Syst. Appl..

[11]  Liu Yun,et al.  Driving Intentions Identification Based on Continuous P-2D HMM , 2011, 2011 Second International Conference on Digital Manufacturing & Automation.

[12]  Dongpu Cao,et al.  Virtual-to-Real Knowledge Transfer for Driving Behavior Recognition: Framework and a Case Study , 2019, IEEE Transactions on Vehicular Technology.

[13]  Junqiang Xi,et al.  Development and evaluation of two learning-based personalized driver models for car-following behaviors , 2017, 2017 American Control Conference (ACC).

[14]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[15]  Keqiang Li,et al.  Lane changing intention recognition based on speech recognition models , 2016 .

[16]  Dongpu Cao,et al.  Transfer Learning for Driver Model Adaptation in Lane-Changing Scenarios Using Manifold Alignment , 2020, IEEE Transactions on Intelligent Transportation Systems.

[17]  Hyunjin Park,et al.  Development of a lane change risk index using vehicle trajectory data. , 2018, Accident; analysis and prevention.

[18]  Jooyoung Park,et al.  Prediction of Driver’s Intention of Lane Change by Augmenting Sensor Information Using Machine Learning Techniques , 2017, Sensors.

[19]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[20]  Hajime Asama,et al.  Lane-change detection based on individual driving style , 2019, Adv. Robotics.

[21]  Qiong Zhang,et al.  Lane change warning threshold based on driver perception characteristics. , 2018, Accident; analysis and prevention.

[22]  Junqiang Xi,et al.  Learning Driver-Specific Behavior for Overtaking: A Combined Learning Framework , 2018, IEEE Transactions on Vehicular Technology.

[23]  Gaetano Fusco,et al.  Artificial Neural Network Models for Car Following: Experimental Analysis and Calibration Issues , 2014, J. Intell. Transp. Syst..

[24]  Stewart Worrall,et al.  Naturalistic Driver Intention and Path Prediction Using Recurrent Neural Networks , 2018, IEEE Transactions on Intelligent Transportation Systems.

[25]  Abdollah Homaifar,et al.  Driver intention estimation via discrete hidden Markov model , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  Weihua Sheng,et al.  A Hidden Markov Model based driver intention prediction system , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[27]  Qiang Gao,et al.  Identification of driver’s braking intention based on a hybrid model of GHMM and GGAP-RBFNN , 2018, Neural Computing and Applications.

[28]  Hong Chen,et al.  Modeling driver's car-following behavior based on hidden Markov model and model predictive control: A cyber-physical system approach , 2017, 2017 11th Asian Control Conference (ASCC).

[29]  R. Bishop,et al.  A survey of intelligent vehicle applications worldwide , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[30]  Le Song,et al.  Recurrent Hidden Semi-Markov Model , 2017, ICLR.

[31]  Xianyi Huang.  Driver Lane Change Intention Recognition by Using Entropy-Based Fusion Techniques and Support Vector Machine Learning Strategy , 2013 .

[32]  Klaus C. J. Dietmayer,et al.  Continuous Driver Intention Recognition with Hidden Markov Models , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[33]  Junqiang Xi,et al.  A Learning-Based Approach for Lane Departure Warning Systems With a Personalized Driver Model , 2017, IEEE Transactions on Vehicular Technology.

[34]  Junqiang Xi,et al.  Learning and Inferring a Driver's Braking Action in Car-Following Scenarios , 2018, IEEE Transactions on Vehicular Technology.

[35]  Douglas M. Bates,et al.  Nonlinear Regression Analysis and Its Applications , 1988 .