A Human-Vehicle Collaborative Driving Framework for Driver Assistance

With a goal to improve transportation safety, this paper proposes a collaborative driving framework based on assessments of both internal and external risks involved in vehicle driving. The internal risk analysis includes driver drowsiness detection and driver intention recognition that helps to understand the human driver’s behavior. Steering wheel data and facial expression are used to detect the driver’s drowsiness. Hidden Markov models are adapted to recognize the driver’s intention using the vehicle’s lane position, control, and state data. For the external risk analysis, a co-pilot utilizes a collision avoidance system to estimate the collision probability between the ego vehicle and other nearby vehicles. Based on the risk analyses, we design a novel collaborative driving scheme by fusing the control inputs from the human driver and the co-pilot to obtain the final control input for the ego vehicle under different circumstances. The proposed collaborative driving framework is validated in an assisted-driving testbed, which enables both autonomous and manual driving capabilities.

[1]  Mark E. Campbell,et al.  Multiple-step prediction using a two stage Gaussian Process model , 2014, 2014 American Control Conference.

[2]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .

[3]  A. Mortazavi,et al.  Evaluation of a Smart Algorithm for Commercial Vehicle Driver Drowsiness Detection , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Bo Cheng,et al.  Effects of Human Adaptation and Trust on Shared Control for Driver-Automation Cooperative Driving , 2017, ICVS 2017.

[6]  Jean-Michel Hoc,et al.  Analysis of Human-Machine Cooperation When Driving with Different Degrees of Haptic Shared Control , 2014, IEEE Transactions on Haptics.

[7]  Hermann Winner,et al.  Towards cooperative guidance and control of highly automated vehicles: H-Mode and Conduct-by-Wire , 2014, Ergonomics.

[8]  Yao Xiao-tian.  Face tracking based on Haar detection and improved Camshift algorithm , 2011 .

[9]  Philippe Chevrel,et al.  Shared Steering Control Between a Driver and an Automation: Stability in the Presence of Driver Behavior Uncertainty , 2013, IEEE Transactions on Intelligent Transportation Systems.

[10]  Linlin Shen,et al.  AdaBoost Gabor Feature Selection for Classification , 2004 .

[11]  Pin Wang,et al.  Trajectory Prediction for Turning Vehicles at Intersections by Fusing Vehicle Dynamics and Driver’s Future Input Estimation , 2016 .

[12]  Denis Osipychev,et al.  Collision avoidance for autonomous cars based on human intention , 2015 .

[13]  Markus Zimmermann,et al.  A multimodal interaction concept for cooperative driving , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[14]  Girish Chowdhary,et al.  Human intention-based collision avoidance for autonomous cars , 2017, 2017 American Control Conference (ACC).

[15]  John M. Dolan,et al.  A multi-level collaborative driving framework for autonomous vehicles , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[16]  Weihua Sheng,et al.  A driver assistance framework based on driver drowsiness detection , 2016, 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[17]  Chouki Sentouh,et al.  Automation-driver cooperative driving in presence of undetected obstacles , 2014 .

[18]  Ching-Yao Chan,et al.  Vehicle Collision Risk Prediction at Intersections based on Comparison of Minimal Distance between Vehicles and Dynamic Thresholds , 2017 .

[19]  T. Sattel,et al.  Combining haptic human-machine interaction with predictive path planning for lane-keeping and collision avoidance systems , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[20]  Douglas Guimarães Macharet,et al.  A collaborative control system for telepresence robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[22]  Yiannis Demiris,et al.  Collaborative Control for a Robotic Wheelchair: Evaluation of Performance, Attention, and Workload , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Yanan Li,et al.  Driver-automation indirect shared control of highly automated vehicles with intention-aware authority transition , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[24]  W. Gareth J. Howells,et al.  Assistive Trajectories for Human-in-the-Loop Mobile Robotic Platforms , 2015, 2015 Sixth International Conference on Emerging Security Technologies (EST).

[25]  Weihua Sheng,et al.  A collaborative control framework for driver assistance systems , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Azim Eskandarian,et al.  Unobtrusive drowsiness detection by neural network learning of driver steering , 2001 .

[27]  Hadas Kress-Gazit,et al.  Courteous Cars , 2008, IEEE Robotics & Automation Magazine.