Human-Machine Collaboration for Automated Vehicles via an Intelligent Two-Phase Haptic Interface

Prior to realizing fully autonomous driving, human intervention will be required periodically to guarantee vehicle safety. This fact poses a new challenge in human-machine interaction, particularly during control authority transition from the automated functionality to a human driver. This paper addresses this challenge by proposing an intelligent haptic interface based on a newly developed two-phase human-machine interaction model. The intelligent haptic torque is applied on the steering wheel and switches its functionality between predictive guidance and haptic assistance according to the varying state and control ability of human drivers, helping drivers gradually resume manual control during takeover. The developed approach is validated by conducting vehicle experiments with 26 human participants. The results suggest that the proposed method can effectively enhance the driving state recovery and control performance of human drivers during takeover compared with an existing approach, further improving the safety and smoothness of the human-machine interaction in automated vehicles.

[1]  David J. Cole,et al.  Game-Theoretic Modeling of the Steering Interaction Between a Human Driver and a Vehicle Collision Avoidance Controller , 2015, IEEE Transactions on Human-Machine Systems.

[2]  Nadja Schömig,et al.  Effects of Non-Driving Related Task Modalities on Takeover Performance in Highly Automated Driving , 2018, Hum. Factors.

[3]  B. Reimer,et al.  People must retain control of autonomous vehicles , 2018, Nature.

[4]  Mark Mulder,et al.  Sharing Control With Haptics , 2012, Hum. Factors.

[5]  David J. Cole,et al.  A path-following driver–vehicle model with neuromuscular dynamics, including measured and simulated responses to a step in steering angle overlay , 2012 .

[6]  Klaus Bengler,et al.  Taking Over Control From Highly Automated Vehicles in Complex Traffic Situations , 2016, Hum. Factors.

[7]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[8]  Rajesh Rajamani,et al.  Vehicle dynamics and control , 2005 .

[9]  Lee Skrypchuk,et al.  Characterization of Driver Neuromuscular Dynamics for Human–Automation Collaboration Design of Automated Vehicles , 2018, IEEE/ASME Transactions on Mechatronics.

[10]  Riender Happee,et al.  Modeling take-over performance in level 3 conditionally automated vehicles. , 2017, Accident; analysis and prevention.

[11]  Lee Skrypchuk,et al.  A Novel Control Framework of Haptic Take-Over System for Automated Vehicles , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[12]  Changxu Wu,et al.  The Effects of Lead Time of Take-Over Request and Nondriving Tasks on Taking-Over Control of Automated Vehicles , 2018, IEEE Transactions on Human-Machine Systems.

[13]  Christian Kirches,et al.  qpOASES: a parametric active-set algorithm for quadratic programming , 2014, Mathematical Programming Computation.

[14]  Lee Skrypchuk,et al.  Analysis of autopilot disengagements occurring during autonomous vehicle testing , 2018, IEEE/CAA Journal of Automatica Sinica.

[15]  Alberto Bemporad,et al.  Predictive Control for Linear and Hybrid Systems , 2017 .

[16]  Rainer Stiefelhagen,et al.  Driver observation and shared vehicle control: supporting the driver on the way back into the control loop , 2018, Autom..

[17]  Mark Mulder,et al.  The effect of haptic guidance on curve negotiation behavior of young, experienced drivers , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[18]  Neville A. Stanton,et al.  Analysis of driver roles: modelling the changing role of the driver in automated driving systems using EAST , 2019, Theoretical Issues in Ergonomics Science.

[19]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.

[20]  Andreas Haas,et al.  A Comparison of Concepts for Control Transitions from Automation to Human , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[21]  Sebastiaan M. Petermeijer,et al.  Take-over requests in highly automated driving: A crowdsourcing survey on auditory, vibrotactile, and visual displays , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.

[22]  J. Christian Gerdes,et al.  Shared Steering Control Using Safe Envelopes for Obstacle Avoidance and Vehicle Stability , 2016, IEEE Transactions on Intelligent Transportation Systems.

[23]  Hermann Winner,et al.  Towards cooperative guidance and control of highly automated vehicles: H-Mode and Conduct-by-Wire , 2014, Ergonomics.

[24]  Philippe Chevrel,et al.  Modelling human control of steering for the design of advanced driver assistance systems , 2017, Annu. Rev. Control..

[25]  Ken Goldberg,et al.  Robots and the return to collaborative intelligence , 2019, Nature Machine Intelligence.

[26]  Josef Nilsson,et al.  Safe Transitions From Automated to Manual Driving Using Driver Controllability Estimation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  Takahiro Wada,et al.  Control Authority Transfer Method for Automated-to-Manual Driving Via a Shared Authority Mode , 2018, IEEE Transactions on Intelligent Vehicles.

[28]  Frank Flemisch,et al.  Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations , 2012, Cognition, Technology & Work.

[29]  Allison M. Okamura,et al.  Motor learning affects car-to-driver handover in automated vehicles , 2016, Science Robotics.

[30]  David J. Cole,et al.  Predictive and linear quadratic methods for potential application to modelling driver steering control , 2006 .

[31]  David J. Cole,et al.  Neuromuscular dynamics and the vehicle steering task , 2004 .

[32]  Sören Hohmann,et al.  Steering driver assistance system: A systematic cooperative shared control design approach , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[33]  Neville A. Stanton,et al.  Conditionally and highly automated vehicle handover: A study exploring vocal communication between two drivers , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[34]  Sören Hohmann,et al.  Cooperative dynamic vehicle control allocation using time-variant differential games , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[35]  Chi-Wang Shu,et al.  Total variation diminishing Runge-Kutta schemes , 1998, Math. Comput..

[36]  Klaus Bengler,et al.  How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving , 2014 .

[37]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[38]  David J. Cole,et al.  A Mathematical Model of Driver Steering Control Including Neuromuscular Dynamics , 2008 .

[39]  R. Happee,et al.  A human factors perspective on automated driving , 2017 .