A Workload Adaptive Haptic Shared Control Scheme for Semi-Autonomous Driving

Haptic shared control is used to manage the control authority allocation between a human and an autonomous agent in semi-autonomous driving. Existing haptic shared control schemes, however, do not take full consideration of the human agent. To fill this research gap, this study presents a haptic shared control scheme that adapts to a human operator's workload, eyes on road and input torque in real-time. We conducted human-in-the-loop experiments with 24 participants. In the experiment, a human operator and an autonomy module for navigation shared the control of a simulated notional High Mobility Multipurpose Wheeled Vehicle (HMMWV) at a fixed speed. At the same time, the human operator performed a target detection task for surveillance. The autonomy could be either adaptive or non-adaptive to the above-mentioned human factors. Results indicate that the adaptive haptic control scheme resulted in significantly lower workload, higher trust in autonomy, better driving task performance and smaller control effort.

[1]  Ji-Hyun Kim,et al.  Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap , 2009, Comput. Stat. Data Anal..

[2]  Boris S Kerner,et al.  Physics of automated driving in framework of three-phase traffic theory. , 2018, Physical review. E.

[3]  Darwin G. Caldwell,et al.  Learning Controllers for Reactive and Proactive Behaviors in Human–Robot Collaboration , 2016, Front. Robot. AI.

[4]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[5]  Melissa Patricia Coral.  Analyzing Cognitive Workload through Eye-Related Measurements: A Meta-Analysis , 2016 .

[6]  R. Brent Gillespie,et al.  Who’s the boss? Arbitrating control authority between a human driver and automation system , 2020 .

[7]  Benoit Vanholme,et al.  Towards Highly Automated Driving: Intermediate report on the HAVEit-Joint System , 2010 .

[8]  David A. Abbink,et al.  Should Drivers Be Operating Within an Automation-Free Bandwidth? Evaluating Haptic Steering Support Systems With Different Levels of Authority , 2015, Hum. Factors.

[9]  Boris S. Kerner,et al.  Autonomous driving in framework of three-phase traffic theory , 2018, ANT/SEIT.

[10]  Na Du,et al.  Not All Information Is Equal: Effects of Disclosing Different Types of Likelihood Information on Trust, Compliance and Reliance, and Task Performance in Human-Automation Teaming , 2019, Hum. Factors.

[11]  Akane Sano,et al.  Wavelet-based motion artifact removal for electrodermal activity , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Alex Fridman,et al.  Cognitive Load Estimation in the Wild , 2018, CHI.

[13]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[14]  Tulga Ersal,et al.  Combined Speed and Steering Control in High-Speed Autonomous Ground Vehicles for Obstacle Avoidance Using Model Predictive Control , 2017, IEEE Transactions on Vehicular Technology.

[15]  Yaohui Guo,et al.  Modeling and Predicting Trust Dynamics in Human-Robot Teaming: A Bayesian Inference Approach , 2020, ArXiv.

[16]  Tulga Ersal,et al.  Moving obstacle avoidance for large, high-speed autonomous ground vehicles , 2017, 2017 American Control Conference (ACC).

[17]  Bryan Reimer,et al.  Impact of Cognitive Task Complexity on Drivers’ Visual Tunneling , 2009 .

[18]  Omer Tsimhoni,et al.  Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks , 2010, IEEE Transactions on Intelligent Transportation Systems.

[19]  Kevin Chen,et al.  A shared control method for obstacle avoidance with mobile robots and its interaction with communication delay , 2017, Int. J. Robotics Res..

[20]  Aude Billard,et al.  Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM , 2005, ICML.

[21]  Yifan Wang,et al.  Toward Real-time Assessment of Workload: A Bayesian Inference Approach , 2019 .

[22]  X. Jessie Yang,et al.  Workload Management in Teleoperation of Unmanned Ground Vehicles: Effects of a Delay Compensation Aid on Human Operators’ Workload and Teleoperation Performance , 2019, Int. J. Hum. Comput. Interact..

[23]  Leandro L. Di Stasi,et al.  Monitoring army drivers’ workload during off-road missions: An experimental controlled field study , 2021 .

[24]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[25]  J. Christian Gerdes,et al.  Shared Steering Control Using Safe Envelopes for Obstacle Avoidance and Vehicle Stability , 2016, IEEE Transactions on Intelligent Transportation Systems.

[26]  Sylvain Calinon,et al.  A tutorial on task-parameterized movement learning and retrieval , 2015, Intelligent Service Robotics.

[27]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[28]  Mark Mulder,et al.  The effect of haptic guidance on curve negotiation behavior of young, experienced drivers , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[29]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[30]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[31]  Julie A. Adams,et al.  A Survey of Workload Assessment Algorithms , 2018, IEEE Transactions on Human-Machine Systems.

[32]  R. Brent Gillespie,et al.  Sharing Control Between Humans and Automation Using Haptic Interface: Primary and Secondary Task Performance Benefits , 2005, Hum. Factors.

[33]  Sterling J. Anderson,et al.  Design and Development of an Optimal-Control-Based Framework for Trajectory Planning, Threat Assessment, and Semi-autonomous Control of Passenger Vehicles in Hazard Avoidance Scenarios , 2009, ISRR.

[34]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[35]  Chouki Sentouh,et al.  Sensor Reduction for Driver-Automation Shared Steering Control via an Adaptive Authority Allocation Strategy , 2017, IEEE/ASME Transactions on Mechatronics.

[36]  Hasan Ayaz,et al.  Multisubject “Learning” for Mental Workload Classification Using Concurrent EEG, fNIRS, and Physiological Measures , 2017, Front. Hum. Neurosci..

[37]  Kevin Li,et al.  Evaluating Effects of User Experience and System Transparency on Trust in Automation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[38]  Jing Zhang,et al.  Driver cognitive workload estimation: a data-driven perspective , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[39]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[40]  Boris S. Kerner,et al.  Effect of autonomous driving on traffic breakdown in mixed traffic flow: A comparison of classical ACC with three-traffic-phase-ACC (TPACC) , 2021 .

[41]  James C. Christensen,et al.  Classifying Workload with Eye Movements in a Complex Task , 2012 .

[42]  Tulga Ersal,et al.  A nonlinear model predictive control formulation for obstacle avoidance in high-speed autonomous ground vehicles in unstructured environments , 2018 .

[43]  Ying Wang,et al.  The sensitivity of different methodologies for characterizing drivers’ gaze concentration under increased cognitive demand , 2014, Transportation Research Part F: Traffic Psychology and Behaviour.

[44]  Javier Alonso-Mora,et al.  Parallel autonomy in automated vehicles: Safe motion generation with minimal intervention , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).