Looking ahead: Anticipatory interfaces for driver-automation collaboration

Partially automated driving systems that require driver supervision and intervention need to keep the driver in the loop and help maintain their situation awareness of the vehicle's current state and future plans. In this paper, we introduce the idea of an “Anticipatory Control Interface” — an interface that informs the driver of the lateral trajectory plan of the automated driving system. Our first prototype performs this task by actuating the steering wheel (physical) in advance of road wheel movement. A second prototype uses LEDs on a steering wheel cover to create a virtual steering wheel (visual) that can move in advance while keeping the steering wheel locked to the road wheel. We report an evaluation of the Anticipatory Control Interface prototypes based on their ability to support driver recognition and response to automation failures, compared to a control condition. Results show faster disengagement of automation and subsequently better takeover quality on failure with the physical anticipatory interface compared to the control.

[1]  Magnus Egerstedt,et al.  Human-in-the-Loop: Terminal constraint receding horizon control with human inputs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[2]  J. Christian Gerdes,et al.  Handwheel Force Feedback for Lanekeeping Assistance: Combined Dynamics and Stability , 2006 .

[3]  Gudrun Klinker,et al.  Visual Longitudinal and Lateral Driving Assistance in the Head-Up Display of Cars , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[4]  Bobbie D. Seppelt,et al.  Making adaptive cruise control (ACC) limits visible , 2007, Int. J. Hum. Comput. Stud..

[5]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[6]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[7]  Klaus Bengler,et al.  Highly automated driving with a decoupled steering wheel , 2014 .

[8]  R. Brent Gillespie,et al.  Shared Control between Human and Machine: Using a Haptic Steering Wheel to Aid in Land Vehicle Guidance , 2001 .

[9]  Wendy Ju,et al.  Exploring shared control in automated driving , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[10]  Wendy Ju,et al.  Take the wheel: Effects of available modalities on driver intervention , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[11]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[12]  Donald A. Norman,et al.  The Human Side of Automation , 2015 .

[13]  Christos Katrakazas,et al.  Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions , 2015 .

[14]  A. Berthoz,et al.  Eye-head coordination for the steering of locomotion in humans: an anticipatory synergy , 1998, Neuroscience Letters.

[15]  E. A. Bretz.  By-wire cars turn the corner , 2001 .

[16]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[17]  J. Christian Gerdes,et al.  Shared Steering Control Using Safe Envelopes for Obstacle Avoidance and Vehicle Stability , 2016, IEEE Transactions on Intelligent Transportation Systems.

[18]  Sterling J. Anderson,et al.  The intelligent copilot: A constraint-based approach to shared-adaptive control of ground vehicles , 2013, IEEE Intelligent Transportation Systems Magazine.

[19]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[20]  J. Christian Gerdes,et al.  Predictive Haptic Feedback for Obstacle Avoidance Based on Model Predictive Control , 2016, IEEE Transactions on Automation Science and Engineering.

[21]  Leila Takayama,et al.  Assisted driving of a mobile remote presence system: System design and controlled user evaluation , 2011, 2011 IEEE International Conference on Robotics and Automation.