Reinventing the Wheel: Transforming Steering Wheel Systems for Autonomous Vehicles

In this paper, we introduce two different transforming steering wheel systems that can be utilized to augment user experience for future partially autonomous and fully autonomous vehicles. The first one is a robotic steering wheel that can mechanically transform by using its actuators to move the various components into different positions. The second system is a LED steering wheel that can visually transform by using LEDs embedded along the rim of wheel to change colors. Both steering wheel systems contain onboard microcontrollers developed to interface with our driving simulator. The main function of these two systems is to provide emergency warnings to drivers in a variety of safety critical scenarios, although the design space that we propose for these steering wheel systems also includes the use as interactive user interfaces. To evaluate the effectiveness of the emergency alerts, we conducted a driving simulator study examining the performance of participants (N=56) after an abrupt loss of autonomous vehicle control. Drivers who experienced the robotic steering wheel performed significantly better than those who experienced the LED steering wheel. The results of this study suggest that alerts utilizing mechanical movement are more effective than purely visual warnings.

[1]  Mascha C. van der Voort,et al.  The influence of time-criticality on Situation Awareness when retrieving human control after automated driving , 2013, ITSC.

[2]  Joris C Verster,et al.  Standard operation procedures for conducting the on-the-road driving test, and measurement of the standard deviation of lateral position (SDLP) , 2011, International journal of general medicine.

[3]  Hiroshi Ishii,et al.  Towards Radical Atoms — Form-giving to transformable materials , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[4]  F. Beruscha,et al.  Haptic Warning Signals at the Steering Wheel: A Literature Survey Regarding Lane Departure Warning Systems (Short Paper) , 2011 .

[5]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[6]  Frederik Diederichs,et al.  Take-Over Requests for Automated Driving , 2015 .

[7]  Hiroshi Ishii,et al.  PneUI: pneumatically actuated soft composite materials for shape changing interfaces , 2013, UIST.

[8]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[9]  Cagatay Basdogan,et al.  Vibrotactile feedback in steering wheel reduces navigation errors during GPS-guided car driving , 2011, 2011 IEEE World Haptics Conference.

[10]  Thomas A. Dingus,et al.  Driver comprehension of multiple haptic seat alerts intended for use in an integrated collision avoidance system , 2011 .

[11]  Yvonne Rogers,et al.  Enhancing Navigation Information with Tactile Output Embedded into the Steering Wheel , 2009, Pervasive.

[12]  Albrecht Schmidt,et al.  Multimodal interaction in the car: combining speech and gestures on the steering wheel , 2012, AutomotiveUI.

[13]  J. Williams,et al.  Haptic chameleon: a new concept of shape-changing user interface controls with force feedback , 2004, CHI EA '04.

[14]  Sungjae Hwang,et al.  The Haptic steering Wheel: Vibro-tactile based navigation for the driving environment , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[15]  Wendy Ju,et al.  Distraction Becomes Engagement in Automated Driving , 2015 .

[16]  R. Happee,et al.  A human factors perspective on automated driving , 2017 .

[17]  J. Christian Gerdes,et al.  Designing Steering Feel for Steer-by-Wire Vehicles Using Objective Measures , 2015, IEEE/ASME Transactions on Mechatronics.

[18]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[19]  Wijnand A. IJsselsteijn,et al.  Presence: concept, determinants, and measurement , 2000, Electronic Imaging.

[20]  Toshio Ito,et al.  Time Required for Take-over from Automated to Manual Driving , 2016 .

[21]  J C F de Winter,et al.  Comparing spatially static and dynamic vibrotactile take-over requests in the driver seat. , 2017, Accident; analysis and prevention.

[22]  Kazuhiro Yoshida,et al.  Automobile Driving Interface Using Gesture Operations for Disabled People , 2013 .

[23]  Terrence Fong,et al.  Novel interfaces for remote driving: gesture, haptic, and PDA , 2001, SPIE Optics East.

[24]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[25]  Hiroshi Ishii,et al.  Surflex: a programmable surface for the design of tangible interfaces , 2008, CHI Extended Abstracts.

[26]  Dick de Waard,et al.  Monitoring drivers' mental workload in driving simulators using physiological measures. , 2010, Accident; analysis and prevention.

[27]  Wendy Ju,et al.  Tunneled In: Drivers with Active Secondary Tasks Need More Time to Transition from Automation , 2017, CHI.

[28]  Albrecht Schmidt,et al.  Gestural interaction on the steering wheel: reducing the visual demand , 2011, CHI.

[29]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[30]  Jamie Zigelbaum,et al.  Shape-changing interfaces , 2011, Personal and Ubiquitous Computing.

[31]  Yangsheng Xu,et al.  Omnidirectional Steering Interface and Control for a Four-Wheel Independent Steering Vehicle , 2010, IEEE/ASME Transactions on Mechatronics.

[32]  Wendy Ju,et al.  Actions speak louder: Effects of a transforming steering wheel on post-transition driver performance , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[33]  Manfred Tscheligi,et al.  The wheels are turning: content rotation on steering wheel displays , 2013, CHI.

[34]  Terrence Fong,et al.  Vehicle Teleoperation Interfaces , 2001, Auton. Robots.

[35]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[36]  Mark Mulder,et al.  The effect of haptic guidance on curve negotiation behavior of young, experienced drivers , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[37]  Wendy Ju,et al.  Timing of unstructured transitions of control in automated driving , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[38]  Wendy Ju,et al.  Consistency in physical and on-screen action improves perceptions of telepresence robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[39]  Klaus Bengler,et al.  Ubernahmezeiten beim hochautomatisierten Autofahren , 2012 .

[40]  Klaus Bengler,et al.  How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving , 2014 .

[41]  R. Brent Gillespie,et al.  Shared Control between Human and Machine: Using a Haptic Steering Wheel to Aid in Land Vehicle Guidance , 2001 .

[42]  Wendy Ju,et al.  Haptic skin stretch on a steering wheel for displaying preview information in autonomous cars , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[43]  Stephen A. Brewster,et al.  Evaluation of Haptic Patterns on a Steering Wheel , 2016, AutomotiveUI.

[44]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[45]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.