Eyes-free In-vehicle Gesture Controls: Auditory-only Displays Reduced Visual Distraction and Workload

Visual distractions increase crash risk while driving. Our research focuses on creating and evaluating an air gesture control system that is less visually demanding than current infotainment systems. We completed a within-subjects experiment with 24 participants, each of whom completed a simulated drive while using six different prototypes, in turn. The primary research questions were the influence of combinations of visual and auditory displays (visual, visual/auditory, auditory) and control orientation (vertical vs horizontal). We recorded lane departures, eye glance behavior, secondary task performance, and driver workload. Results demonstrated that for lane departures all prototypes performed comparably, with the auditory-only showing a strong tendency of improvements. A deeper look illustrated a tradeoff between eyes-on-road time and secondary task completion time for the auditory-only display -- the safest but slowest among the six prototypes. The auditory-only also reduced overall workload. Control orientation showed only small subjective effect in favor of vertical controls.

[1]  Paul Green.  INTERNATIONAL INCIDENTS: CRASHES INDUCED BY DRIVER INFORMATION SYSTEMS AND WHAT CAN BE DONE TO REDUCE THEM. , 2000 .

[2]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[3]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[4]  Bruce N. Walker,et al.  A Multimodal Air Gesture Interface for In Vehicle Menu Navigation , 2014, AutomotiveUI.

[5]  Mohan M. Trivedi,et al.  Hand gesture-based visual user interface for infotainment , 2012, AutomotiveUI.

[6]  Klaus Bengler,et al.  Gesture Control for Use in Automobiles , 2000, MVA.

[7]  Louis Tijerina,et al.  MODELLING THE RELATIONSHIP BETWEEN DRIVER IN-VEHICLE VISUAL DEMANS AND ACCIDENT OCCURRENCE , 1998 .

[8]  Mark Billinghurst,et al.  A user study of auditory versus visual interfaces for use while driving , 2008, Int. J. Hum. Comput. Stud..

[9]  Thomas A. Dingus,et al.  The 100-Car Naturalistic Driving Study Phase II – Results of the 100-Car Field Experiment , 2006 .

[10]  Dot Hs,et al.  The 100-Car Naturalistic Driving Study Phase II - Results of the 100-Car Field Experiment , 2006 .

[11]  Steven Landry,et al.  Towards an in-vehicle sonically-enhanced gesture control interface: A pilot study , 2016, ICAD 2016.

[12]  Gary E. Burnett,et al.  On-the-move destination entry for vehicle navigation systems: Unsafe by any means? , 2004, Behav. Inf. Technol..

[13]  N. Cairnie,et al.  Using finger-pointing to operate secondary controls in automobiles , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[14]  Andreas Riener.  Gestural Interaction in Vehicular Applications , 2012, Computer.

[15]  Richard J. Hanowski,et al.  Driver Distraction in Commercial Vehicle Operations , 2009 .

[16]  D. Holdstock.  Past, present--and future? , 2005, Medicine, conflict, and survival.

[17]  Micah Alpern,et al.  Developing a car gesture interface for use as a secondary task , 2003, CHI Extended Abstracts.

[18]  Abdulmotaleb El-Saddik,et al.  Motion-path based in car gesture control of the multimedia devices , 2011, DIVANet '11.