Calling while Driving Using Augmented Reality: Blessing or Curse?

We report on an experiment on the distracting effects of in-car conversations through augmented-reality glasses. Previous research showed that in-car phone conversations can be distracting, but that the distraction might be reduced if the remote caller receives visual information about the driving context. However, what happens if such video sharing becomes bidirectional? The recent introduction of commercial augmented-reality glasses in particular might allow drivers to engage in video-supported conversations while driving. We investigate how distracting such video-based conversations are in an experiment. Our participants operated a simulated vehicle, while also playing a conversational game (Taboo) with a remote conversant. The driver either only heard the remote conversant (speech-only condition), or was also able to see the remote person in a virtual window that was presented through augmented reality (video call condition). Results show that our participants did not spend time looking at the video of the remote conversant. We hypothesize that this was due to the fact that in our experiment participants had to turn their head to get a full view of the virtual window. Our results imply that we need further studies on the effects of augmented reality on the visual attention of the driver, before the technology is used on the road.

[1]  Robert Xiao,et al.  Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays , 2016, CHI.

[2]  Dario D. Salvucci.  Predicting the effects of in-car interface use on driver performance: an integrated model approach , 2001, Int. J. Hum. Comput. Stud..

[3]  Albrecht Schmidt,et al.  Shifting Gears: User Interfaces in the Age of Autonomous Driving , 2016, IEEE Pervasive Computing.

[4]  Victor Ng-Thow-Hing,et al.  Personal Navi: Benefits of an Augmented Reality Navigational Aid Using a See-Thru 3D Volumetric HUD , 2014, AutomotiveUI.

[5]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[6]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[7]  Thomas Schiex,et al.  Soft Constraints , 2000, WLP.

[8]  Shamsi T. Iqbal,et al.  Sharing a driver's context with a caller via continuous audio cues to increase awareness about driver state. , 2014, Journal of experimental psychology. Applied.

[9]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[10]  John G. Gaspar,et al.  Providing Views of the Driving Scene to Drivers’ Conversation Partners Mitigates Cell-Phone-Related Distraction , 2014, Psychological science.

[11]  Mark Vollrath,et al.  Conversing while driving: The importance of visual information for conversation modulation , 2011 .

[12]  Gary E. Burnett,et al.  The Effects of Augmented Reality Head-Up Displays on Drivers' Eye Scan Patterns, Performance, and Perceptions , 2017, Int. J. Mob. Hum. Comput. Interact..

[13]  Andrew L. Kun,et al.  Spoken tasks for human-human experiments: towards in-car speech user interfaces for multi-threaded dialogue , 2010, AutomotiveUI.

[14]  Eric Horvitz,et al.  Hang on a sec!: effects of proactive mediation of phone conversations while driving , 2011, CHI.

[15]  Elsevier Sdol.  Transportation Research Part F: Traffic Psychology and Behaviour , 2009 .

[16]  Andrew L. Kun,et al.  Calling while driving: an initial experiment with hololens , 2017 .

[17]  Thomas A. Dingus,et al.  An overview of the 100-car naturalistic study and findings , 2005 .

[18]  Tim Paek,et al.  Augmented reality vs. street views: a driving simulator study comparing two emerging navigation aids , 2011, Mobile HCI.

[19]  Joseph L. Gabbard,et al.  Behind the Glass: Driver Challenges and Opportunities for AR Automotive Applications , 2014, Proceedings of the IEEE.

[20]  David L. Strayer,et al.  Driven to Distraction: Dual-Task Studies of Simulated Driving and Conversing on a Cellular Telephone , 2001, Psychological science.

[21]  T. Dingus,et al.  Distracted driving and risk of road crashes among novice and experienced drivers. , 2014, The New England journal of medicine.

[22]  Feng Guo,et al.  Driver crash risk factors and prevalence evaluation using naturalistic driving data , 2016, Proceedings of the National Academy of Sciences.

[23]  Wayne D. Gray,et al.  The soft constraints hypothesis: a rational analysis approach to resource allocation for interactive behavior. , 2006, Psychological review.

[24]  Andrew L. Kun,et al.  User interfaces for first responder vehicles: views from practitioners, industry, and academia , 2015, AutomotiveUI.

[25]  Albrecht Schmidt,et al.  Exploring user expectations for context and road video sharing while calling and driving , 2013, AutomotiveUI.

[26]  Samuel G Charlton,et al.  Driving while conversing: cell phones that distract and passengers who react. , 2009, Accident; analysis and prevention.

[27]  Sara B. Kiesler,et al.  Calling while driving: effects of providing remote traffic context , 2005, CHI.

[28]  Andrew L. Kun,et al.  Interactions between human–human multi-threaded dialogues and driving , 2012, Personal and Ubiquitous Computing.

[29]  Antonio Krüger,et al.  Interrupted by a phone call: exploring designs for lowering the impact of call notifications for smartphone users , 2014, CHI.

[30]  Andrew L. Kun,et al.  Estimating cognitive load using pupil diameter during a spoken dialogue task , 2013, AutomotiveUI.

[31]  K A Brookhuis,et al.  The effects of mobile telephoning on driving performance. , 1991, Accident; analysis and prevention.

[32]  David R. Large,et al.  An investigation of augmented reality presentations of landmark-based navigation using a head-up display , 2015, AutomotiveUI.

[33]  Sukeshini A. Grandhi,et al.  Knock, knock! who's there? Putting the user in control of managing interruptions , 2015, Int. J. Hum. Comput. Stud..

[34]  Peter Fröhlich,et al.  Investigating safety services on the motorway: the role of realistic visualization , 2011, AutomotiveUI.

[35]  Stephen A. Brewster,et al.  I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR , 2017, CHI.

[36]  Andrew L. Kun,et al.  On the feasibility of using pupil diameter to estimate cognitive load changes for in-vehicle spoken dialogues , 2013, INTERSPEECH.

[37]  David Crundall,et al.  Regulating Conversation During Driving: A Problem for Mobile Telephones? , 2005 .

[38]  John W. Senders,et al.  THE ATTENTIONAL DEMAND OF AUTOMOBILE DRIVING , 1967 .

[39]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[40]  D. Strayer,et al.  Passenger and Cell-Phone Conversations in Simulated Driving , 2004, Journal of experimental psychology. Applied.

[41]  Michael A. Cohen,et al.  Telephone conversation impairs sustained visual attention via a central bottleneck , 2008, Psychonomic bulletin & review.

[42]  Philipp Wintersberger,et al.  Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems , 2017, CHItaly.

[43]  Andrew L. Kun,et al.  Video call, or not, that is the question , 2012, CHI EA '12.

[44]  Eric Horvitz,et al.  Cars, calls, and cognition: investigating driving and divided attention , 2010, CHI.