InCarAR: A Design Space Towards 3D Augmented Reality Applications in Vehicles

Advances in vehicle automation and the resulting change of the interior of cars lead to new challenges for user interface concepts. Augmented reality (AR) is a promising solution for the emerging design needs due to its diverse opportunities for user interaction and presenting information. This paper supports the development of novel AR applications. We describe a corresponding use case set consisting of 98 examples from a literature review and two focus groups. Based on these samples we present a design space for in-car AR applications. To demonstrate the benefit thereof, we show a fictional design process including our proposed design space to derive a custom AR system. This work supports designers and engineers by providing a systematic approach for integrating 3D AR interfaces in a vehicle, excluding windshields and windows.

[1]  Lewis L. Chuang,et al.  Workshop on The Mobile Office , 2018, AutomotiveUI.

[2]  Deborah Hix,et al.  A Perceptual Matching Technique for Depth Judgments in Optical, See-Through Augmented Reality , 2006, IEEE Virtual Reality Conference (VR 2006).

[3]  Neil A. Dodgson,et al.  Autostereoscopic 3D displays , 2005, Computer.

[4]  Steve Mann,et al.  High dynamic range (HDR) video image processing for digital glass , 2012, ACM Multimedia.

[5]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[6]  Ed H. Chi,et al.  A taxonomy of visualization techniques using the data state reference model , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[7]  Arthur B. VanGundy,et al.  BRAIN WRITING FOR NEW PRODUCT IDEAS: AN ALTERNATIVE TO BRAINSTORMING , 1984 .

[8]  Lee.  Lykan Hypersport：来自中东 , 2013 .

[9]  Florian Alt,et al.  The S3D-UI designer: creating user interface prototypes for 3D displays , 2016, MUM.

[10]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[11]  Martin Halvey,et al.  Thermal icons: evaluating structured thermal feedback for mobile interaction , 2012, Mobile HCI.

[12]  Thomas J Triggs,et al.  Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. , 2006, Accident; analysis and prevention.

[13]  C. E. Rash,et al.  Helmet-mounted Displays: Sensation, Perception, and Cognition Issues , 2009 .

[14]  Andreas Butz,et al.  SupportingTrust in Autonomous Driving , 2017, IUI.

[15]  Stefan Diewald,et al.  Mobile Device Integration and Interaction in the Automotive Domain , 2011 .

[16]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[17]  Moshe Eizenman,et al.  THE IMPACT OF COGNITIVE DISTRACTION ON DRIVER VISUAL BEHAVIOUR AND VEHICLE CONTROL , 2002 .

[18]  Gudrun Klinker,et al.  Survey and Classification of Head-Up Display Presentation Principles , 2009 .

[19]  Philipp Wintersberger,et al.  Workaholistic: on balancing typing- and handover-performance in automated driving , 2018, MobileHCI.

[20]  Joseph J. LaViola,et al.  Dynamic Stereoscopic 3D Parameter Adjustment for Enhanced Depth Discrimination , 2016, CHI.

[21]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[22]  Robert W. Heath,et al.  Five disruptive technology directions for 5G , 2013, IEEE Communications Magazine.

[23]  Florian Alt,et al.  A Design Space to Support the Development of Windshield Applications for the Car , 2016, CHI.

[24]  Luís Ducla Soares,et al.  Spatial and temporal prediction scheme for 3D holoscopic video coding based on H.264/AVC , 2012, 2012 19th International Packet Video Workshop (PV).

[25]  Tobias Brandt.  Information Systems in Automobiles - Past, Present, and Future Uses , 2013, AMCIS.

[26]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual evaluations and requirements of three-dimensional TV , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Niels Henze,et al.  Design and evaluation of a layered handheld 3d display with touch-sensitive front and back , 2014, NordiCHI.

[28]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[29]  Albrecht Schmidt,et al.  Requirements and design space for interactive public displays , 2010, ACM Multimedia.

[30]  Andrew L. Kun,et al.  Calling while driving: an initial experiment with hololens , 2017 .

[31]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[32]  Matthias Wöpking,et al.  3-D displays: A review of current technologies , 1997 .

[33]  Andreas Butz,et al.  Supporting Trust in Autonomous Driving , 2017 .

[34]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[35]  Ernst Lueder.  3D Displays: Lueder/3D Displays , 2011 .

[36]  Heinrich Hußmann,et al.  Adjunct Proceedings of the 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications , 2018 .

[37]  Dora E Angelaki,et al.  The neural basis of depth perception from motion parallax , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  Aykut Avci,et al.  P-159L: Late-News Poster: A Liquid Crystal Based Contact Lens Display Using PEDOT: PSS and Obliquely Evaporated SiO2 , 2012 .

[39]  Albrecht Schmidt,et al.  Shifting Gears: User Interfaces in the Age of Autonomous Driving , 2016, IEEE Pervasive Computing.

[40]  Gerhard Rigoll,et al.  Exploring floating stereoscopic driver-car interfaces with wide field-of-view in a mixed reality simulation , 2016, VRST.

[41]  Arnulf Remote,et al.  PICTORIAL COMMUNICATION IN VIRTUAL AND REAL ENVIRONMENTS , 1992 .

[42]  Albrecht Schmidt,et al.  Design space for driver-based automotive user interfaces , 2009, AutomotiveUI.

[43]  Sonja Rümelin,et al.  Clicks are in the Air: How to Support the Interaction with Floating Objects through Ultrasonic Feedback , 2017, AutomotiveUI.

[44]  長田 昌次郎,et al.  How to Reinforce Perception of Depth in Single Two-Dimensional Pictures , 1986 .

[45]  Florian Alt,et al.  3D Displays in Cars: Exploring the User Performance for a Stereoscopic Instrument Cluster , 2014, AutomotiveUI.

[46]  Florian Alt,et al.  Introducing novel technologies in the car: conducting a real-world study to test 3D dashboards , 2015, AutomotiveUI.

[47]  T. Litman.  Victoria Transport Policy Institute , 2004 .

[48]  H. Jorke,et al.  Advanced Stereo Projection Using Interference Filters , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[49]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[50]  Nora Broy.  Stereoscopic 3D user interfaces : exploring the potentials and risks of 3D displays in cars , 2016 .

[51]  H. Hsu.  Volumetric three-dimensional display system [Book Review] , 2001, IEEE Circuits and Devices Magazine.

[52]  Oliver Bimber,et al.  Video see-through AR on consumer cell-phones , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[53]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[54]  S. Ellis.  Pictorial communication in virtual and real environments , 1991 .

[55]  Anthony Tang,et al.  Scale Impacts Elicited Gestures for Manipulating Holograms: Implications for AR Gesture Design , 2018, Conference on Designing Interactive Systems.

[56]  Kelly A. Sprehn,et al.  Augmented Reality Design Heuristics: Designing for Dynamic Interactions , 2017 .

[57]  Andreas Butz,et al.  Content Destabilization for Head-Mounted Displays , 2015, CHI.

[58]  Yu Yuan,et al.  All Reality: Virtual, Augmented, Mixed (X), Mediated (X, Y), and Multimediated Reality , 2018, ArXiv.

[59]  Eric Kolstad,et al.  Egocentric depth judgments in optical, see-through augmented reality , 2007, IEEE Transactions on Visualization and Computer Graphics.

[60]  Judy M. Vance,et al.  Assessment of VR Technology and its Applications to Engineering Problems , 2001, J. Comput. Inf. Sci. Eng..

[61]  Kathrin Pollmann,et al.  How to Work in the Car of the Future?: A Neuroergonomical Study Assessing Concentration, Performance and Workload Based on Subjective, Behavioral and Neurophysiological Insights , 2019, CHI.

[62]  Bastian Pfleging,et al.  Investigating user needs for non-driving-related activities during automated driving , 2016, MUM.

[63]  E. Laurier.  Doing Office Work on the Motorway , 2004 .

[64]  Graham R Jones,et al.  Controlling perceived depth in stereoscopic images , 2001, IS&T/SPIE Electronic Imaging.

[65]  Holger Regenbrecht,et al.  Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[66]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[67]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[68]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .