Exploring Application Opportunities for Smart Vehicles in the Continuous Interaction Space Inside and Outside the Vehicle

We describe applications that implement interactions between the driver and their smart vehicle in a continuous interaction space characterized by the physical distance to the vehicle and by the smart devices that implement those interactions. Specifically, we demonstrate the principles of smart vehicle proxemics with smart rings, smartwatches, smartphones, and other devices employed to interact with the in-vehicle infotainment system while the driver traverses five distinctly identifiable zones, from inside the vehicle to the personal, proximal, distant, and covert zone outside the vehicle. We present engineering details of our applications that capitalize on standardized web technology (HTML, CSS, JavaScript), communication protocols (WebSocket), and data formats (JSON) and, thus, enable straightforward extension to accommodate other smart devices for new interactions with smart vehicles. We also point to future opportunities for designing interactions from a distance and function of the distance between the driver and their vehicle.

[1]  Erno Salmela,et al.  Digital Smart Jewelry: Next Revolution of Jewelry Industry? , 2018 .

[2]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[3]  Stefan Schneegaß,et al.  User-Defined Voice and Mid-Air Gesture Commands for Maneuver-based Interventions in Automated Vehicles , 2019, MuC.

[4]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[5]  Radu-Daniel Vatavu,et al.  From Controls on the Steering Wheel to Controls on the Finger: Using Smart Rings for In-Vehicle Interactions , 2020, Conference on Designing Interactive Systems.

[6]  Ignacio Alvarez,et al.  Voice interfaced vehicle user help , 2010, AutomotiveUI.

[7]  E. Hall,et al.  The Hidden Dimension , 1970 .

[8]  Sebastian Boring,et al.  Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies , 2015, MobileHCI.

[9]  Saul Greenberg,et al.  Using digital but physical surrogates to mediate awareness, communication and privacy in media spaces , 1999, Personal Technologies.

[10]  Radu-Daniel Vatavu,et al.  A Synopsis of Input Modalities for In-Vehicle Infotainment and Consumption of Interactive Media , 2020, IMX.

[11]  Radu-Daniel Vatavu,et al.  A multistudy investigation of drivers and passengers’ gesture and voice input preferences for in-vehicle interactions , 2020 .

[12]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[13]  Morten Fjeld,et al.  Exploring Proxemics for Human-Drone Interaction , 2017, HAI.

[14]  Radu-Daniel Vatavu,et al.  A design space for vehicular lifelogging to support creation of digital content in connected cars , 2019, EICS.

[15]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[16]  Radu-Daniel Vatavu,et al.  Detecting and Tracking Multiple Users in the Proximity of Interactive Tabletops , 2008 .

[17]  Jens Emil Grønbæk,et al.  Proxemics Beyond Proximity: Designing for Flexible Social Interaction Through Cross-Device Interaction , 2020, CHI.

[18]  Jean Vanderdonckt,et al.  Euphoria: A Scalable, event-driven architecture for designing interactions across heterogeneous devices in smart environments , 2019, Inf. Softw. Technol..

[19]  Len Hamey,et al.  Designing a user-defined gesture vocabulary for an in-vehicle climate control system , 2016, OZCHI.

[20]  Albrecht Schmidt,et al.  Proxemic zones of exhibits and their manipulation using floor projection , 2016, PerDis.

[21]  Radu-Daniel Vatavu,et al.  Empirical Results for High-definition Video and Augmented Reality Content Delivery in Hyper-connected Cars , 2021, Interact. Comput..

[22]  Mohammed A. Qadeer,et al.  4G as a Next Generation Wireless Network , 2009, 2009 International Conference on Future Computer and Communication.

[23]  F. Previc The neuropsychology of 3-D space. , 1998, Psychological bulletin.

[24]  Ki Jun Han,et al.  Social vehicle-to-everything (V2X) communication model for intelligent transportation systems based on 5G scenario , 2018, ICFNDS.

[25]  Alberto Ferreira de Souza,et al.  Self-Driving Cars: A Survey , 2019, Expert Syst. Appl..

[26]  Paul Johns,et al.  Tattio: Fabrication of Aesthetic and Functional Temporary Tattoos , 2016, CHI Extended Abstracts.

[27]  Tom Gross,et al.  The Effects of Situational Demands on Gaze, Speech and Gesture Input in the Vehicle , 2017, AutomotiveUI.

[28]  Fred H. Previc,et al.  The Neuropsychology of 3-D Space , 1998 .

[29]  Bilge Mutlu,et al.  Human-robot proxemics: Physical and psychological distancing in human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Radu-Daniel Vatavu,et al.  Smart Vehicle Proxemics: A Conceptual Framework Operationalizing Proxemics in the Context of Outside-the-Vehicle Interactions , 2021, INTERACT.