Gremlin: scheduling interactions in vehicular computing

Vehicular applications must not demand too much of a driver's attention. They often run in the background and initiate interactions with the driver to deliver important information. We argue that the vehicular computing system must schedule interactions by considering their priority, the attention they will demand, and how much attention the driver currently has to spare. Based on these considerations, it should either allow a given interaction or defer it. We describe a prototype called Gremlin that leverages edge computing infrastructure to help schedule interactions initiated by vehicular applications. It continuously performs four tasks: (1) monitoring driving conditions to estimate the driver's available attention, (2) recording interactions for analysis, (3) generating a user-specific quantitative model of the attention required for each distinct interaction, and (4) scheduling new interactions based on the above data. Gremlin performs the third task on edge computing infrastructure. Offload is attractive because the analysis is too computationally demanding to run on vehicular platforms. Since recording size for each interaction can be large, it is preferable to perform the offloaded computation at the edge of the network rather than in the cloud, and thereby conserve wide-area network bandwidth. We evaluate Gremlin by comparing its decisions to those recommended by a vehicular UI expert. Gremlin's decisions agree with the expert's over 90% of the time, much more frequently than the coarse-grained scheduling policies used by current vehicle systems. Further, we find that offloading of analysis to edge platforms reduces use of wide-area networks by an average of 15MB per analyzed interaction.

[1]  A Stevens,et al.  DESIGN GUIDELINES FOR SAFETY OF IN-VEHICLE INFORMATION SYSTEMS , 2002 .

[2]  Jung Wook Park,et al.  Integrated Driving Aware System in the Real-World: Sensing, Computing and Feedback , 2016, CHI Extended Abstracts.

[3]  Byung-Gon Chun,et al.  TaintDroid: An Information-Flow Tracking System for Realtime Privacy Monitoring on Smartphones , 2010, OSDI.

[4]  Brian P. Bailey,et al.  Understanding and developing models for detecting and differentiating breakpoints during interactive tasks , 2007, CHI.

[5]  Steve Benford,et al.  Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications , 2011, Mobile HCI.

[6]  Chin-Chiuan Lin Effects of contrast ratio and text color on visual performance with TFT-LCD , 2003 .

[7]  Jason Flinn,et al.  AMC: verifying user interface properties for vehicular applications , 2013, MobiSys '13.

[8]  Brian P. Bailey,et al.  On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state , 2006, Comput. Hum. Behav..

[9]  Georg Jahn,et al.  Peripheral detection as a workload measure in driving: Effects of traffic complexity and route guidance system use in a driving study , 2005 .

[10]  John W. Senders,et al.  THE ATTENTIONAL DEMAND OF AUTOMOBILE DRIVING , 1967 .

[11]  Omer Tsimhoni,et al.  EFFECTS OF VISUAL DEMAND AND IN-VEHICLE TASK COMPLEXITY ON DRIVING AND TASK PERFORMANCE AS ASSESSED BY VISUAL OCCLUSION , 1999 .

[12]  D. Allport,et al.  On the Division of Attention: A Disproof of the Single Channel Hypothesis , 1972, The Quarterly journal of experimental psychology.

[13]  Weina Qu,et al.  An Empirical Study on the Smallest Comfortable Button/Icon Size on Touch Screen , 2007, HCI.

[14]  David L. Strayer,et al.  Measuring Cognitive Distraction in the Automobile , 2013 .

[15]  Albert Kircher,et al.  Driver experience and cognitive workload in different traffic environments. , 2006, Accident; analysis and prevention.

[16]  Mahadev Satyanarayanan,et al.  Agile application-aware adaptation for mobility , 1997, SOSP.

[17]  Ted Selker,et al.  Task Load Estimation and Mediation Using Psycho-physiological Measures , 2016, IUI.

[18]  Bernt Schiele,et al.  Context-aware notification for wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[19]  Paul Green,et al.  Driver Distraction, Telematics Design, and Workload Managers: Safety Issues and Solutions , 2004 .

[20]  Emmett Witchel,et al.  Ryoan: A Distributed Sandbox for Untrusted Computation on Secret Data , 2016, OSDI.

[21]  Olsson Measuring Driver Visual Distraction with a Peripheral Detection Task , 2000 .

[22]  Galen C. Hunt,et al.  Shielding Applications from an Untrusted Cloud with Haven , 2014, OSDI.

[23]  Xiaofeng Wang,et al.  CapSeat: capacitive proximity sensing for automotive activity recognition , 2015, AutomotiveUI.

[24]  Jan E B Törnros,et al.  Mobile phone use-effects of handheld and handsfree phones on driving performance. , 2005, Accident; analysis and prevention.

[25]  Martina Ziefle,et al.  Effects of Display Resolution on Visual Performance , 1998, Hum. Factors.

[26]  Albert Kircher,et al.  Using mobile telephones: cognitive workload and attention resource allocation. , 2004, Accident; analysis and prevention.

[27]  Eric Horvitz,et al.  Learning and reasoning about interruption , 2003, ICMI '03.

[28]  Paul Milgram,et al.  An Investigation of Attentional Demand in a Simulated Driving Environment , 2000 .

[29]  An-Hsiang Wang,et al.  Effects of polarity and luminance contrast on visual performance and VDT display quality , 2000 .

[30]  Eric Horvitz,et al.  Notifications and awareness: a field study of alert usage and preferences , 2010, CSCW '10.

[31]  Tadashi Okoshi,et al.  Attelia: sensing user's attention status on smart phones , 2014, UbiComp Adjunct.

[32]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[33]  Yukinobu Nakamura JAMA Guideline for In-Vehicle Display Systems , 2008 .

[34]  Peng Liu,et al.  Lightweight Multitenancy at the Network’s Extreme Edge , 2017, Computer.

[35]  Eric Horvitz,et al.  Disruption and recovery of computing tasks: field study, analysis, and directions , 2007, CHI.

[36]  Silvia Zuffi,et al.  Human Computer Interaction: Legibility and Contrast , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[37]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[38]  Joyce Ho,et al.  Using context-aware computing to reduce the perceived burden of interruptions from mobile devices , 2005, CHI.

[39]  David L. Strayer,et al.  Measuring Cognitive Distraction in the Automobile II: Assessing In-Vehicle Voice-Based InteractiveTechnologies , 2014 .

[40]  Natasha Merat,et al.  Surrogate in-vehicle information systems and driver behaviour: effects of visual and cognitive load in simulated rural driving , 2005 .

[41]  Todd D. Millstein,et al.  RERAN: Timing- and touch-sensitive record and replay for Android , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[42]  Richard Young,et al.  Revised Odds Ratio Estimates of Secondary Tasks: A Re-Analysis of the 100-Car Naturalistic Driving Study Data , 2015 .

[43]  Jason Flinn,et al.  The Case for Operating System Management of User Attention , 2015, HotMobile.

[44]  Marieke Hendrikje Martens,et al.  Measuring distraction: the Peripheral Detection Task , 2000 .

[45]  Anind K. Dey,et al.  Sensors Know When to Interrupt You in the Car: Detecting Driver Interruptibility Through Monitoring of Peripheral Interactions , 2015, CHI.

[46]  Peng Liu,et al.  ParaDrop: Enabling Lightweight Multi-tenancy at the Network’s Extreme Edge , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[47]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[48]  Lisbeth Harms,et al.  Peripheral detection as a measure of driver distraction. a study of memory-based versus system-based navigation in a built-up area , 2003 .

[49]  Ada Gavrilovska,et al.  Fast, Scalable and Secure Onloading of Edge Functions Using AirBox , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[50]  Eric Horvitz,et al.  Attention-Sensitive Alerting , 1999, UAI.

[51]  Krisztián Flautner,et al.  Vertigo: Automatic Performance-Setting for Linux , 2002, OSDI.

[52]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .