You Do Not Have to Touch to Select: A Study on Predictive In-car Touchscreen with Mid-air Selection

In this paper, we first give an overview of the predictive display concept, which aims to minimise the demand associated with interacting with in-vehicle displays, such as touchscreens, via free hand pointing gestures. It determines the item the user intends to select, early in the pointing gesture, and accordingly simplifies-expedites the target acquisition. A study to evaluate the impact of using a predictive touchscreen in a car is then presented. The mid-air selection pointing facilitation scheme is applied, such that the user does not have to physically touch the interactive surface. Instead, the predictive display auto-selects the predicted interface icon on behalf of the user, once the required level of inference certainty is achieved. The study results, which are based on data collected from 20 participants under various driving-road conditions, demonstrate that a predictive display can significantly reduce the workload, effort and durations of completing on-screen selection tasks in vehicles.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  Birsen Donmez,et al.  Measuring Inhibitory Control in Driver Distraction , 2014, AutomotiveUI.

[3]  Natassia Goode,et al.  The impact of on-road motion on BMS touch screen device operation , 2012, Ergonomics.

[4]  Simon J. Godsill,et al.  Bayesian Intent Prediction in Object Tracking Using Bridging Distributions , 2015, IEEE Transactions on Cybernetics.

[5]  Lee Skrypchuk,et al.  Touchscreen usability and input performance in vehicles under different road conditions: an evaluative study , 2015, AutomotiveUI.

[6]  Edward Lank,et al.  Endpoint prediction using motion kinematics , 2007, CHI.

[7]  Lee Skrypchuk,et al.  Intent Inference for Hand Pointing Gesture-Based Interactions in Vehicles , 2016, IEEE Transactions on Cybernetics.

[8]  Neville A. Stanton,et al.  Usability Evaluation for In-Vehicle Systems , 2013 .

[9]  Simon J. Godsill,et al.  Filtering perturbed in-vehicle pointing gesture trajectories: Improving the reliability of intent inference , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[10]  I. Scott MacKenzie,et al.  Fitts' throughput and the speed-accuracy tradeoff , 2008, CHI.

[11]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[12]  Mohan M. Trivedi,et al.  Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[13]  Lee Skrypchuk,et al.  Visual-haptic feedback interaction in automotive touchscreens , 2012, Displays.

[14]  Paul M. Salmon,et al.  The effects of motion on in-vehicle touch screen system operation: A battle management system case study , 2011 .

[15]  Atsuo Murata,et al.  Improvement of Pointing Time by Predicting Targets in Pointing With a PC Mouse , 1998, Int. J. Hum. Comput. Interact..

[16]  Sunghyuk Kwon,et al.  The effect of touch-key size on the usability of In-Vehicle Information Systems and driving safety during simulated driving. , 2014, Applied ergonomics.

[17]  Anind K. Dey,et al.  Probabilistic pointing target prediction via inverse optimal control , 2012, IUI '12.

[18]  Gary E. Burnett,et al.  Ubiquitous computing within cars: designing controls for non-visual use , 2001, Int. J. Hum. Comput. Stud..

[19]  Lee Skrypchuk,et al.  Interactive Displays in Vehicles: Improving Usability with a Pointing Gesture Tracker and Bayesian Intent Predictors , 2014, AutomotiveUI.

[20]  Richard Bishop,et al.  Intelligent Vehicle Technology and Trends , 2005 .

[21]  S. Daniel,et al.  National Highway Traffic Safety Administration , 2020, Federal Regulatory Guide.

[22]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[23]  Jacob O. Wobbrock,et al.  Mouse pointing endpoint prediction using kinematic template matching , 2014, CHI.

[24]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[25]  Ravin Balakrishnan,et al.  Fitts' law and expanding targets: Experimental studies and designs for user interfaces , 2005, TCHI.