Two touch system latency estimators: high accuracy and low overhead

The end-to-end latency of interactive systems is well known to degrade user's performance. Touch systems exhibit notable amount of latencies, but it is seldom characterized, probably because latency estimation is a difficult and time consuming undertaking. In this paper, we introduce two novel approaches to estimate the latency of touch systems. Both approaches require an operator to slide a finger on the touch surface, and provide automatic processing of the recorded data. The High Accuracy (HA) approach requires an external camera and careful calibration, but provides a large sample set of accurate latency estimations. The Low Overhead (LO) approach, while not offering as much accuracy as the HA approach, does not require any additional equipment and is implemented in a few lines of code. In a set of experiments, we show that the HA approach can generate a highly detailed picture of the latency distribution of the system, and that the LO approach provides average latency estimates no further than 4 ms from the HA estimate.

[1]  Robert J. Teather,et al.  Effects of tracking technology, latency, and spatial jitter on object movement , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[2]  William Ribarsky,et al.  Effects of Variation in System Responsiveness on User Performance in Virtual Environments , 1998, Hum. Factors.

[3]  Chris Shaw,et al.  On temporal-spatial realism in the virtual reality environment , 1991, UIST '91.

[4]  Andriy Pavlovych,et al.  The tradeoff between spatial jitter and latency in pointing tasks , 2009, EICS '09.

[5]  Anthony Steed A simple method for estimating the latency of interactive, real-time graphics simulations , 2008, VRST '08.

[6]  Shumin Zhai,et al.  FFitts law: modeling finger touch with fitts' law , 2013, CHI.

[7]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[8]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[9]  I. Scott MacKenzie,et al.  Lag as a determinant of human performance in interactive systems , 1993, INTERCHI.

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  Bernard D. Adelstein,et al.  A testbed for characterizing dynamic response of virtual environment spatial sensors , 1992, UIST '92.

[12]  Colin Swindells,et al.  System lag tests for augmented and virtual environments , 2000, UIST '00.

[13]  Daniel J. Wigdor,et al.  How fast is fast enough?: a study of the effects of latency in direct-touch pointing tasks , 2013, CHI.

[14]  Patrick Baudisch,et al.  Understanding touch , 2011, CHI.

[15]  Mark R. Mine Characterization of End-to-End Delays in Head-Mounted Display Systems , 1993 .

[16]  Daniel J. Wigdor,et al.  Designing for low-latency direct-touch input , 2012, UIST.