Assessing target acquisition and tracking performance for complex moving targets in the presence of latency and jitter

Many modern games and game systems allow for networked remote participation. In such networks latency variability is a commonly encountered factor, but there is still little information available to designers about how human performance changes in the presence of delay. To add to our understanding of performance thresholds for mouse-based tasks that are common in real-time games, we carried out a study of human target acquisition and target tracking in the presence of latency and jitter (variance in latency), for various target velocities and trajectories. Our study indicates critical thresholds at which human performance decreases in the presence of delay. Target acquisition accuracy drops very quickly for latencies over 50 ms and for high velocities. Tracking error, however, is only slightly affected by latency, with deterioration starting at around 110 ms. The effects of latency and target velocity on errors are close to linear, and transverse error is usually smaller than longitudinal error. These results help to quantify the effects of delay on closely-coupled interactive tasks in networked games and real-time groupware systems. They also aid designers in determining when it is critical to improve system parameters and when to apply prediction and delay-compensation algorithms to improve quality of interaction.

[1]  Sion Jennings,et al.  The Effect of Visual System Time Delay on Helicopter Control , 2000 .

[2]  E. C. Poulton,et al.  Tracking skill and manual control , 1974 .

[3]  I. Scott MacKenzie,et al.  Measuring the effective parameters of steering motions , 2005, CHI Extended Abstracts.

[4]  Robert S. Allison,et al.  Tolerance of temporal delay in virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[5]  Andriy Pavlovych,et al.  Target following performance in the presence of latency, jitter, and signal dropouts , 2011, Graphics Interface.

[6]  Nicholas L. Port,et al.  Motor Cortical Activity during Interception of Moving Targets. , 2001, Journal of Cognitive Neuroscience.

[7]  Bernard D. Adelstein,et al.  Factors influencing operator interaction with virtual objects viewed via head-mounted see-through displays: viewing conditions and rendering latency , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[8]  Robert S. Bolia,et al.  ASSESSING SIMULATOR SICKNESS IN A SEE-THROUGH HMD: EFFECTS OF TIME DELAY, TIME ON TASK, AND TASK COMPLEXITY , 2000 .

[9]  Bernard D. Adelstein,et al.  Discrimination of changes in latency during head movement , 1999, HCI.

[10]  E. Poulton PERCEPTUAL ANTICIPATION IN TRACKING WITH TWO-POINTER AND ONE-POINTER DISPLAYS , 1952 .

[11]  Mark R. Mine Characterization of End-to-End Delays in Head-Mounted Display Systems , 1993 .

[12]  M. Young,et al.  Discrimination of Changes of Latency during Voluntary Hand Movement of Virtual Objects , 1999 .

[13]  T. C. Nicholas Graham,et al.  It's about time: confronting latency in the development of groupware systems , 2011, CSCW.

[14]  I. Scott MacKenzie,et al.  Lag as a determinant of human performance in interactive systems , 1993, INTERCHI.

[15]  Robert J. Teather,et al.  Effects of tracking technology, latency, and spatial jitter on object movement , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[16]  R.H.Y. So,et al.  Sensory Motor Responses in Virtual Environments: Studying the Effects of Image Latencies for Target-directed Hand Movement , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[17]  Grenville J. Armitage,et al.  Limitations of using real-world, public servers to estimate jitter tolerance of first person shooter games , 2004, ACE '04.

[18]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .

[19]  Lars C. Wolf,et al.  On the impact of delay on real-time multiplayer games , 2002, NOSSDAV '02.

[20]  Carl Gutwin,et al.  The Effects of Feedback on Targeting with Multiple Moving Targets , 2004, Graphics Interface.

[21]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[22]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[23]  P. Viviani,et al.  The law relating the kinematic and figural aspects of drawing movements. , 1983, Acta psychologica.

[24]  E. Hoffmann Capture of moving targets: a modification of Fitts' Law , 1991 .

[25]  Andriy Pavlovych,et al.  The tradeoff between spatial jitter and latency in pointing tasks , 2009, EICS '09.

[26]  Eric Foxlin,et al.  Motion Tracking Requirements and Technologies , 2002 .

[27]  Robert S. Allison,et al.  Variability-Aware Latency Amelioration in Distributed Environments , 2007, 2007 IEEE Virtual Reality Conference.

[28]  Tovi Grossman,et al.  Comet and target ghost: techniques for selecting moving targets , 2011, CHI.

[29]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[30]  Jean-Daniel Fekete,et al.  Motion-pointing: target selection using elliptical motions , 2009, CHI.