Ka-Boom!!! Visually Exploring Latency Measurements for XR

Latency can be detrimental for the experience of Virtual Reality. High latency can lead to loss of performance and cybersickness. There are simple approaches to measure approximate latency and more elaborated for more insight into latency behavior. Yet there are still researchers who do not measure the latency of the system they are using to conduct VR experiments. This paper provides an illustrated overview of different approaches to measure latency of VR applications, as well as a small decision-making guide to assist in the choice of the measurement method. The visual style offers a more approachable way to understand how to measure latency.

[1]  Ryugo Kijima,et al.  Measurement of Head Mounted Display's latency in rotation and side effect caused by lag compensation by simultaneous observation — An example result using Oculus Rift DK2 , 2016, 2016 IEEE Virtual Reality (VR).

[2]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[3]  Matthias Walter,et al.  In the Right Place at the Right Time? A View at Latency and Its Implications for Automotive Augmented Reality Head-Up Displays , 2018 .

[4]  Robin Wolff,et al.  Comparing the End to End Latency of an Immersive Collaborative Environment and a Video Conference , 2009, 2009 13th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications.

[5]  Mar Gonzalez-Franco,et al.  Measuring System Visual Latency through Cognitive Latency on Video See-Through AR devices , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[6]  Colin Swindells,et al.  System lag tests for augmented and virtual environments , 2000, UIST '00.

[7]  Cheng-Hsin Hsu,et al.  Performance Measurements of Virtual Reality Systems: Quantifying the Timing and Positioning Accuracy , 2016, ACM Multimedia.

[8]  Anselm Grundhöfer,et al.  A LED-Based IR/RGB End-to-End Latency Measurement Device , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[9]  Mark R. Mine.  Characterization of End-to-End Delays in Head-Mounted Display Systems , 1993 .

[10]  Kjetil Raaen,et al.  Measuring Latency in Virtual Reality Systems , 2015, ICEC.

[11]  Armin Becher,et al.  Novel Approach to Measure Motion-To-Photon and Mouth-To-Ear Latency in Distributed Virtual Reality Systems , 2018, ArXiv.

[12]  Ilja T Feldstein,et al.  A Simple, Video-Based Technique for Measuring Latency in Virtual Reality or Teleoperation. , 2020, IEEE transactions on visualization and computer graphics.

[13]  Anthony Steed.  A simple method for estimating the latency of interactive, real-time graphics simulations , 2008, VRST '08.

[14]  Yujie Dong,et al.  Measuring Digital System Latency from Sensing to Actuation at Continuous 1-ms Resolution , 2013, PRESENCE: Teleoperators and Virtual Environments.

[15]  Jan Müller,et al.  Calibratio: A small, low-cost, fully automated Motion-to-Photon Measurement Device , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW).

[16]  Katerina Mania,et al.  A system to measure, control and minimize end-to-end head tracking latency in immersive simulations , 2011, VRCAI '11.

[17]  Chris Shaw,et al.  On temporal-spatial realism in the virtual reality environment , 1991, UIST '91.

[18]  Anthony Steed,et al.  Measuring Latency in Virtual Environments , 2014, IEEE Transactions on Visualization and Computer Graphics.

[19]  Suk-Ju Kang,et al.  Photosensor-Based Latency Measurement System for Head-Mounted Displays , 2017, Sensors.

[20]  Massimiliano Di Luca.  New Method to Measure End-to-End Delay of Virtual Reality , 2010, PRESENCE: Teleoperators and Virtual Environments.

[21]  Marc Erich Latoschik,et al.  Simultaneous Run-Time Measurement of Motion-to-Photon Latency and Latency Jitter , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[22]  Dave Pape,et al.  Video-Based Measurement of System Latency , 2000 .

[23]  Carl Gutwin,et al.  Quantifying and Mitigating the Negative Effects of Local Latencies on Aiming in 3D Shooter Games , 2015, CHI.