Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity

System latency (time delay) and its visible consequences are fundamental virtual environment (VE) deficiencies that can hamper user perception and performance. The aim of this research is to quantify the role of VE scene content and resultant relative object motion on perceptual sensitivity to VE latency. Latency detection was examined by presenting observers in a head-tracked, stereoscopic head mounted display with environments having differing levels of complexity ranging from simple geometrical objects to a radiosity-rendered scene of two interconnected rooms. Latency discrimination was compared with results from a previous study in which only simple geometrical objects, without radiosity rendering or a 'real-world' setting, were used. From the results of these two studies, it can be inferred that the Just Noticeable Difference (JND) for latency discrimination by trained observers averages ~15 ms or less, independent of scene complexity and real-world meaning. Such knowledge will help elucidate latency perception mechanisms and, in turn, guide VE designers in the development of latency countermeasures.

[1]  Bernard D. Adelstein,et al.  Discrimination of changes in latency during head movement , 1999, HCI.

[2]  Bernard D. Adelstein,et al.  Localization of a Time-Delayed, Monocular Virtual Object Superimposed on a Real Environment , 2000, Presence: Teleoperators & Virtual Environments.

[3]  Lawrence W. Stark,et al.  Some of what one needs to know about using head-mounted displays to improve teleoperator performance , 1993, IEEE Trans. Robotics Autom..

[4]  D. Cunningham,et al.  Sensorimotor Adaptation to Violations of Temporal Contiguity , 2001, Psychological science.

[5]  Jae Y. Jurg DISCRIMINABILITY OF PREDICTION ARTIFACTS IN A TIME-DELAYED VIRTUAL ENVIRONMENT , 1999 .

[6]  K U Smith,et al.  Delayed Visual Feedback and Behavior , 1960, Science.

[7]  Robert S. Allison,et al.  Tolerance of temporal delay in virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[8]  Bernard D. Adelstein,et al.  Discriminability of Prediction Artifacts in a Time-Delayed Virtual Environment , 2000 .

[9]  W. Schweigert,et al.  Research Methods and Statistics in Psychology , 2023 .

[10]  Hugh Coolican Research Methods and Statistics in Psychology , 1993 .

[11]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[12]  Bernard D. Adelstein,et al.  Operator Interaction with Visual Objects: Effect of System Latency , 1997, HCI.

[13]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[14]  Bernard D. Adelstein,et al.  Dynamic Response of Electromagnetic Spatial Displacement Trackers , 1996, Presence: Teleoperators & Virtual Environments.

[15]  Michael I. Hill,et al.  Generalizeability of Latency Detection in a Variety of Virtual Environments , 2004 .

[16]  Bernard D. Adelstein,et al.  Head Tracking Latency in Virtual Environments: Psychophysics and a Model , 2003 .

[17]  Aikaterini Mania,et al.  Fidelity Metrics for Virtual Environment Simulations based on Human Judgements of Spatial Memory Awareness States , 2001 .

[18]  Stephen R. Ellis,et al.  Simulation Fidelity of a Virtual Environment Display , 1994 .

[19]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[20]  Katerina Mania,et al.  Fidelity Metrics for Virtual Environment Simulations Based on Spatial Memory Awareness States , 2003, Presence: Teleoperators & Virtual Environments.

[21]  Gavin S. P. Miller,et al.  A real-time low-latency hardware light-field renderer , 1999, SIGGRAPH.

[22]  Lawrence W. Stark,et al.  The Effects of Pictorial Realism, Delay of Visual Feedback, and Observer Interactivity on the Subjective Sense of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[23]  H. Bülthoff,et al.  Driving in the future: temporal visuomotor adaptation and generalization. , 2001, Journal of vision.

[24]  William Ribarsky,et al.  Maintaining usability during 3D placement despite delay , 2003, IEEE Virtual Reality, 2003. Proceedings..

[25]  Mel Slater,et al.  The sensitivity of presence to collision response , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[26]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[27]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[28]  R. Held,et al.  Adaptation to displaced and delayed visual feedback from the hand. , 1966 .

[29]  Bernard D. Adelstein,et al.  Improved temporal response in virtual environments through system hardware and software reorganization , 1996, Electronic Imaging.

[30]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .