Latency compensation by horizontal scanline selection for head- mounted displays

A fundamental task of a virtual-environment system is to present images that change appropriately as the user's head moves. Latency produces registration error causing the scene to appear spatially unstable. To improve the spatial stability of the scene, we built a system that, immediately before scanout to a head-mounted raster display, selects a portion of each scanline from an image rendered at a wider display width. The pixel selection corrects for yaw head rotations and effectively reduces latency for yaw to the millisecond range. In informal evaluations, users consistently judged visual scenes more stable and reported no additional visual artifacts with horizontal scanline selection than the same system without. Scanline-selection hardware can be added to existing virtual-reality systems as an external device between the graphics card and the raster display.

[1]  Jun Someya,et al.  29. 3: A Fast-Response 15-in. XGA TFT-LCD with Feed-forward Driving(FFD) Technology for Multimedia Applications(Session29: Video Quality AMLCDs I)(Report on 2001 SID) , 2001 .

[2]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[3]  Michael J. Griffin,et al.  Compensating Lags in Head-Coupled Displays Using Head Position Prediction and Image Deflection , 1992 .

[4]  Jason Jerald.  Latency Compensation for Head-Mounted Virtual Reality , 2004 .

[5]  Ryugo Kijima,et al.  Reflex HMD to compensate lag and correction of derivative deformation , 2002, Proceedings IEEE Virtual Reality 2002.

[6]  Tomasz Mazuryk,et al.  Two‐step Prediction and Image Deflection for Exact Head Tracking in Virtual Environments , 1995, Comput. Graph. Forum.

[7]  Greg Welch,et al.  The HiBall Tracker: high-performance wide-area tracking for virtual and augmented environments , 1999, VRST '99.

[8]  Greg Welch,et al.  High-Performance Wide-Area Optical Tracking: The HiBall Tracking System , 2001, Presence: Teleoperators & Virtual Environments.

[9]  H. Wallach.  Perceiving a stable environment when one moves. , 1987, Annual review of psychology.

[10]  P. M. Murray,et al.  Hardware Improvements To The Helmet Mounted Projector On The Visual Display Research Tool (VDRT) At The Naval Training Systems Center , 1989, Defense, Security, and Sensing.

[11]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[12]  Ronald Azuma,et al.  A frequency-domain analysis of head-motion prediction , 1995, SIGGRAPH.

[13]  Masahiko Inami,et al.  Improvement of Temporal Quality of HMD for Rotational Motion , 1998 .

[14]  Richard L. Holloway,et al.  Registration Error Analysis for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[15]  Ryugo Kijima,et al.  A Development of Reflex HMD - HMD with time delay compensation capability , 2001 .

[16]  Gavin S. P. Miller,et al.  A real-time low-latency hardware light-field renderer , 1999, SIGGRAPH.

[17]  Ronald Pose,et al.  Priority rendering with a virtual reality address recalculation pipeline , 1994, SIGGRAPH.

[18]  Mark R. Mine,et al.  Just-In-Time Pixels , 1995 .

[19]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[20]  Michael I. Hill,et al.  Generalizeability of Latency Detection in a Variety of Virtual Environments , 2004 .

[21]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.