The Visual Display Transformation for Virtual Reality

The visual display transformation for virtual reality (VR) systems is typically much more complex than the standard viewing transformation discussed in the literature for conventional computer graphics. The process can be represented as a series of transformations, some of which contain parameters that must match the physical configuration of the system hardware and the user's body. Because of the number and complexity of the transformations, a systematic approach and a thorough understanding of the mathematical models involved are essential. This paper presents a complete model for the visual display transformation for a VR system; that is, the series of transformations used to map points from object coordinates to screen coordinates. Virtual objects are typically defined in an object-centered coordinate system (CS), but must be displayed using the screen-centered CSs of the two screens of a head-mounted display (HMD). This particular algorithm for the VR display computation allows multiple users to independently change position, orientation, and scale within the virtual world, allows users to pick up and move virtual objects, uses the measurements from a head tracker to immerse the user in the virtual world, provides an adjustable eye separation for generating two stereoscopic images, uses the off-center perspective projection required by many HMDs, and compensates for the optical distortion introduced by the lenses in an HMD. The implementation of this framework as the core of the UNC VR software is described, and the values of the UNC display parameters are given. We also introduce the vector-quaternion-scalar (VQS) representation for transformations between 3D coordinate systems, which is specifically tailored to the needs of a VR system. The transformations and CSs presented comprise a complete framework for generating the computer-graphic imagery required in a typical VR system. The model presented here is deliberately abstract in order to be general purpose; thus, issues of system design and visual perception are not addressed. While the mathematical techniques involved are already well known, there are enough parameters and pitfalls that a detailed description of the entire process should be a useful tool for someone interested in implementing a VR system.

[1]  Bob Francis,et al.  Silicon Graphics Inc. , 1993 .

[2]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[3]  Warren Robinett,et al.  Implementation of flying, scaling and grabbing in virtual worlds , 1992, I3D '92.

[4]  Michael Zyda,et al.  NPSNET: Flight Simulation Dynamic Modeling Using Quaternions , 1992, Presence: Teleoperators & Virtual Environments.

[5]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1993, Virtual Reality Systems.

[6]  R. Paul.  Robot manipulators : mathematics, programming, and control : the computer control of robot manipulators , 1981 .

[7]  Warren Robinett,et al.  Virtual-worlds research at the University of North Carolina at Chapel Hill as of February 1992 , 1992 .

[8]  Warren Robinett,et al.  Virtual environment display system , 1987, I3D '86.

[9]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[10]  Jaron Lanier,et al.  Reality built for two: a virtual reality tool , 1990, I3D '90.

[11]  Jannick P. Rolland,et al.  A Method of Computational Correction for Optical Distortioin in Head-Mounted Displays , 1993 .

[12]  Martin R. Stytz,et al.  Distributed virtual environments , 1996, IEEE Computer Graphics and Applications.

[13]  R A Buchroeder,et al.  Design of a Catadioptric VCASS Helmet-Mounted Display , 1981 .

[14]  Phillip J. McKerrow,et al.  Introduction to robotics , 1991 .

[15]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1991, Presence: Teleoperators & Virtual Environments.

[16]  Russell H. Taylor,et al.  On homogeneous transforms, quaternions, and computational efficiency , 1990, IEEE Trans. Robotics Autom..

[17]  Thomas P. Caudell,et al.  Calibration of head-mounted displays for augmented reality applications , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[18]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[19]  Henry Fuchs,et al.  Pixel-planes 5: a heterogeneous multiprocessor graphics system using processor-enhanced memories , 1989, SIGGRAPH.

[20]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[21]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .