QuickTime VR: an image-based approach to virtual environment navigation

Traditionally, virtual reality systems use 3D computer graphics to model and render virtual environments in real-time. This approach usually requires laborious modeling and expensive special purpose rendering hardware. The rendering quality and scene complexity are often limited because of the real-time constraint. This paper presents a new approach which uses 360-degree cylindrical panoramic images to compose a virtual environment. The panoramic image is digitally warped on-the-fly to simulate camera panning and zooming. The panoramic images can be created with computer rendering, specialized panoramic cameras or by "stitching" together overlapping photographs taken with a regular camera. Walking in a space is currently accomplished by "hopping" to different panoramic points. The image-based approach has been used in the commercial product QuickTime VR, a virtual reality extension to Apple Computer's QuickTime digital multimedia framework. The paper describes the architecture, the file format, the authoring process and the interactive players of the VR system. In addition to panoramic viewing, the system includes viewing of an object from different directions and hit-testing through orientation-independent hot spots. CR

[1]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[2]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[3]  Sally A. Applin,et al.  The virtual museum: Interactive 3D navigation of a multimedia database , 1992, Comput. Animat. Virtual Worlds.

[4]  Nelson L. Chang.  View Reconstruction from Uncalibrated Cameras for Three-Dimensional Scenes. , 1994 .

[5]  Paul S. Heckbert,et al.  Creating Raster Omnimax Images from Multiple Perspective Views Using the Elliptical Weighted Average Filter , 1986, IEEE Computer Graphics and Applications.

[6]  David Salesin,et al.  Multiresolution painting and compositing , 1994, SIGGRAPH.

[7]  D. Blackketter,et al.  QuickTime: an extensible standard for digital multimedia , 1992, Digest of Papers COMPCON Spring 1992.

[8]  Lance Williams,et al.  Pyramidal parametrics , 1983, SIGGRAPH.

[9]  G. David Ripley.  DVI—a digital multimedia technology , 1989, CACM.

[10]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[11]  Richard Szeliski,et al.  Image mosaicing for tele-reality applications , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[12]  Carlo H. Séquin,et al.  Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments , 1993, SIGGRAPH.

[13]  Ken Perlin,et al.  Pad: an alternative approach to the computer interface , 1993, SIGGRAPH.

[14]  Donald P. Greenberg,et al.  Improved Computational Methods for Ray Tracing , 1984, TOGS.

[15]  Mathew E. Hodges,et al.  Multimedia Computing: Case Studies from Mit Project Athena , 1993 .

[16]  Ronald Pose,et al.  Priority rendering with a virtual reality address recalculation pipeline , 1994, SIGGRAPH.

[17]  James H. Clark,et al.  Hierarchical geometric models for visible surface algorithms , 1976, CACM.

[18]  Robert Mohl.  Cognitive space in the interactive movie map : an investigation of spatial learning in virtual environments , 1981 .

[19]  Steve Mann,et al.  Virtual bellows: constructing high quality stills from video , 1994, Proceedings of 1st International Conference on Image Processing.

[20]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[21]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1976, CACM.

[22]  Andrew Lippman,et al.  Movie-maps: An application of the optical videodisc to computer graphics , 1980, SIGGRAPH '80.

[23]  Steven Yelick,et al.  Anamorphic image processing , 1980 .

[24]  Abigail Sellen,et al.  A study in interactive 3-D rotation using 2-D control devices , 1988, SIGGRAPH.