The lumigraph

This paper discusses a new method for capturing the complete appearanceof both synthetic and real world objects and scenes, representing this information, and then using this representation to render images of the object from new camera positions. Unlike the shape capture process traditionally used in computer vision and the rendering process traditionally used in computer graphics, our approach does not rely on geometric representations. Instead we sample and reconstruct a 4D function, which we call a Lumigraph. The Lumigraph is a subsetof the complete plenoptic function that describes the flow of light at all positions in all directions. With the Lumigraph, new images of the object can be generated very quickly, independent of the geometric or illumination complexity of the scene or object. The paper discusses a complete working system including the capture of samples, the construction of the Lumigraph, and the subsequent rendering of images from this new representation.

[1]  M. J. D. Powell,et al.  Weighted Uniform Sampling — a Monte Carlo Technique for Reducing Variance , 1966 .

[2]  Stephen A. Benton,et al.  Survey Of Holographic Stereograms , 1983, Optics & Photonics.

[3]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[4]  Demetri Terzopoulos.  Regularization ofInverseVisualProblemsInvolving Discontinuities , 1986 .

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Michael Potmesil.  Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[7]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[8]  Peter J. Burt,et al.  Moment images, polynomial fit filters. and the problem of surface interpolation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Huang Yumin,et al.  A PHYSICAL APPROACH TO COLOR IMAGE UNDERSTANDING , 1991 .

[10]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[11]  John M. Snyder,et al.  Generative modeling: a symbolic system for geometric modeling , 1992, SIGGRAPH.

[12]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[13]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[14]  I. Ashdown,et al.  Near-Field Photometry: A New Approach , 1993 .

[15]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[16]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[17]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Michael W. Halle.  Holographic stereograms as discrete imaging systems , 1994, Electronic Imaging.

[19]  Lance Williams,et al.  Animating images with drawings , 1994, SIGGRAPH.

[20]  Reg G. Willson.  Modeling and calibration of automated zoom lenses , 1994, Other Conferences.

[21]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[22]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[23]  Václav Hlavác,et al.  Rendering real-world objects using view interpolation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[24]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[25]  Hideyuki Tamura,et al.  Viewpoint-dependent stereoscopic display using interpolation of multiviewpoint images , 1995, Electronic Imaging.

[26]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[27]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[28]  Alain Fournier,et al.  Light-Driven Global Illumination with a Wavelet Representation of Light Transport , 1996, Rendering Techniques.

[29]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.