Image-based modeling and rendering of surfaces with arbitrary BRDFs

A goal of image-based rendering is to synthesize as realistically as possible man made and natural objects. The paper presents a method for image-based modeling and rendering of objects with arbitrary (possibly anisotropic and spatially varying) BRDFs. An object is modeled by sampling the surface's incident light field to reconstruct a non-parametric apparent BRDF at each visible point on the surface, This can be used to render the object from the same viewpoint but under arbitrarily specified illumination. We demonstrate how these object models can be embedded in synthetic scenes and rendered under global illumination which captures the interreflections between real and synthetic objects. We also show how these image-based models can be automatically composited onto video footage with dynamic illumination so that the effects (shadows and shading) of the lighting on the composited object match those of the scene.

[1]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[2]  Yakup Genc,et al.  Parameterized image varieties: a novel approach to the analysis and synthesis of image sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[3]  David Salesin,et al.  A fast and accurate light reflection model , 1992, SIGGRAPH.

[4]  Julie Dorsey,et al.  Effic ient Re-rendering of Naturally Illuminated Environments , 1994 .

[5]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[6]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[7]  Robert L Cook,et al.  A reflectance model for computer graphics , 1981, SIGGRAPH '81.

[8]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[9]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[10]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[11]  David J. Kriegman,et al.  Beyond Lambert: reconstructing surfaces with arbitrary BRDFs , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[13]  Steven W. Zucker,et al.  What is a light source? , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[15]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[16]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[17]  Peter Shirley,et al.  A microfacet-based BRDF generator , 2000, SIGGRAPH.

[18]  Tien-Tsin Wong,et al.  Illuminating image-based objects , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[19]  Amnon Shashua,et al.  Novel view synthesis in tensor space , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[21]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[22]  Edward H. Adelson,et al.  Computation Models of Visual Processing , 1991, IEEE Expert.

[23]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[24]  J WardGregory,et al.  Measuring and modeling anisotropic reflection , 1992 .

[25]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[26]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.