Surface reflectance modeling of real objects with interreflections for augmented virtuality

In mixed reality, especially in augmented virtuality, in which real objects are virtualized, it is important to estimate object surface reflectance properties in order to render the objects under arbitrary illumination conditions. Although several methods have been explored, faithfully estimating surface reflectance parameters for complex objects having nonuniform surface reflectance properties or interreflections remains difficult. This article describes a new method for densely estimating the nonuniform surface reflectance properties of real objects constructed of convex and concave surfaces with interreflections. Registered range and surface color texture images are obtained using a laser rangefinder. In the proposed method, light source positions are first determined in order to obtain color images for discriminating diffuse and specular reflection components considering the object geometry. Surface reflectance parameters are then estimated based on radiosity and the Torrance–Sparrow model. The usefulness of the proposed method is shown experimentally. © 2005 Wiley Periodicals, Inc. Col Res Appl, 31, 38–47, 2006; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/col.20184

[1]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[2]  Naokazu Yokoya,et al.  Range Image Segmentation Based on Differential Geometry: A Hybrid Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Marc Rioux,et al.  Color Reflectance Modeling Using a Polychromatic Laser Range Sensor , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  T. Caelli,et al.  Inverting an illumination model from range and intensity maps , 1994 .

[6]  James J. Little,et al.  Reflectance function estimation and shape recovery from image sequence of a rotating object , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[8]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[9]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[10]  Michael F. Cohen,et al.  A Radiosity Solution for Complex Environments , 1997 .

[11]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[12]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[13]  Sang Wook Lee,et al.  Estimation of diffuse and specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Sang Wook Lee,et al.  A representation of specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  George Drettakis,et al.  Interactive Virtual Relighting of Real Scenes , 2000, IEEE Trans. Vis. Comput. Graph..

[16]  André Gagalowicz,et al.  Image-based rendering of diffuse, specular and glossy surfaces from a single image , 2001, SIGGRAPH.

[17]  Yasuhiro Mukaigawa,et al.  Photometric image-based rendering for image generation in arbitrary illumination , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Naokazu Yokoya,et al.  Virtualizing real objects with surface interreflections , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[19]  N. Yokoya,et al.  Dense Estimation of Surface Reflectance Properties for Merging Virtualized Objects into Real Images , 2002 .

[20]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.