Surface reflectance modeling of real objects with interreflections

In mixed reality, especially in augmented virtuality which virtualizes real objects, it is important to estimate object surface reflectance properties to render the objects under arbitrary illumination conditions. Though several methods have been explored to estimate the surface reflectance properties, it is still difficult to estimate surface reflectance parameters faithfully for complex objects which have nonuniform surface reflectance properties and exhibit interreflections. We describe a new method for densely estimating nonuniform surface reflectance properties of real objects constructed of convex and concave surfaces with interreflections. We use registered range and surface color texture images obtained by a laser rangefinder. Experiments show the usefulness of the proposed method.

[1]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[2]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Sang Wook Lee,et al.  A representation of specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  André Gagalowicz,et al.  Image-based rendering of diffuse, specular and glossy surfaces from a single image , 2001, SIGGRAPH.

[5]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[6]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[7]  Michael F. Cohen,et al.  A Radiosity Solution for Complex Environments , 1997 .

[8]  Sang Wook Lee,et al.  Estimation of diffuse and specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  P GreenbergDonald,et al.  The hemi-cube , 1985 .

[10]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[11]  James J. Little,et al.  Reflectance function estimation and shape recovery from image sequence of a rotating object , 1995, Proceedings of IEEE International Conference on Computer Vision.

[12]  Yasuhiro Mukaigawa,et al.  Photometric image-based rendering for image generation in arbitrary illumination , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  George Drettakis,et al.  Interactive Virtual Relighting of Real Scenes , 2000, IEEE Trans. Vis. Comput. Graph..

[14]  Naokazu Yokoya,et al.  Range Image Segmentation Based on Differential Geometry: A Hybrid Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[16]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[17]  T. Caelli,et al.  Inverting an illumination model from range and intensity maps , 1994 .

[18]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[19]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[20]  N. Yokoya,et al.  Dense Estimation of Surface Reflectance Properties for Merging Virtualized Objects into Real Images , 2002 .

[21]  Marc Rioux,et al.  Color Reflectance Modeling Using a Polychromatic Laser Range Sensor , 1992, IEEE Trans. Pattern Anal. Mach. Intell..