Dense Estimation of Surface Reflectance Properties for Merging Virtualized Objects into Real Images

To appropriately reproduce a real object in a mixed environment, it is necessary to estimate reflectance properties of object surfaces. This paper describes a new method of densely estimating non-uniform surface reflectance properties of an object with convex and concave surfaces using registered range and surface color texture images obtained by a laser rangefinder. The proposed method determines positions of light source to take color images for discriminating diffuse and specular reflection components of surface reflection. The Torrance-Sparrow model is employed to estimate reflectance parameters using color images under multiple illumination conditions. Experiments show the usefulness of the method.

[1]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[2]  Naokazu Yokoya,et al.  Range Image Segmentation Based on Differential Geometry: A Hybrid Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Marc Rioux,et al.  Color Reflectance Modeling Using a Polychromatic Laser Range Sensor , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  T. Caelli,et al.  Inverting an illumination model from range and intensity maps , 1994 .

[6]  James J. Little,et al.  Reflectance function estimation and shape recovery from image sequence of a rotating object , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[8]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[9]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[10]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[11]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[12]  Sang Wook Lee,et al.  Estimation of diffuse and specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Sang Wook Lee,et al.  A representation of specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Yasuhiro Mukaigawa,et al.  Photometric image-based rendering for image generation in arbitrary illumination , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.