Image-Based Acquisition of Shape and Spatially Varying Reflectance

The shape and reflectance of complex objects, for use in compu ter graphics applications, cannot always be acquired using specialized equipment due to cost or pratical considerations. We want to provide an easy and cost-effective way for the approximate recovery of both shape and spatially-varying reflectance of objects using commodity hardware. In this paper, we present an image-based technique for recovering 3D shape and spatially-varying reflectance properties from a s parse set of photographs, taken under varying illumination. Our technique models the reflectance with a set of low-parameter BRDFs without knowledg e of the location of the light-sources or camera. This results an a flexi ble and portable system that can be used in the field. We successfully apply the approach to several objects (synthetic and real), recovering shape and reflectance. The acquired information can then be used to render the object with modifications to geometry and light ing via traditional rendering methods.

[1]  Athinodoros S. Georghiades,et al.  Recovering 3-D Shape and Reflectance From a Small Number of Photographs , 2003, Rendering Techniques.

[2]  Steven M. Seitz,et al.  Shape and materials by example: a photometric stereo approach , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[4]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[5]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[6]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[7]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[8]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[9]  Daniel Snow,et al.  Shape and albedo from multiple images using integrability , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Andrew W. Fitzgibbon,et al.  BRDF and geometry capture from extended inhomogeneous samples using flash photography , 2005, Comput. Graph. Forum.

[11]  Nahum Kiryati,et al.  Photometric stereo under perspective projection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[13]  C.-C. Jay Kuo,et al.  Shape from Shading with a Generalized Reflectance Map Model , 1997, Comput. Vis. Image Underst..

[14]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[15]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[16]  Steven M. Seitz,et al.  Shape and Spatially-Varying BRDFs from Photometric Stereo , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[18]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.