Single-shot photometric stereo by spectral multiplexing

We propose a novel method for single-shot photometric stereo by spectral multiplexing. The output of our method is a simultaneous per-pixel estimate of the surface normal and full-color reflectance. Our method is well suited to materials with varying color and texture, requires no time-varying illumination, and no high-speed cameras. Being a single-shot method, it may be applied to dynamic scenes without any need for optical flow. Our key contributions are a generalization of three-color photometric stereo to more than three color channels, and the design of a practical six-color-channel system using off-the-shelf parts.

[1]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[2]  Szymon Rusinkiewicz,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[3]  Hanspeter Pfister,et al.  Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows , 2010, ECCV.

[4]  Paul E. Debevec,et al.  Optimizing Color Matching in a Lighting Reproduction System for Complex Subject and Illuminant Spectra , 2003, Rendering Techniques.

[5]  Tomoyuki Nishita,et al.  Extracting depth and matte using a color-filtered aperture , 2008, SIGGRAPH 2008.

[6]  Hans Brettel,et al.  Spectral characterisation of electronic cameras , 1998, Electronic Imaging.

[7]  Er-Wei Bai,et al.  On the Least Squares Solutions of a System of Bilinear Equations , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[8]  Jon Yngve Hardeberg,et al.  Spectral characterization of electronic cameras , 1998, Other Conferences.

[9]  George Vogiatzis,et al.  Self-calibrating a real-time monocular 3 d facial capture system , 2010 .

[10]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[11]  Jan Kautz,et al.  Capturing multiple illumination conditions using time and color multiplexing , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Linda G. Shapiro,et al.  Three-dimensional shape from color photometric stereo , 2005, International Journal of Computer Vision.

[13]  Moshe Ben-Ezra,et al.  Photometric Stereo for Dynamic Surface Orientations , 2010, ECCV.