Photogeometric structured light: A self-calibrating and multi-viewpoint framework for accurate 3D modeling

Structured-light methods actively generate geometric correspondence data between projectors and cameras in order to facilitate robust 3D reconstruction. In this paper, we present photogeometric structured light whereby a standard structured light method is extended to include photometric methods. Photometric processing serves the double purpose of increasing the amount of recovered surface detail and of enabling the structured-light setup to be robustly self-calibrated. Further, our framework uses a photogeometric optimization that supports the simultaneous use of multiple cameras and projectors and yields a single and accurate multi-view 3D model which best complies with photometric and geometric data.

[1]  Peter F. Sturm,et al.  Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length , 1999, Image Vis. Comput..

[2]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[4]  R. Woodham,et al.  Photometric Stereo: Lambertian Reflectance and Light Sources with Unknown Direction and Strength , 1991 .

[5]  Holly E. Rushmeier,et al.  Computing consistent normals and colors from photometric data , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[6]  Szymon Rusinkiewicz,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[7]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[8]  Marc Levoy,et al.  Dual photography , 2005, SIGGRAPH 2005.

[9]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[11]  Ira Kemelmacher-Shlizerman,et al.  Photometric Stereo with General, Unknown Lighting , 2006, International Journal of Computer Vision.

[12]  James J. Little,et al.  Reflectance and Shape from Images Using a Collinear Light Source , 1999, International Journal of Computer Vision.

[13]  David J. Kriegman,et al.  Beyond Lambert: reconstructing specular surfaces using color , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Billy Chen,et al.  Light Source Interpolation for Sparsely Sampled Reflectance Fields , 2005 .

[15]  Ryo Furukawa,et al.  Uncalibrated multiple image stereo system with arbitrarily movable camera and projector for wide range scanning , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[16]  Ze-Nian Li,et al.  A survey of motion-parallax-based 3-D reconstruction algorithms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  David J. Kriegman,et al.  Passive photometric stereo from motion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  David J. Kriegman,et al.  Isotropy, Reciprocity and the Generalized Bas-Relief Ambiguity , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Todd E. Zickler.  Reciprocal Image Features for Uncalibrated Helmholtz Stereopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Li Zhang,et al.  Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multiview stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[24]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[25]  David J. Kriegman,et al.  Toward a stratification of Helmholtz stereopsis , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..