A Self-Calibrating Method for Photogeometric Acquisition of 3D Objects

We present a self-calibrating photogeometric method using only off-the-shelf hardware that enables quickly and robustly obtaining multimillion point-sampled and colored models of real-world objects. Some previous efforts use a priori calibrated systems to separately acquire geometric and photometric information. Our key enabling observation is that a digital projector can be simultaneously used as either an active light source or as a virtual camera (as opposed to a digital camera, which cannot be used for both). We present our self-calibrating and multiviewpoint 3D acquisition method, based on structured light, which simultaneously obtains mutually registered surface position and surface normal information and produces a single high-quality model. Acquisition processing freely alternates between using a geometric setup and using a photometric setup with the same hardware configuration. Further, our approach generates reconstructions at the resolution of the camera and not only the projector. We show the results of capturing several high-quality models of real-world objects.

[1]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .

[2]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  R. Woodham,et al.  Photometric Stereo: Lambertian Reflectance and Light Sources with Unknown Direction and Strength , 1991 .

[4]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[5]  Holly E. Rushmeier,et al.  Computing consistent normals and colors from photometric data , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[6]  Peter F. Sturm,et al.  Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length , 1999, Image Vis. Comput..

[7]  Peter Sturm Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length , 2002, Image Vis. Comput..

[8]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  David J. Kriegman,et al.  Toward a stratification of Helmholtz stereopsis , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Li Zhang,et al.  Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multiview stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Luc Van Gool,et al.  Real-time range scanning of deformable surfaces by adaptively coded structured light , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[13]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[14]  Todd E. Zickler,et al.  Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction , 2002, International Journal of Computer Vision.

[15]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[16]  James J. Little,et al.  Reflectance and Shape from Images Using a Collinear Light Source , 1999, International Journal of Computer Vision.

[17]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[18]  David J. Kriegman,et al.  Beyond Lambert: reconstructing specular surfaces using color , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Ryo Furukawa,et al.  Uncalibrated multiple image stereo system with arbitrarily movable camera and projector for wide range scanning , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[20]  Szymon Rusinkiewicz,et al.  Spacetime stereo: a unifying framework for depth from triangulation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  David J. Kriegman,et al.  Passive photometric stereo from motion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Szymon Rusinkiewicz,et al.  Spacetime Stereo: A Unifying Framework for Depth from Triangulation , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Diego F. Nehab,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[25]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[26]  Ira Kemelmacher-Shlizerman,et al.  Photometric Stereo with General, Unknown Lighting , 2006, International Journal of Computer Vision.

[27]  Todd E. Zickler Reciprocal Image Features for Uncalibrated Helmholtz Stereopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[28]  R. Cipolla,et al.  Multi-view photometric stereo , 2007 .

[29]  Luc Van Gool,et al.  Fast 3D Scanning with Automatic Motion Compensation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Daniel G. Aliaga,et al.  Photogeometric structured light: A self-calibrating and multi-viewpoint framework for accurate 3D modeling , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Stephen Lin,et al.  Subpixel Photometric Stereo , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Avinash C. Kak,et al.  3D Modeling of Optically Challenging Objects , 2008, IEEE Transactions on Visualization and Computer Graphics.

[33]  Roberto Cipolla,et al.  Multiview Photometric Stereo , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.