Efficiently combining positions and normals for precise 3D geometry

Range scanning, manual 3D editing, and other modeling approaches can provide information about the geometry of surfaces in the form of either 3D positions (e.g., triangle meshes or range images) or orientations (normal maps or bump maps). We present an algorithm that combines these two kinds of estimates to produce a new surface that approximates both. Our formulation is linear, allowing it to operate efficiently on complex meshes commonly used in graphics. It also treats high-and low-frequency components separately, allowing it to optimally combine outputs from data sources such as stereo triangulation and photometric stereo, which have different error-vs.-frequency characteristics. We demonstrate the ability of our technique to both recover high-frequency details and avoid low-frequency bias, producing surfaces that are more widely applicable than position or orientation data alone.

[1]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[2]  Reinhard Klette,et al.  Shape from Photometric Stereo and Contours , 2003, CAIP.

[3]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Gavin S. P. Miller,et al.  Efficient algorithms for local and global accessibility shading , 1994, SIGGRAPH.

[6]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[7]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[8]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  P. Belhumeur,et al.  Learning Object Representations from LightingVariationsR , 1996 .

[10]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[11]  Subhashis Banerjee,et al.  Surface reconstruction from disparate shading: an integration of shape-from-shading and stereopsis , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[12]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[13]  Aly A. Farag,et al.  Integrating shape from shading and range data using neural networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Rui J. P. de Figueiredo,et al.  A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[16]  B. Curless.  New Methods for Surface Reconstruction from Range Images , 1997 .

[17]  Holger Lange,et al.  Advances in the cooperation of shape from shading and stereo vision , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[18]  Holly E. Rushmeier,et al.  Computing consistent normals and colors from photometric data , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[19]  Ikeuchi,et al.  Constructing a Depth Map from Images , 1983 .

[20]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[21]  Pascal Fua,et al.  Using 3-Dimensional Meshes To Combine Image-Based and Geometry-Based Constraints , 1994, ECCV.

[22]  Paul J. Besl,et al.  Active, optical range imaging sensors , 1988, Machine Vision and Applications.

[23]  Mubarak Shah,et al.  Integration of shape from shading and stereo , 1995, Pattern Recognit..

[24]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Katsushi Ikeuchi,et al.  Determining a Depth Map Using a Dual Photometric Stereo , 1987 .

[26]  Szymon Rusinkiewicz,et al.  Spacetime Stereo: A Unifying Framework for Depth from Triangulation , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Denis Laurendeau,et al.  3-D Sensing for industrial computer vision , 1988 .

[28]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.