Efficiently combining positions and normals for precise 3D geometry

Range scanning, manual 3D editing, and other modeling approaches can provide information about the geometry of surfaces in the form of either 3D positions (e.g., triangle meshes or range images) or orientations (normal maps or bump maps). We present an algorithm that combines these two kinds of estimates to produce a new surface that approximates both. Our formulation is linear, allowing it to operate efficiently on complex meshes commonly used in graphics. It also treats high-and low-frequency components separately, allowing it to optimally combine outputs from data sources such as stereo triangulation and photometric stereo, which have different error-vs.-frequency characteristics. We demonstrate the ability of our technique to both recover high-frequency details and avoid low-frequency bias, producing surfaces that are more widely applicable than position or orientation data alone.

[1]  Katsushi Ikeuchi,et al.  Determining a Depth Map Using a Dual Photometric Stereo , 1987 .

[2]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[3]  Subhashis Banerjee,et al.  Surface reconstruction from disparate shading: an integration of shape-from-shading and stereopsis , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[4]  Denis Laurendeau,et al.  3-D Sensing for industrial computer vision , 1988 .

[5]  Holly E. Rushmeier,et al.  Computing consistent normals and colors from photometric data , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[6]  Ikeuchi,et al.  Constructing a Depth Map from Images , 1983 .

[7]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[8]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[9]  Holger Lange,et al.  Advances in the cooperation of shape from shading and stereo vision , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[10]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[11]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Mubarak Shah,et al.  Integration of shape from shading and stereo , 1995, Pattern Recognit..

[13]  Learning Object Representations from LightingVariationsR , 1996 .

[14]  B. Curless.  New Methods for Surface Reconstruction from Range Images , 1997 .

[15]  Paul J. Besl,et al.  Active, optical range imaging sensors , 1988, Machine Vision and Applications.

[16]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[17]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[20]  Szymon Rusinkiewicz,et al.  Spacetime Stereo: A Unifying Framework for Depth from Triangulation , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Pascal Fua,et al.  Using 3-Dimensional Meshes To Combine Image-Based and Geometry-Based Constraints , 1994, ECCV.

[22]  Aly A. Farag,et al.  Integrating shape from shading and range data using neural networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[23]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[25]  Reinhard Klette,et al.  Shape from Photometric Stereo and Contours , 2003, CAIP.

[26]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[27]  Gavin S. P. Miller,et al.  Efficient algorithms for local and global accessibility shading , 1994, SIGGRAPH.

[28]  Rui J. P. de Figueiredo,et al.  A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces , 1991, IEEE Trans. Pattern Anal. Mach. Intell..