New Methods for Surface Reconstruction from Range Images

The digitization and reconstruction of 3D shapes has numerous applications in areas that include manufacturing, virtual simulation, science, medicine, and consumer marketing. In this thesis, we address the problem of acquiring accurate range data through optical triangulation, and we present a method for reconstructing surfaces from sets of data known as range images. The standard methods for extracting range data from optical triangulation scanners are accurate only for planar objects of uniform reflectance. Using these methods, curved surfaces, discontinuous surfaces, and surfaces of varying reflectance cause systematic distortions of the range data. We present a new ranging method based on analysis of the time evolution of the structured light reflections. Using this spacetime analysis, we can correct for each of these artifacts, thereby attaining significantly higher accuracy using existing technology. When using coherent illumination such as lasers, however, we show that laser speckle places a fundamental limit on accuracy for both traditional and spacetime triangulation. The range data acquired by 3D digitizers such as optical triangulation scanners commonly consists of depths sampled on a regular grid, a sample set known as a range image. A number of techniques have been developed for reconstructing surfaces by integrating groups of aligned range images. A desirable set of properties for such algorithms includes: incremental updating, representation of directional uncertainty, the ability to fill gaps in the reconstruction, and robustness in the presence of outliers and distortions. Prior algorithms possess subsets of these properties. In this thesis, we present an efficient volumetric method for merging range images that possesses all of these properties. Using this method, we are able to merge a large number of range images (as many as 70) yielding seamless, high-detail models of up to 2.6 million triangles.

[1]  R. Weinstock Calculus of Variations: with Applications to Physics and Engineering , 1952 .

[2]  J. Goodman Statistical Properties of Laser Speckle Patterns , 1963 .

[3]  K. W. Cattermole The Fourier Transform and its Applications , 1965 .

[4]  Ronald N. Bracewell,et al.  The Fourier Transform and Its Applications , 1966 .

[5]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[6]  H. M. Schey Div, grad, curl, and all that , 1973 .

[7]  S. L. Parsonson,et al.  Calculus and analytic geometry , 1975 .

[8]  Toshimitsu Asakura,et al.  Computer simulation study of image speckle patterns with relation to object surface profile , 1976 .

[9]  W T Welford,et al.  Laser Speckle and Applications in Optics , 1980 .

[10]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[11]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jean-Daniel Boissonnat,et al.  Geometric structures for three-dimensional shape representation , 1984, TOGS.

[13]  C. Ian Connolly,et al.  Cumulative generation of octree models from range data , 1984, ICRA.

[14]  Michael Shneier,et al.  Describing a Robot's Workspace Using a Sequence of Views from a Moving Camera , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Timothy C. Strand Optical Three-Dimensional Sensing For Machine Vision , 1985 .

[16]  G Hausler,et al.  Triangulation With Expanded Range Of Depth , 1985, Other Conferences.

[17]  Joseph L. Mundy,et al.  A Three-Dimensional Sensor Based on Structured Light , 1987 .

[18]  Marc Rioux,et al.  Design Of A Large Depth Of View Three-Dimensional Camera For Robot Vision , 1987 .

[19]  Alberto Elfes,et al.  Sensor integration for robot navigation: Combining sonar and stereo range data in a grid-based representataion , 1987, 26th IEEE Conference on Decision and Control.

[20]  Michael Potmesil Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[21]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[22]  J. K. Aggarwal,et al.  Generation of volume/surface octree from range data , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  G. Häusler,et al.  Light sectioning with large depth and high resolution. , 1988, Applied optics.

[24]  Giulio Sandini,et al.  Extraction of 3-D Information and Volumetric Uncertainty from Multiple Stereo Images , 1988, ECAI.

[25]  D Arthur Development of 3-D Imaging Systems for Postal Automation , 1989 .

[26]  D. Laurendeau,et al.  Behaviour of the center of gravity of a reflected gaussian laser spot near a surface reflectance discontinuity , 1990 .

[27]  Takeo Kanade,et al.  A very fast VLSI rangefinder , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[28]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[29]  Giulio Sandini,et al.  3D feature extraction from sequences of range data , 1991 .

[30]  M. Rioux,et al.  Influence of speckle on laser range finders. , 1991, Applied optics.

[31]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[32]  William E. Lorensen,et al.  Decimation of triangle meshes , 1992, SIGGRAPH.

[33]  Denis Laurendeau,et al.  Multi-resolution surface modeling from multiple range views , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[35]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Steven D. Pieper,et al.  Interactive graphics for plastic surgery: a task-level analysis and implementation , 1992, I3D '92.

[37]  Warren H. Stevenson,et al.  Performance characteristics of range sensors utilizing optical triangulation , 1992, Proceedings of the IEEE 1992 National Aerospace and Electronics Conference@m_NAECON 1992.

[38]  Paul Ning,et al.  An evaluation of implicit surface tilers , 1993, IEEE Computer Graphics and Applications.

[39]  Denis Laurendeau,et al.  Scene reconstruction and description: geometric primitive extraction from multiple viewed scattered data , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[41]  Martin Rutishauser,et al.  Merging range images of arbitrarily shaped objects , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[42]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[43]  An Li,et al.  Octree encoding of objects from range images , 1994, Pattern Recognit..

[44]  Robert Bergevin,et al.  Registration of multiple range views for automatic 3-D model building , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[46]  G. Häusler,et al.  Laser triangulation: fundamental uncertainty in distance measurement. , 1994, Applied optics.

[47]  V. Leitáo,et al.  Computer Graphics: Principles and Practice , 1995 .

[48]  J. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, SIGGRAPH.

[49]  Marc Levoy,et al.  Better optical triangulation through spacetime analysis , 1995, Proceedings of IEEE International Conference on Computer Vision.

[50]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[51]  Tsnsliiiiia Nala,et al.  Shape from Shading with Interreflections under Proximal Light Source - 3D shape Reconstruction of Unfolded Book Surface from a Scanner Image - , 1995 .

[52]  Glenn H. Tarbox,et al.  IVIS: An Integrated Volumetric Inspection System , 1995, Comput. Vis. Image Underst..

[53]  Denis Laurendeau,et al.  A General Surface Approach to the Integration of a Set of Range Views , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Chandrajit L. Bajaj,et al.  Automatic reconstruction of surfaces and scalar fields from 3D scans , 1995, SIGGRAPH.

[55]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[56]  Philippe Lacroute,et al.  Analysis of a Parallel Volume Rendering System Based on the Shear-Warp Factorization , 1996, IEEE Trans. Vis. Comput. Graph..

[57]  Marc Levoy,et al.  Fitting smooth surfaces to dense polygon meshes , 1996, SIGGRAPH.

[58]  Adrian Hilton,et al.  Reliable Surface Reconstructiuon from Multiple Range Images , 1996, ECCV.

[59]  Katsushi Ikeuchi,et al.  Recovering shape and reflectance properties from a sequence of range and color images , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[60]  Shree K. Nayar,et al.  Real-Time Focus Range Sensor , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  Robert Bergevin,et al.  Towards a General Multi-View Registration Technique , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Richard Pito,et al.  A sensor-based solution to the "next best view" problem , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[63]  Adrian Hilton,et al.  Registration of multiple point sets , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[64]  M. Carter Computer graphics: Principles and practice , 1997 .