On Three-Dimensional Surface Reconstruction Methods

A survey is presented of some of the surface reconstruction methods that can be found in the literature; the focus is on a small, recent, and important subset of the published reconstruction techniques. The techniques are classified based on the surface representation used, implicit versus explicit functions. A study is made of the important aspects of the surface reconstruction techniques. One aspect is the viewpoint invariance of the methods. This is an important property if object recognition is the ultimate objective. The robustness of the various methods is examined. It is determined whether the parameter estimates are biased, and the sensitivity to obscuration is addressed. The latter two aspects are particularly important for fitting functions in the implicit form. A detailed description is given of a parametric reconstruction method for three-dimensional object surfaces that involves numeric grid generation techniques and variational principle formulations. This technique is invariant to rigid motion in dimensional space. >

[1]  Katsushi Ikeuchi Recognition of 3-D Objects Using the Extended Gaussian Image , 1981, IJCAI.

[2]  Andrew Blake,et al.  Reconstructing a Visible Surface , 1984, AAAI.

[3]  Jean Duchon,et al.  Interpolation des fonctions de deux variables suivant le principe de la flexion des plaques minces , 1976 .

[4]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[5]  Alan C. Bovik,et al.  Improving visible-surface reconstruction , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  R. Bajcsy,et al.  A computerized system for the elastic matching of deformed radiographic images to idealized atlas images. , 1983, Journal of computer assisted tomography.

[7]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[8]  R. Bajcsy,et al.  Shape recovery and segmentation with deformable part models , 1987 .

[9]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[10]  L. E. Scales,et al.  Introduction to Non-Linear Optimization , 1985 .

[11]  Jake K. Aggarwal,et al.  Curvature-based representation of objects from range data , 1986, Image Vis. Comput..

[12]  ARISTIDES A. G. REQUICHA,et al.  Representations for Rigid Solids: Theory, Methods, and Systems , 1980, CSUR.

[13]  Terrance E. Boult,et al.  Recovery Of Superquadrics From 3-D Information , 1988, Other Conferences.

[14]  C. Reinsch Smoothing by spline functions , 1967 .

[15]  Joe F. Thompson,et al.  Numerical grid generation: Foundations and applications , 1985 .

[16]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[17]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[18]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[19]  W E Grimson,et al.  A computational theory of visual surface interpolation. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  Terrance E. Boult,et al.  Error Of Fit Measures For Recovering Parametric Solids , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[21]  A. Pentland Recognition by Parts , 1987 .

[22]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[24]  F. Bookstein Fitting conic sections to scattered data , 1979 .

[25]  W. Eric L. Grimson,et al.  An implementation of a computational theory of visual surface interpolation , 1983, Comput. Vis. Graph. Image Process..

[26]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[27]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[28]  Ernest L. Hall,et al.  Measuring Curved Surfaces for Robot Vision , 1982, Computer.

[29]  Tomaso Poggio,et al.  A Theory of Human Stereo Vision , 1977 .

[30]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  A. Ralston A first course in numerical analysis , 1965 .

[33]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[34]  C. Lawson Software for C1 Surface Interpolation , 1977 .

[35]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[36]  Demetri Terzopoulos,et al.  Multiresolution computation of visible-surface representations , 1984 .

[37]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  John R. Kender,et al.  Solving the depth interpolation problem on a parallel architecture with a multigrid approach , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Alex Pentland,et al.  Part Segmentation for Object Recognition , 1989, Neural Computation.

[40]  S. Shafer Shadows and Silhouettes in Computer Vision , 1985 .

[41]  John R. Kender,et al.  Visual Surface Reconstruction Using Sparse Depth Data , 1986, CVPR 1986.

[42]  B. Barsky The beta-spline: a local representation based on shape parameters and fundamental geometric measures , 1981 .

[43]  Jean Ponce,et al.  Finding the limbs and cusps of generalized cylinders , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[44]  Barr,et al.  Superquadrics and Angle-Preserving Transformations , 1981, IEEE Computer Graphics and Applications.

[45]  J. Meinguet Multivariate interpolation at arbitrary points made simple , 1979 .

[46]  Ruud M. Bolle,et al.  Visual recognition using concurrent and layered parameter networks , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  R. Bajcsy,et al.  Three dimensional object representation revisited , 1987 .

[48]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[49]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[50]  John R. Kender,et al.  Information Based Complexity Applied to Optimal Recovery of the 2 1/2-D Sketch , 1985 .

[51]  J. Tukey The Future of Data Analysis , 1962 .

[52]  David B. Cooper,et al.  Bayesian Recognition of Local 3-D Shape by Approximating Image Intensity Functions with Quadric Polynomials , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  David B. Cooper,et al.  On the Computational Cost of Approximating and Recognizing Noise-Perturbed Straight Lines and Quadratic Arcs in the Plane , 1976, IEEE Transactions on Computers.

[54]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  David B. Cooper,et al.  On Optimally Combining Pieces of Information, with Application to Estimating 3-D Complex-Object Position from Range Data , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[57]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[58]  J. Harris The Coupled Depth/Slope Approach to Surface Reconstruction , 1986 .

[59]  Alan L. Yuille,et al.  An Extremum Principle for Shape from Contour , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  D. Brandt,et al.  Multi-level adaptive solutions to boundary-value problems math comptr , 1977 .

[61]  Aristides A. G. Requicha,et al.  Representaiton of Rigid Solid Objects , 1980, CAD Advanced Course.