Energy-based segmentation of very sparse range surfaces

A segmentation technique for very sparse surfaces is described. It is based on minimizing the energy of the surfaces in the scene. While it could be used in almost any system as part of surface reconstruction/model recovery, the algorithm is designed to be usable when the depth information is scattered and very sparse, as is generally the case with depth generated by stereo algorithms. Results from a sequential algorithm are presented, and a working prototype that executes on the massively parallel Connection Machine is discussed. The technique presented models the surfaces with reproducing kernel-based splines which can be shown to solve a regularized surface reconstruction problem. From the functional form of these splines the authors derive computable upper and lower bounds on the energy of a surface over a given finite region. The computation of the spline, and the corresponding surface representation are quite efficient for very sparse data.<<ETX>>

[1]  G. Wahba,et al.  A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines , 1970 .

[2]  Myron L. Wolbarsht,et al.  Foundations of Cyclopean Perception.Bela Julesz , 1972 .

[3]  J. Meinguet Surface Spline Interpolation: Basic Theory and Computational Aspects , 1984 .

[4]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[5]  G. Stewart,et al.  Reorthogonalization and stable algorithms for updating the Gram-Schmidt QR factorization , 1976 .

[6]  Paul J. Besl,et al.  Segmentation through symbolic surface descriptions , 1986 .

[7]  T. Boult Information-based complexity in nonlinear equations and computer vision (multivariate splines, optimal algorithms, zero-finding) , 1986 .

[8]  R. Szeliski,et al.  Incremental estimation of dense depth maps from image sequences , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  R. Franke Smooth Interpolation of Scattered Data by Local Thin Plate Splines , 1982 .

[10]  Narendra Ahuja,et al.  SURFACES FROM STEREO. , 1986 .

[11]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Narendra Ahuja,et al.  EXTRACTING SURFACES FROM STEREO IMAGES: AN INTEGRATED APPROACH. , 1987 .

[13]  G. Wahba Surface fitting with scattered noisy data on Euclidean D-space and on the sphere , 1984 .

[14]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[15]  John R. Kender,et al.  Information Based Complexity Applied to Optimal Recovery of the 2 1/2-D Sketch , 1985 .

[16]  David Lee,et al.  Contributions to information based complexity, image understanding and logic circuit design , 1986 .

[17]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .