Inference of Surfaces, 3D Curves, and Junctions From Sparse, Noisy, 3D Data

We address the problem of obtaining dense surface information from a sparse set of 3D data in the presence of spurious noise samples. The input can be in the form of points, or points with an associated tangent or normal, allowing both position and direction to be corrupted by noise. Most approaches treat the problem as an interpolation problem, which is solved by fitting a surface such as a membrane or thin plate to minimize some function. We argue that these physical constraints are not sufficient, and propose to impose additional perceptual constraints such as good continuity and "cosurfacity". These constraints allow us to not only infer surfaces, but also to detect surface orientation discontinuities, as well as junctions, all at the same time. The approach imposes no restriction on genus, number of discontinuities, number of objects, and is noniterative. The result is in the form of three dense saliency maps for surfaces, intersections between surfaces (i.e., 3D curves), and 3D junctions, respectively. These saliency maps are then used to guide a "marching" process to generate a description (e.g., a triangulated mesh) making information about surfaces, space curves, and 3D junctions explicit. The traditional marching process needs to be refined as the polarity of the surface orientation is not necessarily locally consistent. These three maps are currently not integrated, and this is the topic of our ongoing research. We present results on a variety of computer-generated and real data, having varying curvature, of different genus, and multiple objects.

[1]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[2]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  John R. Kender,et al.  Visual Surface Reconstruction Using Sparse Depth Data , 1986, CVPR 1986.

[5]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[6]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[7]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Narendra Ahuja,et al.  Extraction of early perceptual structure in dot patterns: Integrating region, boundary, and component gestalt , 1989, Comput. Vis. Graph. Image Process..

[9]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Richard S. Weiss,et al.  Perceptual Grouping Of Curved Lines , 1989, Other Conferences.

[11]  Barbara Moore,et al.  Theory of networks for learning , 1990, Defense, Security, and Sensing.

[12]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[13]  S. S. Sinha,et al.  Surface approximation using weighted splines , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[15]  Pascal Fua,et al.  Segmenting Unstructured 3D Points into Surfaces , 1992, ECCV.

[16]  G. Guy,et al.  Perceptual grouping using global saliency-enhancing operators , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[17]  Richard Szeliski,et al.  Modeling surfaces of arbitrary topology with dynamic particles , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Gérard G. Medioni,et al.  Inferring global perceptual contours from local features , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Surface Approximation of a Cloud of 3D Points , 1995, CVGIP Graph. Model. Image Process..

[20]  N. M. Vaidya,et al.  Discontinuity preserving surface reconstruction through global optimization , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[21]  Song Han,et al.  Triangular NURBS surface modeling of scattered data , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[22]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[23]  G. Guy Inference of multiple curves and surfaces from sparse data , 1996 .