Inference of surfaces, 3-D curves, and junctions from sparse 3-D data

Addresses the problem of obtaining surface information from a sparse set of 3-D data in the presence of spurious noise samples. The input can be in the form of points, or points with an associated normal, allowing for both position and direction to be corrupted by noise. This is the typical input obtained from matching sparse features in stereo or motion, assuming that the observed scene is rigid. Most approaches treat the problem as an interpolation problem, solved by fitting a surface such as a membrane or thin plate which minimizes some functional. The authors argue that these physical constraints are not sufficient and propose to impose additional perceptual constraints such as good continuation and "co-surfacity". These constraints allow the authors to not only infer surfaces, but also detect surface discontinuities at the same time. The method imposes no restriction on genus, number of discontinuities, number of objects, and is non-iterative. The result is in the form of three dense saliency maps for surfaces, intersections between surfaces, and 3-D junctions. These saliency maps can then be used to guide a 'marching' process to generate a description (e.g. a triangulated mesh) making information about surfaces, space curves, and 3-D junctions explicit. The authors present results on computer-generated and real data having multiple objects, varying curvature, and of different genus.

[1]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[4]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[5]  N. M. Vaidya,et al.  Discontinuity preserving surface reconstruction through global optimization , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[6]  Richard Szeliski,et al.  Modeling surfaces of arbitrary topology with dynamic particles , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Song Han,et al.  Triangular NURBS surface modeling of scattered data , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[8]  G. Guy,et al.  Perceptual grouping using global saliency-enhancing operators , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[9]  G. Guy Inference of multiple curves and surfaces from sparse data , 1996 .

[10]  S. S. Sinha,et al.  Surface approximation using weighted splines , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Pascal Fua,et al.  Segmenting Unstructured 3D Points into Surfaces , 1992, ECCV.

[12]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[14]  Ramakant Nevatia,et al.  Segmentation and description based on perceptual organization , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Richard S. Weiss,et al.  Perceptual Grouping Of Curved Lines , 1989, Other Conferences.

[16]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[17]  Narendra Ahuja,et al.  Extraction of early perceptual structure in dot patterns: Integrating region, boundary, and component gestalt , 1989, Comput. Vis. Graph. Image Process..

[18]  John R. Kender,et al.  Visual Surface Reconstruction Using Sparse Depth Data , 1986, CVPR 1986.

[19]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.