Segmentation of range images as the search for geometric parametric models

Segmentation of range images has long been considered in computer vision as an important but extremely difficult problem. In this paper we present a new paradigm for the segmentation of range images into piecewise continuous surfaces. Data aggregation is performed via model recovery in terms of variable-order bi-variate polynomials using iterative regression. Model recovery is initiated independently in regularly placed seed regions in the image. All the recovered models are potential candidates for the final description of the data. Selection of the models is defined as a quadratic Boolean problem, and the solution is sought by the WTA (winner-takes-all) technique, which turns out to be a good compromise between the speed of computation and the accuracy of the solution. The overall efficiency of the method is achieved by combining model recovery and model selection in an iterative way. Partial recovery of the models is followed by the selection (optimization) procedure and only the “best” models are allowed to develop further.The major novelty of the approach lies in an effective combination of simple component algorithms, which stands in contrast to methods which attempt to solve the problem in a single processing step using sophisticated means. We present the results on several real range images.

[1]  D. Krech,et al.  Levels of perceptual organization and cognition. , 1953, Journal of abnormal psychology.

[2]  Steven W. Zucker,et al.  Region growing: Childhood and adolescence* , 1976 .

[3]  S. Zucker Toward a model of texture , 1976 .

[4]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[5]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[6]  M. Brady Criteria for Representations of Shape , 1983 .

[7]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[8]  Christof Koch,et al.  Selecting One Among the Many: A Simple Network Implementing Shifts in Selective Visual Attention , 1984 .

[9]  R. Lee,et al.  Two-Dimensional Critical Point Configuration Graphs , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  L. Nackman Two-Dimensional Critical Point Configuration Graphs , 1984, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jorma Rissanen,et al.  Universal coding, information, prediction, and estimation , 1984, IEEE Trans. Inf. Theory.

[12]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[13]  Jean Ponce,et al.  Describing surfaces , 1985, Comput. Vis. Graph. Image Process..

[14]  Jean Ponce,et al.  Toward a surface primal sketch , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[15]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[16]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[19]  Takeo Kanade,et al.  Autonomous scene description with range imagery , 1985, Comput. Vis. Graph. Image Process..

[20]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[21]  Anil K. Jain,et al.  Segmentation and Classification of Range Images , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  D. Ackley Stochastic iterated genetic hillclimbing , 1987 .

[23]  Paul J. Besl,et al.  Surfaces in Range Image Understanding , 1988, Springer Series in Perception Engineering.

[24]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  R. Bajcsy Active perception , 1988, Proc. IEEE.

[26]  Ruzena Bajcsy,et al.  Segmentation versus object representation—are they separable? , 1989 .

[27]  Alex Pentland,et al.  Part Segmentation for Object Recognition , 1989, Neural Computation.

[28]  David Shi Chen,et al.  A Data-Driven Intermediate Level Feature Extraction Algorithm , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Martin D. Levine,et al.  Structured edge map of curved objects in a range image , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Pascal Fua,et al.  Objective Functions for Feature Discrimination , 1989, IJCAI.

[31]  Pascal Fua,et al.  Objective functions for feature discrimination: theory , 1989 .

[32]  Ping Liang,et al.  Representation and recognition of surface shapes in range images: A differential geometry approach , 1990, Comput. Vis. Graph. Image Process..

[33]  T. Fan Describing and Recognizing 3-D Objects Using Surface Properties , 1989, Springer Series in Perception Engineering.

[34]  Baba C. Vemuri,et al.  On Three-Dimensional Surface Reconstruction Methods , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[36]  Thomas O. Binford,et al.  Ignorance, myopia, and naiveté in computer vision systems , 1991, CVGIP Image Underst..

[37]  Ruzena Bajcsy,et al.  Finding Parametric Curves in an Image , 1992, ECCV.

[38]  Ruzena Bajcsy,et al.  Volumetric segmentation of range images of 3D objects using superquadric models , 1993 .

[39]  Franc Solina,et al.  A Direct Recovery of Superquadric Models in Range Images Using Recover-and-Select Paradigm , 1994, ECCV.

[40]  Yvan G. Leclerc,et al.  Constructing simple stable descriptions for image partitioning , 1989, International Journal of Computer Vision.

[41]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[42]  Alex Pentland,et al.  Automatic extraction of deformable part models , 1990, International Journal of Computer Vision.

[43]  Jerome A. Feldman,et al.  Dynamic connections in neural networks , 1990, Biological Cybernetics.

[44]  Layne T. Watson,et al.  Robust window operators , 2005, Machine Vision and Applications.

[45]  Elizabeth Berry,et al.  Segmentation and Classification , 2007 .