Finding tree structures by grouping symmetries

The representation of objects in images as tree structures is of great interest to vision, as they can represent articulated objects such as people as well as other structured objects like arteries in human bodies, roads, circuit board patterns, etc. Tree structures are often related to the symmetry axis representation of shapes, which captures their local symmetries. Algorithms have been introduced to detect (i) open contours in images in quadratic time (ii) closed contours in images in cubic time, and (iii) tree structures from contours in quadratic time. The algorithms are based on dynamic programming and single source shortest path algorithms. However, in this paper, we show that the problem of finding tree structures in images in a principled manner is a much harder problem. We argue that the optimization problem of finding tree structures in images is essentially equivalent to a variant of the Steiner tree problem, which is NP-hard. Nevertheless, an approximate polynomial-time algorithm for this problem exists: we apply a fast implementation of the Goemans-Williamson approximate algorithm to the problem of finding a tree representation after an image is transformed by a local symmetry mapping. Examples of extracting tree structures from images illustrate the idea and applicability of the approximate method

[1]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[2]  Jayant Shah,et al.  Extraction of Shape Skeletons from Grayscale Images , 1997, Comput. Vis. Image Underst..

[3]  Benjamin B. Kimia,et al.  Symmetry Maps of Free-Form Curve Segments via Wave Propagation , 2004, International Journal of Computer Vision.

[4]  Robert Kohn,et al.  Representation and self-similarity of shapes , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Demetri Terzopoulos,et al.  Symmetry-seeking models and 3D object reconstruction , 1988, International Journal of Computer Vision.

[6]  David P. Williamson,et al.  A general approximation technique for constrained forest problems , 1992, SODA '92.

[7]  Alan L. Yuille,et al.  FORMS: A flexible object recognition and modelling system , 1996, International Journal of Computer Vision.

[8]  H. Blum Biological shape and visual science. I. , 1973, Journal of theoretical biology.

[9]  Ian H. Jermyn,et al.  Globally Optimal Regions and Boundaries as Minimum Ratio Weight Cycles , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Stephen M. Pizer,et al.  Object representation by cores: Identifying and representing primitive spatial regions , 1995, Vision Research.

[12]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[13]  Moshe Lewenstein,et al.  A faster implementation of the Goemans-Williamson clustering algorithm , 2001, SODA '01.

[14]  Philip N. Klein,et al.  Recognition of Shapes by Editing Shock Graphs , 2001, ICCV.

[15]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[16]  R. Ravi,et al.  When trees collide: an approximation algorithm for the generalized Steiner problem on networks , 1991, STOC '91.

[17]  H. Blum Biological shape and visual science (part I) , 1973 .

[18]  Ugo Montanari,et al.  On the optimal detection of curves in noisy pictures , 1971, CACM.

[19]  R. Ravi,et al.  When Trees Collide: An Approximation Algorithm for the Generalized Steiner Problem on Networks , 1995, SIAM J. Comput..

[20]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[21]  Kaleem Siddiqi,et al.  Parts of Visual Form: Computational Aspects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Kaleem Siddiqi,et al.  Contour Fragment Grouping and Shared, Simple Occluders , 1999, Comput. Vis. Image Underst..

[23]  Robert Kohn,et al.  Representation and Self-Similarity of Shapes , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Benjamin B. Kimia,et al.  Perceptual organization via the symmetry map and symmetry transforms , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Gérard G. Medioni,et al.  Hierarchical Decomposition and Axial Shape Description , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Ingemar J. Cox,et al.  "Ratio regions": a technique for image segmentation , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[28]  Yehezkel Yeshurun,et al.  Detection of interest points using symmetry , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[29]  Kaleem Siddiqi,et al.  Matching Hierarchical Structures Using Association Graphs , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  David B. Cooper,et al.  Automatic Finding of Main Roads in Aerial Images by Using Geometric-Stochastic Models and Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Alan L. Yuille,et al.  Segmenting by seeking the symmetry axis , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[32]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..