Complexity, Confusion, and Perceptual Grouping. Part II: Mapping Complexity

Intermediate-level vision is central to form perception, and we outline an approach to intermediate-level segmentation based on complexity analysis. In this second of a pair of papers, we continue the focus on edge-element grouping, and the motivating example of an edge element inferred from an unknown image. Is this local edge part of a long curve, or part of a texture? If the former, which is the next element along the curve? If the latter, is the texture like a well-combed hair pattern, in which nearby elements are oriented similarly, or more chaotic, as in a spaghetti pattern? In the previous paper we showed how these questions raise issues of complexity and dimensionality, and how context in both position and orientation are important. We now propose a measure based on tangential and normal complexities, and illustrate its computation. Tangential complexity is related to extension; normal complexity to density. Taken together they define four canonical classes of tangent distributions: those arising from curves, from texture flows, from turbulent textures, and from isolated “dust”. Examples are included.

[1]  A. Chatterjee,et al.  PREATTENTIVE PROCESSES IN VISION , 1998 .

[2]  G. Borgefors Distance transformations in arbitrary dimensions , 1984 .

[3]  Michael Lindenbaum,et al.  A Probabilistic Interpretation of the Saliency Network , 2000, ECCV.

[4]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[5]  Ronen Basri,et al.  Extracting Salient Curves from Images: An Analysis of the Saliency Network , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  James Theiler,et al.  Estimating fractal dimension , 1990 .

[7]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[8]  Rüdiger von der Heydt,et al.  A computational model of neural contour processing: Figure-ground segregation and illusory contours , 1993, 1993 (4th) International Conference on Computer Vision.

[9]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[10]  J. Brickmann B. Mandelbrot: The Fractal Geometry of Nature, Freeman and Co., San Francisco 1982. 460 Seiten, Preis: £ 22,75. , 1985 .

[11]  S. Zucker,et al.  Evaluating the fractal dimension of profiles. , 1989, Physical review. A, General physics.

[12]  Alex Pentland,et al.  On describing complex surface shapes , 1986, Image Vis. Comput..

[13]  G. Matheron Random Sets and Integral Geometry , 1976 .

[14]  Lance R. Williams,et al.  A Comparison of Measures for Detecting Natural Shapes in Cluttered Backgrounds , 1998, ECCV.

[15]  Alex Pentland,et al.  Fractal-Based Description of Natural Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Frederic Fol Leymarie,et al.  Fast raster scan distance propagation on the discrete rectangular lattice , 1992, CVGIP Image Underst..

[17]  L. Santaló Integral geometry and geometric probability , 1976 .

[18]  S Ullman,et al.  Three-dimensional object recognition. , 1990, Cold Spring Harbor symposia on quantitative biology.

[19]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[20]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[21]  Tony Lindeberg,et al.  Scale selection for differential operators , 1994 .

[22]  H. Pagels,et al.  Dreams of Reason: The Computer and the Rise of the Sciences of Complexity , 1989 .

[23]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[24]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[25]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[26]  T. Kamae,et al.  Can one measure the temperature of a curve? , 1986 .

[27]  Georges Valiron,et al.  Théorie des fonctions , 1966 .

[28]  Steven W. Zucker,et al.  Complexity, Confusion, and Perceptual Grouping. Part I: The Curve-like Representation , 2001, Journal of Mathematical Imaging and Vision.

[29]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[30]  C. Tricot Curves and Fractal Dimension , 1994 .

[31]  M. Stryker,et al.  Development of individual geniculocortical arbors in cat striate cortex and effects of binocular impulse blockade , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  Ronen Basri,et al.  Extracting Salient Curves from Images: An Analysis of the Saliency Network , 2004, International Journal of Computer Vision.

[33]  B. Mandelbrot How Long Is the Coast of Britain ? , 2002 .

[34]  Steven W. Zucker,et al.  Indexing visual representations through the complexity map , 1995, Proceedings of IEEE International Conference on Computer Vision.

[35]  B. Mandelbrot Self-Affine Fractals and Fractal Dimension , 1985 .

[36]  B. Dubuc,et al.  Error bounds on the estimation of fractal dimension , 1996 .

[37]  James V. Mahoney,et al.  Image Chunking: Defining Spatial Building Blocks for Scene Analysis , 1987 .

[38]  C. Sparrow The Fractal Geometry of Nature , 1984 .

[39]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[40]  C. Roques-Carmes,et al.  Evaluation de la dimension fractale d'un graphe , 1988 .