Higher-order structure in regularity detection

In three experiments a simple Euclidean transformation (reflection, translation, rotation) was applied to collections of twelve dots in such a way that they contained equal lower-order structure, defined on the pairwise grouping of elements with their partner following transformation (e.g. parallel virtual lines), but differed in the presence vs absence of higher-order structure, defined on pairs of pairwise groupings (e.g. virtual quadrangles with correlated angles). Based on the much better performance levels (d') in the case of additional higher-order structure, we conclude that global regularities are easier to detect when the local correspondences are supported by higher-order ones formed between them. These enable the lower-order groupings to spread out across the whole pattern very rapidly (called bootstrapping). As a preliminary attempt to specify these principles, we proposed a working model with two basic components: first, a function expressing the cost of a perceptual grouping or the lack of regularity, and, secondly, an algorithm based on simulated annealing to minimize the cost function. The simulation results obtained with our current implementation of these principles showed satisfactory qualitative agreement with human regularity detection performance. Finally, the theory was shown to capture the essence of a large number of grouping phenomena taken from diverse domains such as detection of symmetry in dot patterns, global structure in Glass and vector patterns, correspondence in stereoscopic transparency and apparent motion. Therefore, we are convinced that, in principle, the mechanism used by the human visual system to detect regularity incorporates something like bootstrapping based on higher-order structure. We regard this as a promising step towards unraveling the intriguing mechanisms of classic Gestalt phenomena.

[1]  F. Royer,et al.  Detection of symmetry. , 1981, Journal of experimental psychology. Human perception and performance.

[2]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[3]  I. Rock,et al.  An experimental analysis of visual symmetry , 1963 .

[4]  B Jenkins,et al.  Component processes in the perception of bilaterally symmetric dot textures , 1983, Perception & psychophysics.

[5]  J J Koenderink,et al.  Effects of element orientation on apparent motion perception , 1990, Perception & psychophysics.

[6]  B. Jenkins,et al.  Redundancy in the perception of bilateral symmetry in dot textures , 1982, Perception & psychophysics.

[7]  J. Smits,et al.  The perception of a dotted line in noise: a model of good continuation and some experimental results. , 1985, Spatial vision.

[8]  Ernst Mach,et al.  The Analysis of Sensations. , 1916 .

[9]  Vicky G Bruce,et al.  Violations of Symmetry and Repetition in Visual Patterns , 1975 .

[10]  K Prazdny,et al.  On the Perception of Glass Patterns , 1984, Perception.

[11]  David H. Foster,et al.  Discrete internal pattern representations and visual detection of small changes in pattern shape , 1979 .

[12]  Johan Wagemans,et al.  Visual search in dot-patterns with bilateral and skewed symmetry , 1990 .

[13]  D H Foster,et al.  Visual Comparison of Random-Dot Patterns: Evidence concerning a Fixed Visual Association between Features and Feature-Relations , 1978, The Quarterly journal of experimental psychology.

[14]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[15]  D E Humphrey,et al.  The role of structure in infant visual pattern perception. , 1989, Canadian journal of psychology.

[16]  W. Hoffman The Lie algebra of visual perception , 1966 .

[17]  S. Palmer,et al.  Orientation and symmetry: effects of multiple, rotational, and near symmetries. , 1978, Journal of Experimental Psychology: Human Perception and Performance.

[18]  S. Appelle Perception and discrimination as a function of stimulus orientation: the "oblique effect" in man and animals. , 1972, Psychological bulletin.

[19]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[20]  B Jenkins,et al.  Orientational anisotropy in the human visual system , 1985, Perception & psychophysics.

[21]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[22]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[23]  Thomas O. Binford,et al.  Segmentation and aggregation: an approach to figure-ground phenomena , 1987 .

[24]  P. Dodwell,et al.  Recognition of Vector Patterns under Transformations: Local and Global Determinants , 1985 .

[25]  E. Essock The Oblique Effect of Stimulus Identification Considered with Respect to Two Classes of Oblique Effects , 1980, Perception.

[26]  S. Zucker,et al.  Points and Endpoints: A Size/Spacing Constraint for Dot Grouping , 1988, Perception.

[27]  Johan Wagemans,et al.  Orientational Effects and Component Processes in Symmetry Detection , 1992 .

[28]  J T Todd,et al.  The perception of stereoscopic transparency , 1988, Perception & psychophysics.

[29]  T Caelli,et al.  Orientation-position coding and invariance characteristics of pattern discrimination , 1984, Perception & psychophysics.

[30]  Allen Brookes,et al.  Detecting structure by symbolic constructions on tokens , 1987, Comput. Vis. Graph. Image Process..

[31]  L. Glass,et al.  Pattern Recognition in Humans: Correlations Which Cannot be Perceived , 1976, Perception.

[32]  Takeo Kanade,et al.  Mapping Image Properties into Shape Constraints: Skewed Symmetry, Affine-Transformable Patterns, and the Shape-from-Texture Paradigm , 1983 .

[33]  D. Foster,et al.  Horizontal-vertical structure in the visual comparison of rigidly transformed patterns. , 1986, Journal of experimental psychology. Human perception and performance.

[34]  P J Locher,et al.  Effects of Element Type and Spatial Grouping on Symmetry Detection , 1993, Perception.

[35]  H. Barlow,et al.  The versatility and absolute efficiency of detecting mirror symmetry in random dot displays , 1979, Vision Research.

[36]  P. Dodwell The Lie transformation group model of visual perception , 1983, Perception & psychophysics.

[37]  L. Glass Moiré Effect from Random Dots , 1969, Nature.

[38]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[39]  T Caelli,et al.  The discrimination of structure in vectorgraphs: Local and global effects , 1982, Perception & psychophysics.

[40]  Stuart A. Friedberg,et al.  Finding axes of skewed symmetry , 1986, Comput. Vis. Graph. Image Process..

[41]  R. Pérez,et al.  Perception of Random Dot Interference Patterns , 1973, Nature.

[42]  W F Bischof,et al.  Selective internal operations in the recognition of locally and globally point-inverted patterns. , 1985, Spatial vision.

[43]  G. Moraglia,et al.  Display organization and the detection of horizontal line segments , 1989, Perception & psychophysics.

[44]  Johan Wagemans,et al.  Detection of symmetry in tachistoscopically presented dot patterns: Effects of multiple axes and skewing , 1991, Perception & psychophysics.

[45]  B Jenkins,et al.  Spatial limits to the detection of transpositional symmetry in dynamic dot textures. , 1983, Journal of experimental psychology. Human perception and performance.

[46]  H Pashler,et al.  Coordinate frame for symmetry detection and object recognition. , 1990, Journal of experimental psychology. Human perception and performance.

[47]  David J. Parker,et al.  Analysis of global pattern features , 1974, Pattern Recognit..