Closure—Hierarchies of Gestalten

Gestalt perception comes in hierarchies. Human observers are quick and reliable in reconstructing from pictorial data constructions like a row made of reflection symmetric parts, where each wing of the parts is again a lattice of reflection symmetric sub-parts, etc. Machines hardly compete with these skills up to now, in particular when projection distorted the patterns, or occlusion deleted some parts of it. This chapter is meant as an attempt to code machines so that they become better. To this end, the combinatorial nature of such “Gestalt sentences” must first be understood. Instead of the traditional way of defining grammars, here an algebraic view is taken, understanding what used to be a “pattern language” as the closure of the Gestalt Algebra. The operations of this algebra are the Gestalt operations given in the previous chapters. Of course such closure is infinite, but we can prove that almost all Gestalten in it have assessments close to zero. The set of hierarchical Gestalten assessed better than an \(\epsilon >0\) and resulting from a finite set of primitives is finite. Still, this set can be very huge. In particular if we use the operations simply, i.e., only taking into account the features of immediately preceding Gestalten. However, in this chapter we also present ways to propagate the Gestalt laws through the hierarchy, if necessary, down to the preceding primitives. This greatly reduces numbers and efforts. The literature on symmetry recognition sees a problem in the non-local nature of, e.g., reflection symmetry. Search for correspondence cannot be bounded by less than quadratic complexity. Here hierarchy can actually help. Correspondence between very distant small objects is established by use of hierarchy. This can be implemented in sub-quadratic complexity. Thus, what looks at first glance like a combinatorial nightmare, turns out to be a proposal for the solution of an old and hard combinatorial correspondence problem.

[1]  Heinrich Niemann Pattern Analysis and Understanding , 1990 .

[2]  Sven J. Dickinson,et al.  2017 ICCV Challenge: Detecting Symmetry in the Wild , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[3]  Wolfgang Förstner,et al.  Photogrammetric Computer Vision: Statistics, Geometry, Orientation and Reconstruction , 2017 .

[4]  Eckart Michaelsen Gestalt Algebra - A Proposal for the Formalization of Gestalt Perception and Rendering , 2014, Symmetry.

[5]  Bernd Meyer,et al.  Visual Language Theory , 2012, Springer New York.

[6]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[7]  Michael Arens,et al.  Hierarchical Grouping Using Gestalt Assessments , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[8]  King-Sun Fu,et al.  Syntactic Methods in Pattern Recognition , 1974, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Takashi Matsuyama,et al.  SIGMA: A Knowledge-Based Aerial Image Understanding System , 1990 .

[10]  E. Michaelsen Perceptual grouping of row-gestalts in aerial NIR images of urban terrain , 2012, 7th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[11]  E. Michaelsen,et al.  Simple gestalt algebra , 2014, Pattern Recognition and Image Analysis.

[12]  R. Narasimhan,et al.  Labeling Schemata and Synctactic Descriptions of Pictures , 1964, Inf. Control..