Vision as a user interface

The egg-rolling behavior of the graylag goose is an often quoted example of a fixed-action pattern. The bird will even attempt to roll a brick back to its nest! Despite excellent visual acuity it apparently takes a brick for an egg." Evolution optimizes utility, not veridicality. Yet textbooks take it for a fact that human vision evolved so as to approach veridical perception. How do humans manage to dodge the laws of evolution? I will show that they don't, but that human vision is an idiosyncratic user interface. By way of an example I consider the case of pictorial perception. Gleaning information from still images is an important human ability and is likely to remain so for the foreseeable future. I will discuss a number of instances of extreme non-veridicality and huge inter-observer variability. Despite their importance in applications (information dissemination, personnel selection,...) such huge effects have remained undocumented in the literature, although they can be traced to artistic conventions. The reason appears to be that conventional psychophysics-by design-fails to address the qualitative, that is the meaningful, aspects of visual awareness whereas this is the very target of the visual arts.

[1]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[2]  N. Tinbergen,et al.  The Study of Instinct , 1953 .

[3]  Donald D. Hoffman,et al.  Visual Intelligence: How We Create What We See , 1998 .

[4]  Johan Wagemans,et al.  Measuring 3D point configurations in pictorial space , 2011, i-Perception.

[5]  K. Lorenz.  Die Rückseite des Spiegels : Versuch einer Naturgeschichte menschlichen Erkennens , 1973 .

[6]  B. Skinner,et al.  The operational analysis of psychological terms , 1945, Behavioral and Brain Sciences.

[7]  A. Eddington.  The Nature of the Physical World , 1928 .

[8]  Stijn Oomes,et al.  Visual Rays are Parallel , 2010, Perception.

[9]  Hermann Lotze.  Medicinische Psychologie, oder, Physiologie der Seele , 2006 .

[10]  J T Todd,et al.  Ambiguity and the ‘Mental Eye’ in Pictorial Relief , 2001, Perception.

[11]  J. Koenderink.  The brain a geometry engine , 1990, Psychological research.

[12]  G. Kanizsa.  Margini Quasi-percettivi in Campi con Stimolazione Omogenea , 1955 .

[13]  E. Brunswik.  Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[14]  H. Barlow.  Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[15]  Jan J. Koenderink,et al.  Wide distribution of external local sign in the normal population , 2009, Psychological research.

[16]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[17]  E. Schrödinger,et al.  What is life? : the physical aspect of the living cell , 1946 .

[18]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[19]  J J Koenderink,et al.  Brain Scanning and the Single Mind , 1999, Perception.

[20]  William Rowan,et al.  The Study of Instinct , 1953 .

[21]  S. Pinker.  The Language Instinct , 1994 .

[22]  H. Hecht,et al.  Looking into pictures : an interdisciplinary approach to pictorial space , 2003 .

[23]  G. Doesschate,et al.  Oxford and the revival of optics in the thirteenth century , 1962 .

[24]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[25]  F. Brentano.  Psychologie vom empirischen Standpunkt , 1925 .

[26]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  M. Pirenne.  Optics, painting & photography , 1970 .

[28]  J. Koenderink,et al.  Surface perception in pictures , 1992, Perception & psychophysics.

[29]  D. Hilbert,et al.  Geometry and the Imagination , 1953 .

[30]  J. Uexküll.  Umwelt und Innenwelt der Tiere , 1921 .

[31]  Johan Wagemans,et al.  Space perception in pictures: 1. Pointing in depth , 2010 .

[32]  Edmund Husserl,et al.  Logische Untersuchungen. Erster Theil: Prolegomena zur reinen Logik , 2022 .

[33]  A. Hildebrand.  Das Problem der Form in der bildenden Kunst , 1893 .

[34]  W. Metzger.  Gesetze des Sehens , 1937 .

[35]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[36]  Donald D. Hoffman,et al.  Object Categorization: The Interface Theory of Perception: Natural Selection Drives True Perception to Swift Extinction , 2009 .

[37]  Jitendra Malik,et al.  Learning Probabilistic Models for Contour Completion in Natural Images , 2008, International Journal of Computer Vision.