Action-dependent perceptual invariants: From ecological to sensorimotor approaches

Ecological and sensorimotor theories of perception build on the notion of action-dependent invariants as the basic structures underlying perceptual capacities. In this paper we contrast the assumptions these theories make on the nature of perceptual information modulated by action. By focusing on the question, how movement specifies perceptual information, we show that ecological and sensorimotor theories endorse substantially different views about the role of action in perception. In particular we argue that ecological invariants are characterized with reference to transformations produced in the sensory array by movement: such invariants are transformation-specific but do not imply motor-specificity. In contrast, sensorimotor theories assume that perceptual invariants are intrinsically tied to specific movements. We show that this difference leads to different empirical predictions and we submit that the distinction between motor equivalence and motor-specificity needs further clarification in order to provide a more constrained account of action/perception relations.

[1]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[2]  M. Wexler.  ALLOCENTRIC PERCEPTION OF SPACE AND VOLUNTARY HEAD MOVEMENT , 2001 .

[3]  G. Stelmach,et al.  Tutorials in Motor Behavior , 1980 .

[4]  P. Jacob,et al.  Why Visual Experience is Likely to Resist Being Enacted , 2006 .

[5]  H. Ono,et al.  Depth perception as a function of motion parallax and absolute-distance information. , 1986, Journal of experimental psychology. Human perception and performance.

[6]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[7]  M. Jeannerod,et al.  Ways of Seeing: The Scope and Limits of Visual Cognition , 2003 .

[8]  T. Järvilehto.  The theory of the organism-environment system: III. Role of efferent influences on receptors in the formation of knowledge. , 1999 .

[9]  Morton A. Heller,et al.  Touch, representation, and blindness , 2000 .

[10]  Jacques Droulez,et al.  Self-motion and the perception of stationary objects , 2001, Nature.

[11]  M. Wexler,et al.  Voluntary Head Movement and Allocentric Perception of Space , 2003, Psychological science.

[12]  D. Wolpert,et al.  Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli , 1999, Journal of Cognitive Neuroscience.

[13]  P. Bach-y-Rita.  Brain mechanisms in sensory substitution , 1972 .

[14]  Eric L. Amazeen,et al.  Peripheral neuropathy and object length perception by effortful (dynamic) touch: A case study , 2006, Neuroscience Letters.

[15]  E. Rosch,et al.  The Embodied Mind: Cognitive Science and Human Experience , 1993 .

[16]  J Kevin O'Regan,et al.  Color naming, unique hues, and hue cancellation predicted from singularities in reflection properties. , 2006, Visual neuroscience.

[17]  Benoît G. Bardy,et al.  Affordances in the design of enactive systems , 2006, Virtual Reality.

[18]  W. S. McCulloch,et al.  Aspects of the Theory of Artificial Intelligence , 1962, Springer US.

[19]  Carter C. Collins,et al.  Seeing with the skin , 1970 .

[20]  M. Turvey,et al.  The ecological approach to perceiving-acting: a pictorial essay. , 1986, Acta psychologica.

[21]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[22]  Robert F. Port,et al.  MIND IN MOTION: , 2019, Dune.

[23]  Masao Ohmi,et al.  Heading judgments during active and passive self-motion , 2004, Experimental Brain Research.

[24]  J. Gibson.  Perception as a function of stimulation , 1959 .

[25]  B. Rogers,et al.  Similarities between motion parallax and stereopsis in human depth perception , 1982, Vision Research.

[26]  M J Steinbach,et al.  Motion parallax judgements of depth as a function of the direction and type of head movement. , 1991, Canadian journal of psychology.

[27]  Peter Wolff,et al.  Position of code and code for position: From isomorphism to a sensorimotor account of space perception , 2004 .

[28]  Jeroen J. A. van Boxtel,et al.  Perception of plane orientation from self-generated and passively observed optic flow. , 2003, Journal of vision.

[29]  H. Poincaré.  La science et l'hypothèse , 1968 .

[30]  L. Stark,et al.  Role of corollary discharge in space constancy , 1983, Perception & psychophysics.

[31]  Koch Sigmund Ed,et al.  Psychology: A Study of A Science , 1962 .

[32]  James E. Cutting,et al.  Perception with an eye for motion , 1986 .

[33]  E. Reed.  An outline of a theory of action systems. , 1982, Journal of motor behavior.

[34]  Mark Nawrot,et al.  Depth from motion parallax scales with eye movement gain. , 2003, Journal of vision.

[35]  C. Lenay,et al.  SENSORY SUBSTITUTION: LIMITS AND PERSPECTIVES , 2003 .

[36]  Donald G. MacKay,et al.  The organization of perception and action. A theory for language and other cognitive skills , 1987, The Italian Journal of Neurological Sciences.

[37]  Edward S. Reed,et al.  Motor variability but functional specificity: Demise of the concept of motor commands , 1986, Behavioral and Brain Sciences.

[38]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[39]  J. Gibson.  Visually controlled locomotion and visual orientation in animals. , 1998, British journal of psychology.

[40]  Susan Hurley,et al.  Perception And Action: Alternative Views , 2001, Synthese.

[41]  Hans Wallach,et al.  The compensation for movement-produced changes of object orientation , 1974 .

[42]  Rob Withagen,et al.  On Ecological Conceptualizations of Perceptual Systems and Action Systems , 2005 .

[43]  A. Noë,et al.  On What We See , 2002 .

[44]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[45]  W. H. Warren.  The dynamics of perception and action. , 2006, Psychological review.

[46]  R. B. Freeman,et al.  Cognition and Motor Processes , 1983 .

[47]  T. Stoffregen,et al.  On specification and the senses , 2001, Behavioral and Brain Sciences.

[48]  M. Goodale,et al.  The visual brain in action , 1995 .

[49]  William H. Warren,et al.  Visually Controlled Locomotion: 40 years Later , 1998 .

[50]  E. Scheerer.  Motor Theories of Cognitive Structure: A Historical Review , 1984 .

[51]  A. Berthoz,et al.  The Brain’s Sense of Movement , 2000 .

[52]  Stéphane Canu,et al.  Technology and perception: the contribution of sensory substitution systems , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.

[53]  E. Reed.  Encountering the world: Toward an ecological psychology. , 1997 .

[54]  M. Turvey.  Dynamic touch. , 1996, The American psychologist.

[55]  J. Prinz.  Putting the Brakes on Enactive Perception , 2006 .

[56]  Alva Noë,et al.  Action in Perception , 2006, Representation and Mind.

[57]  J. Koenderink.  Optic flow , 1986, Vision Research.

[58]  J. Kevin O'Regan,et al.  Perception of the Structure of the Physical World Using Unknown Multimodal Sensors and Effectors , 2003, NIPS.

[59]  C. Gallistel.  The organization of action , 1980 .

[60]  Fillmore H. Sanford,et al.  THE STUDY OF SCIENCE. , 2022, Science.

[61]  Hiroyasu Ujike,et al.  Depth thresholds of motion parallax as a function of head movement velocity , 2001, Vision Research.

[62]  Mark Wexler,et al.  Depth perception by the active observer , 2005, Trends in Cognitive Sciences.

[63]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[64]  J. Fodor,et al.  How direct is visual perception?: Some reflections on Gibson's “ecological approach” , 1981, Cognition.

[65]  J. Gibson.  The perception of the visual world , 1951 .

[66]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[67]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[68]  Donald M. MacKay,et al.  Theoretical Models of Space Perception , 1962 .

[69]  S. Hurley.  Consciousness in Action , 2000 .

[70]  W. Warren.  Action modes and laws of control for the visual guidance of action , 1988 .

[71]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[72]  David N. Lee.  16 Visuo-Motor Coordination in Space-Time , 1980 .

[73]  F. Varela.  Principles of biological autonomy , 1979 .

[74]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[75]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[76]  J. Droulez,et al.  The stationarity hypothesis: an allocentric criterion in visual perception , 2001, Vision Research.

[77]  A. Noē.  Direct Perception , 2022 .

[78]  R. Held.  Plasticity in sensory-motor systems. , 1965, Scientific American.

[79]  Woodrow Barfield,et al.  Virtual environments and advanced interface design , 1995 .

[80]  H. Maturana,et al.  Autopoiesis and Cognition : The Realization of the Living (Boston Studies in the Philosophy of Scie , 1980 .

[81]  Zenon W. Pylyshyn.  Seeing, acting, and knowing , 2001 .

[82]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.