A Dynamical Systems Account of Sensorimotor Contingencies

According to the sensorimotor approach, perception is a form of embodied know-how, constituted by lawful regularities in the sensorimotor flow or in sensorimotor contingencies (SMCs) in an active and situated agent. Despite the attention that this approach has attracted, there have been few attempts to define its core concepts formally. In this paper, we examine the idea of SMCs and argue that its use involves notions that need to be distinguished. We introduce four distinct kinds of SMCs, which we define operationally. These are the notions of sensorimotor environment (open-loop motor-induced sensory variations), sensorimotor habitat (closed-loop sensorimotor trajectories), sensorimotor coordination (reliable sensorimotor patterns playing a functional role), and sensorimotor strategy (normative organization of sensorimotor coordinations). We make use of a minimal dynamical model of visually guided categorization to test the explanatory value of the different kinds of SMCs. Finally, we discuss the impact of our definitions on the conceptual development and empirical as well as model-based testing of the claims of the sensorimotor approach.

[1]  C. L. Hull Mind, mechanism, and adaptive behavior. , 1937 .

[2]  N. Wiener,et al.  Behavior, Purpose and Teleology , 1943, Philosophy of Science.

[3]  R. F. Tredgold,et al.  The Living Brain , 1954, Mental Health.

[4]  J. Piaget The construction of reality in the child , 1954 .

[5]  Kenneth L. Artis Design for a Brain , 1961 .

[6]  James G. Taylor The behavioral basis of perception , 1962 .

[7]  Donald M. MacKay,et al.  Theoretical Models of Space Perception , 1962 .

[8]  I KOHLER,et al.  Experiments with goggles. , 1962, Scientific American.

[9]  I. Kohler,et al.  The formation and transformation of the perceptual world. , 1963 .

[10]  Seville Chapman Catching a Baseball , 1968 .

[11]  P. Bach-y-Rita Brain mechanisms in sensory substitution , 1972 .

[12]  W. T. Powers Behavior, the control of perception , 1973 .

[13]  James L. McClelland,et al.  Phenomenology of perception. , 1978, Science.

[14]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[15]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[16]  R. Beer,et al.  Intelligence as Adaptive Behavior: An Experiment in Computational Neuroethology , 1990 .

[17]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[18]  S. Laughlin,et al.  Computational neuroethology: a provisional manifesto , 1991 .

[19]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[20]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[21]  Stéphane Canu,et al.  Technology and perception: the contribution of sensory substitution systems , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.

[22]  Rolf Pfeifer,et al.  Sensory - motor coordination: The metaphor and beyond , 1997, Robotics Auton. Syst..

[23]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[24]  Inman Harvey,et al.  Evolutionary robotics: the Sussex approach , 1997, Robotics Auton. Syst..

[25]  Randall D. Beer,et al.  The dynamics of adaptive behavior: A research program , 1997, Robotics Auton. Syst..

[26]  T. Gelder Wooden iron? Husserlian phenomenology meets cognitive science , 1999 .

[27]  E. A. Dipaolo,et al.  Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions , 2000 .

[28]  F. Varela,et al.  CHAPTER NINE The Specious Present: A Neurophenomenology of Time Consciousness , 2000, Naturalizing Phenomenology.

[29]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[30]  J. Kevin O'Regan,et al.  Perceptual consciousness, access to modality and skill theories: A way to naturalize phenomenology? , 2002 .

[31]  R. Sternberg,et al.  The Psychology of Intelligence , 2002 .

[32]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[33]  Erik Myin,et al.  An account of color without a subject? , 2003, Behavioral and Brain Sciences.

[34]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[35]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[36]  Alva Noë,et al.  Neural Plasticity and Consciousness , 2003 .

[37]  E. D. Paolo,et al.  Autopoiesis, Adaptivity, Teleology, Agency , 2005 .

[38]  Daniel D. Hutto Knowing What? Radical Versus Conservative Enactivism , 2005 .

[39]  Andy Clark,et al.  Vision as Dance? Three Challenges for Sensorimotor Contingency Theory , 2006 .

[40]  J Kevin O'Regan,et al.  Color naming, unique hues, and hue cancellation predicted from singularities in reflection properties. , 2006, Visual neuroscience.

[41]  W. H. Warren The dynamics of perception and action. , 2006, Psychological review.

[42]  Zheng Wang,et al.  A unified fielder theory for interception of moving objects either above or below the horizon , 2006, Psychonomic bulletin & review.

[43]  Olaf Sporns,et al.  Mapping Information Flow in Sensorimotor Networks , 2006, PLoS Comput. Biol..

[44]  Hiroyuki Iizuka,et al.  Toward Spinozist Robotics: Exploring the Minimal Dynamics of Behavioral Preference , 2007, Adapt. Behav..

[45]  J. O'Regan,et al.  Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’ , 2007, Perception.

[46]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[47]  Xabier E. Barandiaran,et al.  Adaptivity: From Metabolism to Behavior , 2008, Adapt. Behav..

[48]  Dario Taraborelli,et al.  Action-dependent perceptual invariants: From ecological to sensorimotor approaches , 2008, Consciousness and Cognition.

[49]  J. Waller,et al.  Mind in Life: Biology, Phenomenology, and the Sciences of Mind , 2009 .

[50]  J. A. Scott Kelso,et al.  Coordination Dynamics , 2009, Encyclopedia of Complexity and Systems Science.

[51]  Inman Harvey,et al.  The Microbial Genetic Algorithm , 2009, ECAL.

[52]  Robert Ward,et al.  Representation in dynamical agents , 2009, Neural Networks.

[53]  Xabier E. Barandiaran,et al.  Defining Agency: Individuality, Normativity, Asymmetry, and Spatio-temporality in Action , 2009, Adapt. Behav..

[54]  M. Rohde,et al.  Horizons for the Enactive Mind: Values, Social Interaction, and Play , 2010 .

[55]  J. Kevin O'Regan,et al.  The Sensorimotor Approach in CoSy: The Example of Dimensionality Reduction , 2010, Cognitive Systems.

[56]  T. Roberts,et al.  Understanding ‘sensorimotor understanding’ , 2010 .

[57]  A. Chemero,et al.  Dynamics , Agency and Intentional Action , 2011 .

[58]  J. Dewey The Reflex Arc Concept in Psychology , 2011 .

[59]  Alexander Maye,et al.  A discrete computational model of sensorimotor contingencies for object perception and control of behavior , 2011, 2011 IEEE International Conference on Robotics and Automation.

[60]  Tom Froese,et al.  The Enactive Torch: A New Tool for the Science of Perception , 2012, IEEE Transactions on Haptics.

[61]  Rolf Pfeifer,et al.  Bootstrapping Perception using Information Theory: Case Studies in a quadruped Robot Running on Different grounds , 2013, Adv. Complex Syst..

[62]  Xabier E. Barandiaran,et al.  Norm-Establishing and Norm-Following in Autonomous Agency , 2014, Artificial Life.