Toward an Integrated Approach to Perception and Action: Conference Report and Future Directions

This article was motivated by the conference entitled “Perception & Action – An Interdisciplinary Approach to Cognitive Systems Theory,” which took place September 14–16, 2010 at the Santa Fe Institute, NM, USA. The goal of the conference was to bring together an interdisciplinary group of neuroscientists, roboticists, and theorists to discuss the extent and implications of action–perception integration in the brain. The motivation for the conference was the realization that it is a widespread approach in biological, theoretical, and computational neuroscience to investigate sensory and motor function of the brain in isolation from one another, while at the same time, it is generally appreciated that sensory and motor processing cannot be fully separated. Our article summarizes the key findings of the conference, provides a hypothetical model that integrates the major themes and concepts presented at the conference, and concludes with a perspective on future challenges in the field.

[1]  Josef P. Rauschecker,et al.  An expanded role for the dorsal auditory pathway in sensorimotor control and integration , 2011, Hearing Research.

[2]  F. Ohl,et al.  Behavioral semantics of learning and crossmodal processing in auditory cortex: The semantic processor concept , 2011, Hearing Research.

[3]  A. Borst,et al.  Central gating of fly optomotor response , 2010, Proceedings of the National Academy of Sciences.

[4]  Mirko Farina.  Perception, action, and consciousness: Sensorimotor Dynamics and Two Visual Systems , 2010 .

[5]  Michael B. Reiser,et al.  Walking Modulates Speed Sensitivity in Drosophila Motion Vision , 2010, Current Biology.

[6]  Stephen G Lisberger,et al.  Visual Guidance of Smooth-Pursuit Eye Movements: Sensation, Action, and What Happens in Between , 2010, Neuron.

[7]  M. Juusola,et al.  Intrinsic Activity in the Fly Brain Gates Visual Information during Behavioral Choices , 2010, PloS one.

[8]  M. Dickinson,et al.  Active flight increases the gain of visual motion processing in Drosophila , 2010, Nature Neuroscience.

[9]  Ralf Der,et al.  Higher Coordination With Less Control—A Result of Information Maximization in the Sensorimotor Loop , 2009, Adapt. Behav..

[10]  J. Hawkins,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[11]  R. Berman,et al.  Attention and active vision , 2009, Vision Research.

[12]  Ralf Der,et al.  Modulated Exploratory Dynamics Can Shape Self-Organized Behavior , 2009, Adv. Complex Syst..

[13]  M. Sommer,et al.  Frontal Eye Field Neurons with Spatial Representations Predicted by Their Subcortical Input , 2009, The Journal of Neuroscience.

[14]  E. Ahissar,et al.  Orthogonal coding of object location , 2009, Trends in Neurosciences.

[15]  Chrystopher L. Nehaniv,et al.  Keep Your Options Open: An Information-Based Driving Principle for Sensorimotor Systems , 2008, PloS one.

[16]  R. Wurtz,et al.  Brain circuits for the internal monitoring of movements. , 2008, Annual review of neuroscience.

[17]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[18]  J. Poulet,et al.  New insights into corollary discharges mediated by identified neural pathways , 2007, Trends in Neurosciences.

[19]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[20]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[21]  J Kevin O'Regan,et al.  Color naming, unique hues, and hue cancellation predicted from singularities in reflection properties. , 2006, Visual neuroscience.

[22]  E. Ahissar,et al.  Parallel Thalamic Pathways for Whisking and Touch Signals in the Rat , 2006, PLoS biology.

[23]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  Xiaoqin Wang,et al.  Sensory-motor interaction in the primate auditory cortex during self-initiated vocalizations. , 2003, Journal of neurophysiology.

[26]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[27]  Leslie G. Ungerleider,et al.  Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys , 1982, Behavioural Brain Research.

[28]  R. Sperry.  Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[29]  J. O'Regan.  Explaining what people say about sensory qualia , 2009 .

[30]  Ralf Der,et al.  Predictive information and emergent cooperativity in a chain of mobile robots , 2008, ALIFE.

[31]  R. Guillery.  Anatomical pathways that link perception and action. , 2005, Progress in brain research.

[32]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[33]  Alvin M. Liberman,et al.  Speech: A Special Code , 1996 .