The symbol detachment problem

In situated and embodied approaches it is commonly assumed that the dynamics of sensorimotor engagement between an adaptive agent and its environment are crucial in understanding natural cognition. This perspective permits to address the symbol grounding problem, since the aboutness of any mental state arising during agent-environment engagement is guaranteed by their continuous coupling. However, cognitive agents are also able to formulate representations that are detached from the current state of affairs, such as expectations and goals. Moreover, they can act on their representations before—or instead of—acting directly on the environment, for example building the plan of a bridge and not directly the bridge. On the basis of representations, actions such as planning, remembering or imagining are possible that are disengaged from the current sensorimotor cycle, and often functional to future-oriented conducts. A new problem thus has to be acknowledged, the symbol detachment problem: how and why do situated agents develop representations that are detached from their current sensorimotor interaction, but nevertheless preserve grounding and aboutness? How do cognitive agents progressively acquire a range of capabilities permitting them to deal not only with the current situation but also with alternative, in particular future states of affairs? How do they develop the capability of acting on their representations instead of acting directly on the world? In a theoretical and developmental perspective, we propose that anticipation plays a crucial role in the detachment process: anticipatory representations, originally detached from the sensorimotor cycle for the sake of action control, are successively exapted for bootstrapping increasingly complex cognitive capabilities.

[1]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[2]  Giovanni Pezzulo Toward a Perceptual Symbol System , 2006 .

[3]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[4]  Marco C. Bettoni,et al.  Made-Up Minds: A Constructivist Approach to Artificial Intelligence , 1993, IEEE Expert.

[5]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[6]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[7]  D. Kimbrough Oller,et al.  Evolution of communication systems : a comparative approach , 2004 .

[8]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[9]  W. James,et al.  The Principles of Psychology. , 1983 .

[10]  Christian Balkenius,et al.  Attention as selection-for-action: a scheme for active perception , 1999, 1999 Third European Workshop on Advanced Mobile Robots (Eurobot'99). Proceedings (Cat. No.99EX355).

[11]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[12]  D. Dennett Consciousness Explained. Boston (Little, Brown and Co) 1991. , 1991 .

[13]  M. Iacoboni Understanding Others: Imitation, Language, Empathy , 2002 .

[14]  Alfonso Caramazza,et al.  The orchestration of the sensory-motor systems: Clues from Neuropsychology , 2005, Cognitive neuropsychology.

[15]  P. Strick,et al.  Basal Ganglia Output and Cognition: Evidence from Anatomical, Behavioral, and Clinical Studies , 2000, Brain and Cognition.

[16]  F. W. Irwin Purposive Behavior in Animals and Men , 1932, The Psychological Clinic.

[17]  F. Brentano Psychology from an Empirical Standpoint , 1874 .

[18]  Bernhard Hommel,et al.  Codes and their vicissitudes , 2001 .

[19]  Stephen Hurley,et al.  Active Perception and Perceiving Action: The Shared Circuits Model , 2006 .

[20]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[21]  Deb Roy,et al.  Semiotic schemas: A framework for grounding language in action and perception , 2005, Artif. Intell..

[22]  Stephen M. Kosslyn,et al.  Roles of imagery in perception: Or, there is no such thing as immaculate perception , 1995 .

[23]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[24]  A. Damasio Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[25]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[26]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[27]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[28]  Mortimer J. Adler,et al.  The Summa Theologica , 2009 .

[29]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[30]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[31]  Joachim Hoffmann,et al.  Anticipatory Behavioral Control , 2003, ABiALS.

[32]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[33]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[34]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[35]  Lawrence W Barsalou,et al.  Abstraction in perceptual symbol systems. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[36]  Cristiano Castelfranchi,et al.  Guarantees for Autonomy in Cognitive Agent Architecture , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[37]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[38]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[39]  Peter Gärdenfors,et al.  The evolution of anticipatory cognition as a precursor to symbolic communication , 2005 .

[40]  P. Gärdenfors Cooperation and the evolution of symbolic communication , 2004 .

[41]  G. Fricchione Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[42]  J. Adams,et al.  A closed-loop theory of motor learning. , 1971, Journal of motor behavior.

[43]  I. Kant,et al.  Critique of Pure Reason: Glossary , 1998 .

[44]  L. Barsalou,et al.  Ad hoc categories , 1983, Memory & cognition.

[45]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[46]  J. Kalaska,et al.  Common codes for situated interaction , 2001 .

[47]  Martin V. Butz,et al.  An Analysis of the Ideomotor Principle and TOTE , 2006 .

[48]  A. Clark,et al.  The Extended Mind , 1998, Analysis.

[49]  A. Damasio Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[50]  J. Piaget The construction of reality in the child , 1954 .

[51]  Heiko Homann,et al.  Perception through Visuomotor Anticipation in a Mobile Robot , 2006 .

[52]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[53]  H. L. Roitblat,et al.  Codes and coding processes in pigeon short-term memory , 1980 .

[54]  Martin V. Butz,et al.  Anticipatory Behavior in Adaptive Learning Systems , 2003, Lecture Notes in Computer Science.

[55]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[56]  Jean Decety,et al.  When the self represents the other: A new cognitive neuroscience view on psychological identification , 2003, Consciousness and Cognition.

[57]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[58]  Mark H. Bickhard,et al.  Function, anticipation, representation , 2001 .

[59]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[60]  V. Gallese The ‘‘shared manifold’’ hypothesis: from mirror neurons to empathy , 2001 .

[61]  Stevan Harnad The Symbol Grounding Problem , 1999, ArXiv.

[62]  Olivier Sigaud,et al.  Anticipatory Behavior in Adaptive Learning Systems: Foundations, Theories, and Systems , 2003 .

[63]  The Inner Sense of Action , 2000 .

[64]  Aaron Sloman,et al.  The Altricial-Precocial Spectrum for Robots , 2005, IJCAI.

[65]  Cristiano Castelfranchi,et al.  The role of beliefs in goal dynamics: prolegomena to a constructive theory of intentions , 2007, Synthese.

[66]  Giovanni Pezzulo,et al.  A Schema Based Model of the Praying Mantis , 2006, SAB.

[67]  Thomas Metzinger,et al.  Motor ontology: the representational reality of goals, actions and selves , 2003 .

[68]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[69]  M. Graziano,et al.  Effects of auditory and visual interference on auditory-visual delayed matching to sample in monkeys (Macaca fascicularis). , 1994, Behavioral neuroscience.

[70]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[71]  J. Hoffmann,et al.  Anticipated Action Effects Affect the Selection, Initiation, and Execution of Actions , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[72]  Charles Taylor WHAT IS INVOLVED IN A GENETIC PSYCHOLOGY , 1971 .

[73]  J. Decety Do imagined and executed actions share the same neural substrate? , 1996, Brain research. Cognitive brain research.

[74]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[75]  Gebhard Kirchgässner Alles Leben ist Problemlösen , 2002 .

[76]  Martin V. Butz,et al.  Anticipations Control Behavior: Animal Behavior in an Anticipatory Learning Classifier System , 2002, Adapt. Behav..

[77]  A. Glenberg,et al.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[78]  N. Wiener,et al.  Behavior, Purpose and Teleology , 1943, Philosophy of Science.

[79]  I. Kant,et al.  Critique of Pure Reason: Remark to the amphiboly of concepts of reflection , 1998 .

[80]  D. Wolpert,et al.  Explaining the symptoms of schizophrenia: Abnormalities in the awareness of action , 2000, Brain Research Reviews.

[81]  K. Popper,et al.  Alles Leben ist Problemlösen : über Erkenntnis, Geschichte und Politik , 1994 .

[82]  V. J. McGill,et al.  Cognitive Development and Epistemology , 1971 .

[83]  V. Gallese The 'shared manifold' hypothesis: From mirror neurons to empathy. , 2001 .

[84]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[85]  Brian Cantwell Smith,et al.  On the origin of objects , 1997, Trends in Cognitive Sciences.

[86]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[87]  S. Hurley Active perception and perceiving action : The Shared Circuits Hypothesis , 2004 .

[88]  Cristiano Castelfranchi Mind as an Anticipatory Device: For a Theory of Expectations , 2005, BVAI.