The Origin of Epistemic Structures and Proto-Representations

Organisms across species use the strategy of generating structures in their environment to lower cognitive complexity. Examples include pheromones, markers, color codes, etc. We provide a model of how such structures originate, and present a simulation where organisms with only reactive behavior learn, within their lifetime, to add such structures to their world to lower cognitive load. This implementation is then extended to show that the same underlying process could generate internal traces of the world (memories) in an internal environment. This model provides a novel account of the origin of internal representations. Further, as both external and internal traces are generated using the same mechanism, the model shows how an extended mind could be implemented. Also, as the stored internal traces develop entirely out of actions, these action components could be activated implicitly. This feature explains the origin of enactable and action-oriented mental content, suggested by recent experiments.

[1]  Tom Ziemke,et al.  Social cognition, artefacts, and stigmergy: A comparative analysis of theoretical frameworks for the understanding of artefact-mediated collaborative activity , 2001, Cognitive Systems Research.

[2]  T. Metzinger,et al.  The emergence of a shared action ontology: Building blocks for a theory , 2003, Consciousness and Cognition.

[3]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[4]  Jason D. Warren,et al.  The Oxford Companion to the Mind , 2005 .

[5]  P. Richerson,et al.  Why Culture is Common, but Cultural Evolution is Rare , 1996 .

[6]  Jonathan D. Cohen,et al.  On the Control of Control: The Role of Dopamine in Regulating Prefrontal Function and Working Memory , 2007 .

[7]  Jack W. Bradbury,et al.  Principles of Animal Communication , 1998 .

[8]  Ruth Garrett Millikan,et al.  White Queen Psychology and Other Essays for Alice. , 1984 .

[9]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[10]  E. Tulving Elements of episodic memory , 1983 .

[11]  M. Martin White Queen Psychology and Other Essays for Alice , 1995 .

[12]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[13]  Stefano Nolfi,et al.  Self-Organization of Modules and Their Hierarchy in Robot Learning Problems: A Dynamical Systems App , 1997 .

[14]  Tom Ziemke,et al.  Evolving cognitive scaffolding and environment adaptation: a new research direction for evolutionary robotics , 2004, Connect. Sci..

[15]  W. Tuckwell,et al.  The Honey Bee , 1891, Nature.

[16]  Seth Bullock,et al.  Simple Heuristics That Make Us Smart , 1999 .

[17]  E. Hutchins Cognition in the wild , 1995 .

[18]  Sanjay Chandrasekharan,et al.  Reactive Agents Learn to Add Epistemic Structures to the World , 2004 .

[19]  Peter Godfrey-Smith,et al.  Précis of Complexity and the Function of Mind in Nature , 1996, Adapt. Behav..

[20]  Bruno Galantucci,et al.  An Experimental Study of the Emergence of Human Communication Systems , 2005, Cogn. Sci..

[21]  Andy Clark The Presence of a Symbol , 1992 .

[22]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[23]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[24]  Edwin Hutchins,et al.  How a Cockpit Remembers Its Speeds , 1995, Cogn. Sci..

[25]  Simon Kirby,et al.  Natural Language From Artificial Life , 2002, Artificial Life.

[26]  Paul Smolensky,et al.  Connectionist modeling: Neural computation/mental connections. , 1989 .

[27]  J. L. Gould Honey bee cognition , 1990, Cognition.

[28]  Andy Clark,et al.  Doing without representing? , 1994, Synthese.

[29]  D. Dennett Why the Law of Effect will not Go Away , 1975 .

[30]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[31]  Stephen Roberts,et al.  Positional entropy during pigeon homing II: navigational interpretation of Bayesian latent state models. , 2004, Journal of theoretical biology.

[32]  H. Rheinberger Toward a History of Epistemic Things: Synthesizing Proteins in the Test Tube , 1997 .

[33]  A. Dickinson,et al.  Episodic memory: what can animals remember about their past? , 1999, Trends in Cognitive Sciences.

[34]  Moshe Sipper,et al.  On the Origin of Environments by Means of Natural Selection , 2001, AI Mag..

[35]  J D Henry,et al.  The use of urine marking in the scavenging behavior of the red fox (Vulpes vulpes). , 1977, Behaviour.

[36]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[37]  R. Robinson The Red Fox, Vulpes vulpes , 1975 .

[38]  David Kirsh,et al.  Adapting the Environment Instead of Oneself , 2022 .

[39]  R Wehner,et al.  Path integration in desert ants, Cataglyphis fortis. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[40]  T. Ziemke,et al.  Making sense of embodiment : simulation theories and the sharing of neural circuitry , 2004 .

[41]  S Hurley,et al.  Perspectives on Imitation , 2004 .

[42]  Scott Camazine,et al.  Self-organizing pattern formation on the combs of honey bee colonies , 2004, Behavioral Ecology and Sociobiology.

[43]  T. Stewart Extrema selection: accelerated evolution on neutral networks , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[44]  L. Barsalou Situated simulation in the human conceptual system , 2003 .

[45]  Two Cognitive Descriptions of Q-Learning 1 , 2005 .

[46]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[47]  S Hurley,et al.  Perspectives on imitation: From neuroscience to social science. Imitation, human development and culture. , 2005 .

[48]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[49]  A. Clark,et al.  The Extended Mind , 1998, Analysis.

[50]  S. Stich,et al.  Mental representation : a reader , 1994 .

[51]  Shweta Narayan,et al.  Simulated Action in an Embodied Construction Grammar , 2004 .

[52]  M. Feldman,et al.  Niche construction, biological evolution, and cultural change , 2000, Behavioral and Brain Sciences.

[53]  K. Sterelny Cognitive Load and Human Decision, or, Three Ways of Rolling the Rock Up Hill , 2003 .

[54]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[55]  Guido C. H. E. de Croon,et al.  Macroscopic analysis of robot foraging behaviour , 2004, Connect. Sci..

[56]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[57]  R. L. Gregory The Oxford companion to the mind , 1989 .

[58]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[59]  Epistemic Structure : How Agents Change the World for Cognitive Congeniality , 2004 .

[60]  Vittorio Gallese,et al.  The eyes, the hand, and the mind: behavioral and neurophysiological aspects of social cognition , 2001 .

[61]  Tom Ziemke,et al.  Brains, Bodies, and Beyond: Competitive Co-Evolution of Robot Controllers, Morphologies and Environments , 2005, Genetic Programming and Evolvable Machines.

[62]  M. Brass,et al.  Imitation: is cognitive neuroscience solving the correspondence problem? , 2005, Trends in Cognitive Sciences.

[63]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[64]  M. Bacharach,et al.  Trust in signs. , 2001 .

[65]  A. Tversky,et al.  The simulation heuristic , 1982 .

[66]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  Ruth Garrett Millikan,et al.  Pushmi-Pullyu Representations , 1995 .

[68]  Prof. Dr. Eberhard Curio The Ethology of Predation , 1976, Zoophysiology and Ecology.

[69]  S. Stich,et al.  The Varieties of Off-Line Simulation , 1996 .

[70]  Joseph P. Huston,et al.  Wistar rats show episodic-like memory for unique experiences , 2006, Neurobiology of Learning and Memory.

[71]  Anil K. Seth,et al.  Agent-based modelling and the environmental complexity thesis , 2002 .

[72]  Thomas T. Hills Animal Foraging and the Evolution of Goal-Directed Cognition , 2006, Cogn. Sci..

[73]  F. J. Odling-Smee,et al.  Niche Construction: The Neglected Process in Evolution , 2003 .

[74]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[75]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[76]  W. Schultz Activity of dopamine neurons in the behaving primate , 1992 .

[77]  C. Heyes,et al.  Experience modulates automatic imitation. , 2005, Brain research. Cognitive brain research.

[78]  Stefano Nolfi,et al.  Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems , 1998, Neural Networks.

[79]  Andy Clark,et al.  Selective Representing and World-making 1. What's in an Umwelt? , 2022 .

[80]  Amots Zehavi,et al.  The Handicap Principle: A Missing Piece of Darwin's Puzzle , 1997 .

[81]  Kim Sterelny,et al.  Made By Each Other: Organisms and Their Environment , 2005 .

[82]  P. Stopka,et al.  Way-marking behaviour: an aid to spatial navigation in the wood mouse (Apodemus sylvaticus) , 2003, BMC Ecology.

[83]  L. Steels,et al.  coordinating perceptually grounded categories through language: a case study for colour , 2005, Behavioral and Brain Sciences.

[84]  Leigh Tesfatsion,et al.  Agent-Based Computational Economics: Growing Economies From the Bottom Up , 2002, Artificial Life.