ReaCog, a Minimal Cognitive Controller Based on Recruitment of Reactive Systems

It has often been stated that for a neuronal system to become a cognitive one, it has to be large enough. In contrast, we argue that a basic property of a cognitive system, namely the ability to plan ahead, can already be fulfilled by small neuronal systems. As a proof of concept, we propose an artificial neural network, termed reaCog, that, first, is able to deal with a specific domain of behavior (six-legged-walking). Second, we show how a minor expansion of this system enables the system to plan ahead and deploy existing behavioral elements in novel contexts in order to solve current problems. To this end, the system invents new solutions that are not possible for the reactive network. Rather these solutions result from new combinations of given memory elements. This faculty does not rely on a dedicated system being more or less independent of the reactive basis, but results from exploitation of the reactive basis by recruiting the lower-level control structures in a way that motor planning becomes possible as an internal simulation relying on internal representation being grounded in embodied experiences.

[1]  Rodney A. Brooks,et al.  A robot that walks; emergent behaviors from a carefully evolved network , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[2]  Heiko Hoffmann,et al.  Perception through visuomotor anticipation in a mobile robot , 2007, Neural Networks.

[3]  A. Matzger Where's the Action? , 1971, California medicine.

[4]  Sarah T. Boysen,et al.  Comprehension of Cause-Effect Relations in a Tool-Using Task by Chimpanzees (Pan troglodytes) , 1995 .

[5]  Wlodzislaw Duch,et al.  Cognitive Architectures: Where do we go from here? , 2008, AGI.

[6]  T. Kindermann Behavior and Adaptability of a Six-Legged Walking System with Highly Distributed Control , 2001, Adapt. Behav..

[7]  Thierry Hoinville,et al.  A hexapod walker using a heterarchical architecture for action selection , 2013, Front. Comput. Neurosci..

[8]  Holk Cruse,et al.  No need for a body model: Positive velocity feedback for the control of an 18-DOF robot walker , 2008 .

[9]  Rolf A. Zwaan,et al.  Action in cognition: The case of language , 2009, Language and Cognition.

[10]  H. Cruse,et al.  Mental States as Emergent Properties: From Walking to Consciousness , 2014 .

[11]  Holk Cruse,et al.  How and to what end may consciousness contribute to action? Attributing properties of consciousness to an embodied, minimally cognitive artificial neural network , 2013, Front. Psychol..

[12]  Auke J. Ijspeert,et al.  Biorobotics: Using robots to emulate and investigate agile locomotion , 2014, Science.

[13]  H. Cruse What mechanisms coordinate leg movement in walking arthropods? , 1990, Trends in Neurosciences.

[14]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[15]  J. Fuster Memory in the cerebral cortex , 1994 .

[16]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[17]  Bettina Bläsing,et al.  Crossing Large Gaps: A Simulation Study of Stick Insect Behavior , 2006, Adapt. Behav..

[18]  H. Cruse,et al.  Behaviour-based modelling of hexapod locomotion: linking biology and technical application. , 2004, Arthropod structure & development.

[19]  Professor Dr. Ulrich Bässler Neural Basis of Elementary Behavior in Stick Insects , 1983, Studies of Brain Function.

[20]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[21]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[22]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[23]  P. Calvo,et al.  Handbook of cognitive science : an embodied approach , 2008 .

[24]  S. Hurley The shared circuits model (SCM): how control, mirroring, and simulation can enable imitation, deliberation, and mindreading. , 2008, The Behavioral and brain sciences.

[25]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[26]  Fred Keijzer,et al.  Principles of Minimal Cognition: Casting Cognition as Sensorimotor Coordination , 2006, Adapt. Behav..

[27]  Owen Holland,et al.  Architectures for functional imagination , 2009, Neurocomputing.

[28]  H. Maturana,et al.  Autopoiesis and Cognition : The Realization of the Living (Boston Studies in the Philosophy of Scie , 1980 .

[29]  André Frank Krause,et al.  The stick insect antenna as a biological paragon for an actively moved tactile probe for obstacle detection , 2001 .

[30]  Holk Cruse,et al.  What’s Next: Recruitment of a Grounded Predictive Body Model for Planning a Robot’s Actions , 2012, Front. Psychology.

[31]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[32]  P. Morasso,et al.  Kinematic networks , 1988, Biological Cybernetics.

[33]  Holk Cruse,et al.  The evolution of cognition - a hypothesis , 2003, Cogn. Sci..

[34]  Andreas Ritter,et al.  The Universe In A Nutshell , 2016 .

[35]  V. Dürr Context-dependent changes in strength and efficacy of leg coordination mechanisms , 2005, Journal of Experimental Biology.

[36]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[37]  Michael J. Spivey,et al.  Computational Grounded Cognition: a new alliance between grounded cognition and computational modeling , 2013, Front. Psychology.

[38]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[39]  Malte Schilling,et al.  Embodied posture verbs: Emergence of a vocabulary for describing postures , 2010 .

[40]  Tim Oates,et al.  The metacognitive loop I: Enhancing reinforcement learning with metacognitive monitoring and control for improved perturbation tolerance , 2006, J. Exp. Theor. Artif. Intell..

[41]  G. Carruthers Types of body representation and the sense of embodiment , 2008, Consciousness and Cognition.

[42]  Michael L. Anderson Neural reuse: A fundamental organizational principle of the brain , 2010, Behavioral and Brain Sciences.

[43]  J. Feldman,et al.  Embodied meaning in a neural theory of language , 2004, Brain and Language.

[44]  Malte Schilling,et al.  Universally manipulable body models—dual quaternion representations in layered and dynamic MMCs , 2011, Auton. Robots.

[45]  Paul F. M. J. Verschure,et al.  Environmentally mediated synergy between perception and behaviour in mobile robots , 2003, Nature.

[46]  Michael L. Anderson Embodied Cognition: A field guide , 2003, Artif. Intell..

[47]  Nolan Wagener,et al.  Learning contact-rich manipulation skills with guided policy search , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[48]  Margaret Wilson,et al.  How Did We Get from There to Here? An Evolutionary Perspective on Embodied Cognition , 2008 .

[49]  M. Shiffrar,et al.  Recognizing people from their movement. , 2005, Journal of experimental psychology. Human perception and performance.

[50]  H. Cruse,et al.  Stick insect locomotion in a complex environment: climbing over large gaps , 2004, Journal of Experimental Biology.

[51]  Maura Casadio,et al.  Revisiting the Body-Schema Concept in the Context of Whole-Body Postural-Focal Dynamics , 2015, Front. Hum. Neurosci..

[52]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[53]  L. Steels,et al.  coordinating perceptually grounded categories through language: a case study for colour , 2005, Behavioral and Brain Sciences.

[54]  D. McFarland,et al.  Intelligent behavior in animals and robots , 1993 .

[55]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[56]  A. Cangelosi,et al.  Developmental Robotics: From Babies to Robots , 2015 .

[57]  M. Jeannerod,et al.  Mental motor imagery: a window into the representational stages of action , 1995, Current Opinion in Neurobiology.

[58]  Malte Schilling,et al.  Obstacle crossing of a real, compliant robot based on local evasion movements and averaging of stance heights using singular value decomposition , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[59]  Holk Cruse,et al.  Hierarchical MMC Networks as a manipulable body model , 2007, 2007 International Joint Conference on Neural Networks.

[60]  Josef Schmitz,et al.  Biomechatronics for Embodied Intelligence of an Insectoid Robot , 2011, ICIRA.

[61]  Malte Schilling,et al.  Dynamic equations in MMC networks: Construction of a dynamic body model , 2009 .

[62]  P. König,et al.  Where's the action? The pragmatic turn in cognitive science , 2013, Trends in Cognitive Sciences.

[63]  J. G. Taylor,et al.  Vicarious trial and error. , 1951, Psychological review.

[64]  Ron Sun,et al.  Incubation, insight, and creative problem solving: a unified theory and a connectionist model. , 2010, Psychological review.

[65]  Thierry Hoinville,et al.  Walknet, a bio-inspired controller for hexapod walking , 2013, Biological Cybernetics.

[66]  Sir Frederic Bartlett Schema Theory , 2017 .

[67]  B. Webb Neural mechanisms for prediction: do insects have forward models? , 2004, Trends in Neurosciences.

[68]  J. Changeux,et al.  Experimental and Theoretical Approaches to Conscious Processing , 2011, Neuron.

[69]  Pattie Maes,et al.  A bottom-up mechanism for behavior selection in an artificial creature , 1991 .

[70]  Giovanni Pezzulo,et al.  Mental imagery in the navigation domain: a computational model of sensory-motor simulation mechanisms , 2013, Adapt. Behav..

[71]  Paul F. M. J. Verschure,et al.  A real-world rational agent: unifying old and new AI , 2003, Cogn. Sci..

[72]  Friedemann Pulvermüller,et al.  From sensorimotor learning to memory cells in prefrontal and temporal association cortex: A neurocomputational study of disembodiment , 2014, Cortex.

[73]  Bernard J. Baars,et al.  An architectural model of conscious and unconscious brain functions: Global Workspace Theory and IDA , 2007, Neural Networks.

[74]  G. Reeke The society of mind , 1991 .

[75]  R. Sun,et al.  The interaction of the explicit and the implicit in skill learning: a dual-process approach. , 2005, Psychological review.

[76]  John E. Laird,et al.  Extending the Soar Cognitive Architecture , 2008, AGI.

[77]  Antoine Cully,et al.  Robots that can adapt like animals , 2014, Nature.

[78]  Jean-Baptiste Mouret,et al.  Illuminating search spaces by mapping elites , 2015, ArXiv.

[79]  Holk Cruse,et al.  The Evolution of Cognition - From First Order to Second Order Embodiment , 2006, ZiF Workshop.

[80]  V. Dürr,et al.  The behavioural transition from straight to curve walking: kinetics of leg movement parameters and the initiation of turning , 2005, Journal of Experimental Biology.

[81]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[82]  F. Vignemont Body schema and body image—Pros and cons , 2010, Neuropsychologia.

[83]  G. Rizzolatti The mirror neuron system and its function in humans , 2005, Anatomy and Embryology.

[84]  Srini Narayanan,et al.  Communicating with Executable Action Representations , 2013, AAAI Spring Symposium: Designing Intelligent Robots.

[85]  Srinivas Narayanan,et al.  Reasoning About Actions in Narrative Understanding , 1999, IJCAI.

[86]  Thomas Metzinger,et al.  First-Order Embodiment, Second-Order Embodiment, Third-Order Embodiment , 2014 .

[87]  H. Cruse,et al.  Control of swing movement: influences of differently shaped substrate , 2006, Journal of Comparative Physiology A.

[88]  Holk Cruse,et al.  Hexapod Walking: an expansion to Walknet dealing with leg amputations and force oscillations , 2007, Biological Cybernetics.

[89]  A. Ijspeert Ijspeert locomotion Biorobotics : Using robots to emulate and investigate agile , 2014 .

[90]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[91]  Tom Ziemke,et al.  Representation as Internal Simulation: A Minimalistic Robotic Model , 2009 .

[92]  Andrea C. Schalley,et al.  Mental categories in natural languages , 2007 .

[93]  A. Glenberg,et al.  Action-based language: A theory of language acquisition, comprehension, and production , 2012, Cortex.

[94]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[95]  Pat Langley,et al.  Cognitive architectures: Research issues and challenges , 2009, Cognitive Systems Research.

[96]  G. Rizzolatti,et al.  Evolution of human cortical circuits for reading and arithmetic : The “ neuronal recycling ” hypothesis , 2004 .

[97]  Holk Cruse,et al.  Grounding an internal body model of a hexapod walker control of curve walking in a biologically inspired robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[98]  S. Kosslyn,et al.  Mental imagery , 2013, Front. Psychol..

[99]  U. Bässler,et al.  Pattern generation for stick insect walking movements—multisensory control of a locomotor program , 1998, Brain Research Reviews.

[100]  Jeffrey L. Krichmar,et al.  A neural approach to adaptive behavior and multi-sensor action selection in a mobile device , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[101]  R. Menzel,et al.  Cognition in Invertebrates , 2007 .

[102]  V. Dürr,et al.  Active tactile exploration for adaptive locomotion in the stick insect , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[103]  H. Ehrsson,et al.  Behavioural Brain Research , 1999 .

[104]  L. Steels Intelligence with representation , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[105]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[106]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[107]  Wolfram Schenck,et al.  Bootstrapping Cognition from Behavior - A Computerized Thought Experiment , 2008, Cogn. Sci..

[108]  Samuel Wintermute,et al.  Imagery in cognitive architecture: Representation and control at multiple levels of abstraction , 2012, Cognitive Systems Research.

[109]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[110]  G. Edelman Neural Darwinism: Selection and reentrant signaling in higher brain function , 1993, Neuron.