Developing Dynamic Field Theory Architectures for Embodied Cognitive Systems with cedar

Embodied artificial cognitive systems, such as autonomous robots or intelligent observers, connect cognitive processes to sensory and effector systems in real time. Prime candidates for such embodied intelligence are neurally inspired architectures. While components such as forward neural networks are well established, designing pervasively autonomous neural architectures remains a challenge. This includes the problem of tuning the parameters of such architectures so that they deliver specified functionality under variable environmental conditions and retain these functions as the architectures are expanded. The scaling and autonomy problems are solved, in part, by dynamic field theory (DFT), a theoretical framework for the neural grounding of sensorimotor and cognitive processes. In this paper, we address how to efficiently build DFT architectures that control embodied agents and how to tune their parameters so that the desired cognitive functions emerge while such agents are situated in real environments. In DFT architectures, dynamic neural fields or nodes are assigned dynamic regimes, that is, attractor states and their instabilities, from which cognitive function emerges. Tuning thus amounts to determining values of the dynamic parameters for which the components of a DFT architecture are in the specified dynamic regime under the appropriate environmental conditions. The process of tuning is facilitated by the software framework cedar, which provides a graphical interface to build and execute DFT architectures. It enables to change dynamic parameters online and visualize the activation states of any component while the agent is receiving sensory inputs in real time. Using a simple example, we take the reader through the workflow of conceiving of DFT architectures, implementing them on embodied agents, tuning their parameters, and assessing performance while the system is coupled to real sensory inputs.

[1]  De Vries Book review: R.C. O'Reilly and Y. Munakata: Computational explorations in cognitive neuroscience: understanding the mind by stimulating the brain. Cambridge, Mass: The MIT Press. , 2002 .

[2]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[3]  Olivier Michel,et al.  Cyberbotics Ltd. Webots™: Professional Mobile Robot Simulation , 2004 .

[4]  Yulia Sandamirskaya,et al.  Learning to Look and Looking to Remember: A Neural-Dynamic Embodied Model for Generation of Saccadic Gaze Shifts and Memory Formation , 2015 .

[5]  Gregor Schöner,et al.  A Neural Dynamic Architecture Resolves Phrases about Spatial Relations in Visual Scenes , 2014, ICANN.

[6]  Dominique Martinez,et al.  Effectiveness and Robustness of Robot Infotaxis for Searching in Dilute Conditions , 2010, Front. Neurorobot..

[7]  John R. Anderson ACT: A simple theory of complex cognition. , 1996 .

[8]  Gregor Schöner,et al.  Parsing of action sequences: A neural dynamics approach , 2015, Paladyn J. Behav. Robotics.

[9]  Darwin G. Caldwell,et al.  Reinforcement Learning in Robotics: Applications and Real-World Challenges , 2013, Robotics.

[10]  Gregor Schöner,et al.  Dynamic Thinking : A Primer on Dynamic Field Theory , 2015 .

[11]  Gregor Schöner,et al.  A neural mechanism for coordinate transformation predicts pre-saccadic remapping , 2012, Biological Cybernetics.

[12]  G. Schöner,et al.  Dynamic instabilities as mechanisms for emergence. , 2007, Developmental science.

[13]  Dietmar Heinke,et al.  Choice reaching with a LEGO arm robot (CoRLEGO): The motor system guides visual attention to movement-relevant information , 2015, Neural Networks.

[14]  Gregor Schöner,et al.  Autonomous Neural Dynamics to Test Hypotheses in a Model of Spatial Language , 2014, CogSci.

[15]  Estela Bicho,et al.  Integrating Verbal and Nonverbal Communication in a Dynamic Neural Field Architecture for Human–Robot Interaction , 2010, Front. Neurorobot..

[16]  Stephan K. U. Zibner,et al.  Dynamic Scene Representations and Autonomous Robotics , 2015 .

[17]  Estela Bicho,et al.  Embodied Neural Dynamics , 2015 .

[18]  Gregor Schöner,et al.  A robotic architecture for action selection and behavioral organization inspired by human cognition , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  A. Cañada,et al.  Handbook of differential equations , 2004 .

[20]  John R. Anderson,et al.  SAL: an explicitly pluralistic cognitive architecture , 2008, J. Exp. Theor. Artif. Intell..

[21]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[22]  Brian Mingus,et al.  The Emergent neural modeling system , 2008, Neural Networks.

[23]  Stephan K. U. Zibner,et al.  A neural dynamics architecture for grasping that integrates perception and movement generation and enables on-line updating , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Gregor Schöner,et al.  Saccadic motor planning by integrating visual information and pre-information on neural dynamic fields , 1995, Biological Cybernetics.

[25]  Terrence C. Stewart,et al.  Neuroinformatics Original Research Article Python Scripting in the Nengo Simulator , 2022 .

[26]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[27]  Yulia Sandamirskaya,et al.  Dynamic neural fields as a step toward cognitive neuromorphic architectures , 2014, Front. Neurosci..

[28]  Olivier Michel,et al.  Cyberbotics Ltd. Webots™: Professional Mobile Robot Simulation , 2004, ArXiv.

[29]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[30]  Stephan K. U. Zibner,et al.  Making a robotic scene representation accessible to feature and label queries , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[31]  Jan Tekülve,et al.  The neural dynamics of goal-directed arm movements: A developmental perspective , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[32]  J. G. Taylor,et al.  Neural ‘bubble’ dynamics in two dimensions: foundations , 1999, Biological Cybernetics.

[33]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[34]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[35]  G. Schöner The Cambridge Handbook of Computational Psychology: Dynamical Systems Approaches to Cognition , 2008 .

[36]  E. Thelen,et al.  Using dynamic field theory to rethink infant habituation. , 2006, Psychological review.

[37]  J. Hopfield Brain, neural networks, and computation , 1999 .

[38]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[39]  Stephan K. U. Zibner,et al.  A Software Framework for Cognition, Embodiment, Dynamics, and Autonomy in Robotics: Cedar , 2013, ICANN.

[40]  G. Schöner,et al.  Dynamic Field Theory of Movement Preparation , 2022 .

[41]  K. Fernow New York , 1896, American Potato Journal.

[42]  Henrik Schiøler,et al.  Sociable Robots Through Self-Maintained Energy , 2006 .

[43]  Chris Eliasmith,et al.  How to Build a Brain: A Neural Architecture for Biological Cognition , 2013 .

[44]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[45]  Gregor Schöner,et al.  A neural-dynamic architecture for behavioral organization of an embodied agent , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[46]  Estela Bicho,et al.  Off-line simulation inspires insight: A neurodynamics approach to efficient robot task learning , 2015, Neural Networks.

[47]  Vladimir Igorevich Arnold,et al.  Geometrical Methods in the Theory of Ordinary Differential Equations , 1983 .

[48]  Stephan K. U. Zibner,et al.  Dynamic Neural Fields as Building Blocks of a Cortex-Inspired Architecture for Robotic Scene Representation , 2011, IEEE Transactions on Autonomous Mental Development.

[49]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .