Modelling memory functions with recurrent neural networks consisting of input compensation units: II. Dynamic situations

Modelling the cognitive abilities of humans or animals or building agents that are supposed to behave cognitively requires modelling a memory system that is able to store and retrieve various contents. The content to be stored is assumed to comprise information about more or less invariant environmental objects as well as information about movements. A combination of information about both objects and movements may be called a situation model. Here we focus, in part, on models storing dynamic patterns. In particular, two abilities of humans in representing dynamical systems receive special focus: the capability of representing the acceleration of objects, as can be found in the movement of a pendulum or freely falling objects, and the capability of representing actions of transfer, i.e. motion from one point to another, have been modelled using recurrent networks consisting of input compensation units. In addition, possibilities of combining static and dynamic properties within a single model are studied.

[1]  L. Steels.  The Biology and Technology of Intelligent Autonomous Agents , 1995, NATO ASI Series.

[2]  Gary F. Marcus,et al.  German Inflection: The Exception That Proves the Rule , 1995, Cognitive Psychology.

[3]  Javier R. Movellan,et al.  Contrastive Hebbian Learning in the Continuous Hopfield Model , 1991 .

[4]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[5]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[6]  Jane S. Paulsen.  Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate , 1996 .

[7]  J. Feldman,et al.  Embodied meaning in a neural theory of language , 2004, Brain and Language.

[8]  J. Fuster.  Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[9]  Charles J. Fillmore,et al.  The Mechanisms of “Construction Grammar” , 1988 .

[10]  R. Nicoll,et al.  Ca2+ Signaling Requirements for Long-Term Depression in the Hippocampus , 1996, Neuron.

[11]  H Niki,et al.  Prefrontal unit activity during delayed alternation in the monkey. II. Relation to absolute versus relative direction of response. , 1974, Brain research.

[12]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[13]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[14]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[15]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[16]  H Niki,et al.  Prefrontal unit activity during delayed alternation in the monkey. I. Relation to direction of response. , 1974, Brain research.

[17]  M. Bear,et al.  Common forms of synaptic plasticity in the hippocampus and neocortex in vitro. , 1993, Science.

[18]  Rebecca Fincher-Kiefer,et al.  Perceptual components of situation models , 2001, Memory & cognition.

[19]  B. Eckardt.  What Is Cognitive Science , 1992 .

[20]  Maninder K. Kahlon,et al.  Visual Motion Analysis for Pursuit Eye Movements in Area MT of Macaque Monkeys , 1999, The Journal of Neuroscience.

[21]  P. D. Giudice,et al.  Modelling the formation of working memory with networks of integrate-and-fire neurons connected by plastic synapses , 2003, Journal of Physiology-Paris.

[22]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[23]  Bartlett W. Mel.  Why Have Dendrites? A Computational Perspective , 1999 .

[24]  Y. Miyashita,et al.  Neural representation of visual objects: encoding and top-down activation , 2000, Current Opinion in Neurobiology.

[25]  J. Lisman,et al.  A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Holk Cruse,et al.  Modelling memory functions with recurrent neural networks consisting of input compensation units: I. Static situations , 2007, Biological Cybernetics.

[27]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[28]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[29]  Letitia R. Naigles,et al.  Learnability and Cognition: The Acquisition of Argument Structure , 1991 .

[30]  Ronald J. Williams,et al.  Experimental Analysis of the Real-time Recurrent Learning Algorithm , 1989 .

[31]  Arthur M. Glenberg,et al.  Indexical understanding of instructions , 1999 .

[32]  D. Premack.  Is Language the Key to Human Intelligence? , 2004, Science.

[33]  M. Srinivasan,et al.  The concepts of ‘sameness’ and ‘difference’ in an insect , 2001, Nature.

[34]  L. Steels.  Intelligence — Dynamics and Representations , 1995 .

[35]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[36]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[37]  Holk Cruse,et al.  A holistic model for an internal representation to control the movement of a manipulator with redundant degrees of freedom , 1998, Biological Cybernetics.

[38]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[39]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[40]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[41]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[42]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[43]  A. Grafstein.  MIT Encyclopedia of the Cognitive Sciences , 2000 .

[44]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[45]  Angelo Cangelosi,et al.  The Sensorimotor Bases of Linguistic Structure : Experiments with Grounded Adaptive Agents , 2004 .

[46]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[47]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[48]  Luc Steels,et al.  Simulating the evolution of a grammar for case , 2002 .

[49]  Morris Halle,et al.  The rules of language , 1980, IEEE Transactions on Professional Communication.

[50]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[51]  N. Kanwisher,et al.  Activation in Human MT/MST by Static Images with Implied Motion , 2000, Journal of Cognitive Neuroscience.

[52]  R. Wodak.  Strategies in text production and text comprehension: A new perspective , 1992 .

[53]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[54]  Aude Billard,et al.  The Sensorimotor Bases of Linguistic Structure: Experiments with Grounded Adaptive Agents , 2004 .

[55]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[56]  A. Glenberg,et al.  Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning , 2000 .

[57]  Karl Theodor Kalveram,et al.  Sensorimotor Sequential Learning by a Neural Network Based on Redefined Hebbian Learning , 2000, ANNIMAB.

[58]  D. Amit.  The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[59]  Holk Cruse.  Feeling our body - the basis of cognition? , 1999 .

[60]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[61]  Jürgen Schmidhuber,et al.  A Fixed Size Storage O(n3) Time Complexity Learning Algorithm for Fully Recurrent Continually Running Networks , 1992, Neural Computation.

[62]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[63]  E. Hairer,et al.  Geometric Numerical Integration: Structure Preserving Algorithms for Ordinary Differential Equations , 2004 .

[64]  Letitia R. Naigles,et al.  Motion-Verb Generalizations in English and Spanish: Influences of Language and Syntax , 1998 .

[65]  Pierre Baldi,et al.  Contrastive Learning and Neural Oscillations , 1991, Neural Computation.

[66]  Michael P. Kaschak,et al.  Constructing Meaning: The Role of Affordances and Grammatical Constructions in Sentence Comprehension , 2000 .

[67]  F. Helmchen.  Dendrites as biochemical compartments , 1999 .

[68]  Holk Cruse,et al.  Static mental representations in recurrent neural networks for the control of dynamic behavioural sequences , 2005, Connect. Sci..

[69]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[70]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[71]  Xiaohui Xie,et al.  Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network , 2003, Neural Computation.

[72]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[73]  Holk Cruse,et al.  The evolution of cognition - a hypothesis , 2003, Cogn. Sci..

[74]  G. Marcus.  The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[75]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[76]  Holk Cruse,et al.  Neural networks as cybernetic systems , 1996 .

[77]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[78]  John F. Sowa,et al.  Principles of semantic networks , 1991 .

[79]  Cynthia L Fisher,et al.  Structure and meaning in the verb lexicon: Input for a syntax-aided verb learning procedure , 1994 .

[80]  J. Elman,et al.  Networks are not ‘hidden rules’ , 1999, Trends in Cognitive Sciences.

[81]  Srinivas Narayanan,et al.  Moving Right Along: A Computational Model of Metaphoric Reasoning about Events , 1999, AAAI/IAAI.

[82]  J T Todd,et al.  Visual information about moving objects. , 1981, Journal of experimental psychology. Human perception and performance.

[83]  F. Lacquaniti,et al.  Representation of Visual Gravitational Motion in the Human Vestibular Cortex , 2005, Science.

[84]  Jennifer J. Freyd,et al.  Five hunches about perceptual processes and dynamic representations , 1993 .

[85]  J. Stevenson.  The cultural origins of human cognition , 2001 .

[86]  Anne-Marie Brouwer,et al.  Perception of acceleration with short presentation times: Can acceleration be used in interception? , 2001, Perception & psychophysics.

[87]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[88]  D. Zipser,et al.  A spiking network model of short-term active memory , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[89]  Martin Faint,et al.  Does the brain model newton’s laws? , 2001 .

[90]  J. Montgomery,et al.  Discrete synaptic states define a major mechanism of synapse plasticity , 2004, Trends in Neurosciences.

[91]  J. Freyd,et al.  A velocity effect for representational momentum , 1985 .

[92]  Rudolf Kruse,et al.  Neuronale Netze und Fuzzy-Systeme , 1994 .

[93]  Xiao-Jing Wang.  Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[94]  Rolf A. Zwaan,et al.  Moving words: dynamic representations in language comprehension , 2004 .

[95]  A. Goldberg.  Constructions: A Construction Grammar Approach to Argument Structure , 1995 .

[96]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[97]  Jochen J. Steil,et al.  Input output stability of recurrent neural networks , 1999 .

[98]  G. Rizzolatti,et al.  I Know What You Are Doing A Neurophysiological Study , 2001, Neuron.

[99]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[100]  A. C. Greenwood,et al.  Bidirectional synaptic plasticity correlated with the magnitude of dendritic calcium transients above a threshold. , 2001, Journal of neurophysiology.

[101]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[102]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[103]  R. Strauss,et al.  Persistence of orientation toward a temporarily invisible landmark in Drosophila melanogaster , 1998, Journal of Comparative Physiology A.