Stimulus dependent habituation in a bottom - up brain inspired model of learning and memory

This paper explores how stimulus-dependent habituation can be integrated to modulate a cognitively inspired bottom up learning model of semantic representation. We first describe the equations governing habituation and associative habituation and describe how to integrate it to a bottom up hierarchical habituation model. Habituation is used to modulate the weights between the parent and children in the hierarchy. We investigate the behavior of habituation in the hierarchy, the properties of habituation and recovery in the model and show that while habituation has no detrimental effect on clustering, it reduces the number of neurons required for representation and therefore propose it as an important component of cognitively inspired memory systems.

[1]  G. Weissmann.  In Search of Memory: The Emergence Of a New Science of Mind. , 2006, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[2]  Stephen Marsland,et al.  Using habituation in machine learning , 2009, Neurobiology of Learning and Memory.

[3]  Luping Shi,et al.  Artificial cognitive memory—changing from density driven to functionality driven , 2011 .

[4]  C. Balkenius.  Attention, habituation and conditioning: toward a computational model , 2000 .

[5]  Tow Chong Chong,et al.  A Hubel Weisel model for hierarchical representation of concepts in textual documents , 2010 .

[6]  Douglas A. Baxter,et al.  Short-term plasticity in a computational model of the tail-withdrawal circuit in Aplysia , 2007, Neurocomputing.

[7]  Denis Mareschal,et al.  Models of habituation in infancy , 2002, Trends in Cognitive Sciences.

[8]  S. Rauch,et al.  Differential prefrontal cortex and amygdala habituation to repeatedly presented emotional stimuli , 2001, Neuroreport.

[9]  E. N. Sokolov.  Higher nervous functions; the orienting reflex. , 1963, Annual review of physiology.

[10]  DeLiang Wang,et al.  A Neural Model of Synaptic Plasticity Underlying Short-term and Long-term Habituation , 1993, Adapt. Behav..

[11]  R. F. Thompson,et al.  Habituation: a model phenomenon for the study of neuronal substrates of behavior. , 1966, Psychological review.

[12]  E. Kandel.  The Molecular Biology of Memory Storage: A Dialogue Between Genes and Synapses , 2001, Science.

[13]  Romain Brette,et al.  Spike-Timing-Based Computation in Sound Localization , 2010, PLoS Comput. Biol..

[14]  Kiruthika Ramanathan,et al.  Utilizing Hubel Wiesel models for semantic associations and topics extraction from unstructured text , 2011, The 2011 International Joint Conference on Neural Networks.

[15]  Donald A. Wilson,et al.  Habituation revisited: An updated and revised description of the behavioral characteristics of habituation , 2009, Neurobiology of Learning and Memory.

[16]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[17]  Kiruthika Ramanathan,et al.  A Hubel Wiesel model of early concept generalization based on local correlation of input features , 2011, The 2011 International Joint Conference on Neural Networks.

[18]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[19]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[20]  Michael A. Arbib,et al.  Modeling the dishabituation hierarchy: The role of the primordial hippocampus , 1992, Biological Cybernetics.

[21]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[22]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[23]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[24]  Luping Shi,et al.  Presynaptic Learning and Memory with a Persistent Firing Neuron and a Habituating Synapse: a Model of Short Term Persistent Habituation , 2012, Int. J. Neural Syst..