Habituation: a non-associative learning rule design for spiking neurons and an autonomous mobile robots implementation

This paper presents a novel bio-inspired habituation function for robots under control by an artificial spiking neural network. This non-associative learning rule is modelled at the synaptic level and validated through robotic behaviours in reaction to different stimuli patterns in a dynamical virtual 3D world. Habituation is minimally represented to show an attenuated response after exposure to and perception of persistent external stimuli. Based on current neurosciences research, the originality of this rule includes modulated response to variable frequencies of the captured stimuli. Filtering out repetitive data from the natural habituation mechanism has been demonstrated to be a key factor in the attention phenomenon, and inserting such a rule operating at multiple temporal dimensions of stimuli increases a robot's adaptive behaviours by ignoring broader contextual irrelevant information.

[1]  Pierre Poirier,et al.  AI-SIMCOG: a simulator for spiking neurons and multiple animats’ behaviours , 2009, Neural Computing and Applications.

[2]  S. A. Barnett.  Learning and instinct in animals. Second edition, revised and enlarged , 1963 .

[3]  Hierarchy of Habituation Induced by Mechanical Stimuli in Caenorhabditis elegans , 1999 .

[4]  Ricardo Gutierrez-Osuna,et al.  Habituation in the KIII olfactory model with chemical sensor arrays , 2003, IEEE Trans. Neural Networks.

[5]  Bernhard Sendhoff,et al.  Creating Brain-Like Intelligence: From Basic Principles to Complex Intelligent Systems , 2009, Creating Brain-Like Intelligence.

[6]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[7]  P. Balaban.  Cellular mechanisms of behavioral plasticity in terrestrial snail , 2002, Neuroscience & Biobehavioral Reviews.

[8]  Andrew C. Giles,et al.  Behavioral and genetic characterization of habituation using Caenorhabditis elegans , 2009, Neurobiology of Learning and Memory.

[9]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[10]  C. Rankin.  Context conditioning in habituation in the nematode Caenorhabditis elegans. , 2000, Behavioral neuroscience.

[11]  L F Abbott,et al.  A computational approach enhances learning in Aplysia , 2012, Nature Neuroscience.

[12]  Ron Chrisley,et al.  Embodied artificial intelligence , 2003, Artif. Intell..

[13]  Peter Kroes,et al.  Functions in biological and artificial worlds : comparative philosophical perspectives , 2009 .

[14]  M. Arbib,et al.  A model of the neural mechanisms responsible for pattern recognition and stimulus specific habituation in toads , 2004, Biological Cybernetics.

[15]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[16]  V. Bolivar,et al.  Habituation in rodents: A review of behavior, neurobiology, and genetics , 2006, Neuroscience & Biobehavioral Reviews.

[17]  J. Ewert,et al.  Configurational pattern discrimination responsible for dishabituation in common toads Bufo bufo (L.): Behavioral tests of the predictions of a neural model , 1992, Journal of Comparative Physiology A.

[18]  John E. R. Staddon,et al.  On Rate-Sensitive Habituation , 1993, Adapt. Behav..

[19]  E. D. Di Paolo.  Spike-Timing Dependent Plasticity for Evolved Robots , 2002 .

[20]  J. Staddon.  Interval timing: memory, not a clock , 2005, Trends in Cognitive Sciences.

[21]  L. Munari.  How the body shapes the way we think — a new view of intelligence , 2009 .

[22]  Thomas A Cleland,et al.  Distinct neural mechanisms mediate olfactory memory formation at different timescales. , 2008, Learning & memory.

[23]  Carolina Chang,et al.  Using sensor habituation in mobile robots to reduce oscillatory movements in narrow corridors , 2005, IEEE Transactions on Neural Networks.

[24]  John Johnston,et al.  The Allure of Machinic Life: Cybernetics, Artificial Life, and the New AI , 2008 .

[25]  D. Glanzman,et al.  Prolonged Habituation of the Gill-Withdrawal Reflex in Aplysia Depends on Protein Synthesis, Protein Phosphatase Activity, and Postsynaptic Glutamate Receptors , 2003, The Journal of Neuroscience.

[26]  Long Cheng,et al.  A behavior controller based on spiking neural networks for mobile robots , 2008, Neurocomputing.

[27]  John E. R. Staddon,et al.  What Should Comparative Psychology Compare? , 1989, International Journal of Comparative Psychology.

[28]  E. Kandel,et al.  Molecular Mechanisms of Memory Storage in Aplysia , 2006, The Biological Bulletin.

[29]  Edgar H Vogel,et al.  Stimulus specificity in the habituation of the startle response in the rat , 2005, Physiology & Behavior.

[30]  Ammar Belatreche.  Biologically Inspired Neural Networks: Models, Learning, and Applications , 2010 .

[31]  Ben Goertzel,et al.  Introduction: Aspects of Artificial General Intelligence , 2007, AGI.

[32]  Hua-Yue Ye 叶华跃,et al.  Molecular control of memory in nematode Caenorhabditis elegans , 2008, Neuroscience Bulletin.

[33]  R. F. Thompson,et al.  Habituation: a model phenomenon for the study of neuronal substrates of behavior. , 1966, Psychological review.

[34]  C. Rankin,et al.  A new group-training procedure for habituation demonstrates that presynaptic glutamate release contributes to long-term memory in Caenorhabditis elegans. , 2002, Learning & memory.

[35]  John E. R. Staddon.  Adaptive Dynamics: The Theoretical Analysis of Behavior , 2001 .

[36]  DeLiang Wang,et al.  A Neural Model of Synaptic Plasticity Underlying Short-term and Long-term Habituation , 1993, Adapt. Behav..

[37]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[38]  Y. Kuniyoshi,et al.  Embodied Artificial Intelligence , 2004, Lecture Notes in Computer Science.

[39]  P. Groves,et al.  Habituation: a dual-process theory. , 1970, Psychological review.

[40]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[41]  C. Rankin,et al.  Analyses of habituation in Caenorhabditis elegans. , 2001, Learning & memory.

[42]  George A. Bekey,et al.  AUTONOMOUS ROBOTS, From Biological Inspiration to Implementation and Control, by G.A. Bekey, MIT Press, 2005, xv + 577 pp., index, ISBN 0-262-02578-7, 25 pages of references (Hb. £35.95) , 2005, Robotica.

[43]  Joost Broekens,et al.  Affect, Anticipation, and Adaptation: Affect-Controlled Selection of Anticipatory Simulation in Artificial Adaptive Agents , 2007, Adapt. Behav..

[44]  Stephen Marsland,et al.  Using habituation in machine learning , 2009, Neurobiology of Learning and Memory.

[45]  Stephen R. Marsland,et al.  On-line novelty detection for autonomous mobile robots , 2005, Robotics Auton. Syst..

[46]  Mounir Boukadoum,et al.  Classical conditioning in different temporal constraints: an STDP learning rule for robots controlled by spiking neural networks , 2012, Adapt. Behav..

[47]  B. Burrell,et al.  Generalization of habituation and intrinsic sensitization in the leech. , 1998, Learning & memory.

[48]  C. Rankin,et al.  Heat shock disrupts long-term memory consolidation in Caenorhabditis elegans. , 1995, Learning & memory.

[49]  E. Kandel,et al.  A quantal analysis of the synaptic depression underlying habituation of the gill-withdrawal reflex in Aplysia. , 1974, Proceedings of the National Academy of Sciences of the United States of America.

[50]  E. Kandel,et al.  The Contribution of Facilitation of Monosynaptic PSPs to Dishabituation and Sensitization of the Aplysia Siphon Withdrawal Reflex , 1999, The Journal of Neuroscience.

[51]  Ulrich Nehmzow,et al.  A Model of Habituation Applied to Mobile Robots , 2007 .

[52]  J. C. Stanley.  Computer simulation of a model of habituation , 1976, Nature.

[53]  S. Steidl,et al.  Stages of memory in the nematode Caenorhabditis elegans. , 2003, Behavioral and cognitive neuroscience reviews.

[54]  Deliang Wang,et al.  Modeling neural mechanisms of vertebrate habituation: Locus specificity and pattern discrimination , 1994, Journal of Computational Neuroscience.

[55]  Joydeep Ghosh,et al.  Habituation based neural networks for spatio-temporal classification , 1997, Neurocomputing.

[56]  Maja J. Mataric,et al.  The Robotics Primer , 2007 .

[57]  Denis Mareschal,et al.  An Interacting Systems Model of Infant Habituation , 2004, Journal of Cognitive Neuroscience.

[58]  E. D. Rosal,et al.  Simulation of habituation to simple and multiple stimuli , 2006, Behavioural Processes.

[59]  C. H. Rankin,et al.  Caenorhabditis elegans: A new model system for the study of learning and memory , 1990, Behavioural Brain Research.

[60]  C. Rankin,et al.  Effects of changing interstimulus interval during habituation in Caenorhabditis elegans. , 1994, Behavioral neuroscience.

[61]  Molecular control of memory in nematode Caenorhabditis elegans , 2008, Neuroscience bulletin.

[62]  S. R. Wicks,et al.  Integration of mechanosensory stimuli in Caenorhabditis elegans , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  John E. R. Staddon,et al.  MULTIPLE TIME SCALES IN SIMPLE HABITUATION , 1996 .

[64]  Donald A. Wilson,et al.  Habituation revisited: An updated and revised description of the behavioral characteristics of habituation , 2009, Neurobiology of Learning and Memory.

[65]  C. Rankin,et al.  Factors affecting habituation and recovery from habituation in the nematode Caenorhabditis elegans. , 1992, Behavioral neuroscience.

[66]  Lola Alonso,et al.  Simulation of the filtering role of habituation to stimuli , 2005, The Spanish Journal of Psychology.

[67]  M. Davis,et al.  Effects of interstimulus interval length and variability on startle-response habituation in the rat. , 1970, Journal of comparative and physiological psychology.

[68]  J. W. Whitlow.  Short-term memory in habituation and dishabituation , 1975 .

[69]  J. W. Rudy,et al.  The Neurobiology of Learning and Memory , 2013 .

[70]  T. Ziemke.  What’s that Thing Called Embodiment? , 2003 .

[71]  Anthony Kulis,et al.  Bio-Inspired Artificial Intelligence: Theories, Methods, and Technologies , 2009, Scalable Comput. Pract. Exp..

[72]  T. Carew,et al.  Development of learning and memory in Aplysia. II. Habituation and dishabituation , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[73]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[74]  D. Glanzman,et al.  The Cellular Mechanisms of Learning in Aplysia: Of Blind Men and Elephants , 2006, The Biological Bulletin.

[75]  A. Kanellopoulos,et al.  Protection from premature habituation requires functional mushroom bodies in Drosophila. , 2007, Learning & memory.

[76]  S. Sirois,et al.  Hebbian motor control in a robot-embedded model of habituation , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..