Learning expectation in insects: A recurrent spiking neural model for spatio-temporal representation

Insects are becoming a reference point in Neuroscience for the study of biological aspects at the basis of cognitive processes. These animals have much simpler brains with respect to higher animals, showing, at the same time, impressive capability to adaptively react and take decisions in front of complex environmental situations. In this paper we propose a neural model inspired by the insect olfactory system, with particular attention to the fruit fly Drosophila melanogaster. This architecture is a multilayer spiking network, where each layer is inspired by the structures of the insect brain mainly involved in olfactory information processing, namely the Mushroom Bodies, the Lateral Horns and the Antennal Lobes. In the Antennal Lobes layer olfactory signals lead to a competition among sets of neurons, resulting in a pattern which is projected to the Mushroom Bodies layer. Here a competitive reaction-diffusion process leads to a spontaneous emerging of clusters. The Lateral Horns have been modeled as a delayed input-triggered resetting system. Using plastic recurrent connections, with the addition of simple learning mechanisms, the structure is able to realize a top-down modulation at the input level. This leads to the emergence of an attentional loop as well as to the arousal of basic expectation behaviors in case of subsequently presented stimuli. Simulation results and analysis on the biological plausibility of the architecture are provided and the role of noise in the network is reported.

[1]  Ronald L. Davis,et al.  Insect olfactory memory in time and space , 2006, Current Opinion in Neurobiology.

[2]  Anna Dornhaus,et al.  Individual and collective cognition in ants and other insects ( Hymenoptera : Formicidae ) , 2008 .

[3]  Paolo Arena,et al.  An insect brain inspired neural model for object representation and expectation , 2011, The 2011 International Joint Conference on Neural Networks.

[4]  J. Rothstein,et al.  Therapeutic horizons for amyotrophic lateral sclerosis , 1996, Current Opinion in Neurobiology.

[5]  P. Arena,et al.  Implementation of a drosophila-inspired orientation model on the Eye-Ris platform , 2010, 2010 12th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA 2010).

[6]  W. Gronenberg,et al.  Multisensory Convergence in the Mushroom Bodies of Ants and Bees , 2004, Acta biologica Hungarica.

[7]  Mandyam V. Srinivasan,et al.  Small brains, smart minds: vision, perception, navigation and 'cognition' in insects , 2006 .

[8]  Luigi Fortuna,et al.  Learning Anticipation via Spiking Networks: Application to Navigation Control , 2009, IEEE Transactions on Neural Networks.

[9]  S. Sachse,et al.  Role of inhibition for temporal and spatial odor representation in olfactory output neurons: a calcium imaging study. , 2002, Journal of neurophysiology.

[10]  R. Menzel,et al.  Fast dynamics of odor rate coding in the insect antennal lobe , 2010, 1101.0271.

[11]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[12]  R. Wehner Spatial Vision in Arthropods , 1981 .

[13]  Bertram Gerber,et al.  Olfactory learning in individually assayed Drosophila larvae. , 2003, Learning & memory.

[14]  Glenn C. Turner,et al.  Oscillations and Sparsening of Odor Representations in the Mushroom Body , 2002, Science.

[15]  M. Heisenberg,et al.  Visual learning in individually assayed Drosophila larvae , 2004, Journal of Experimental Biology.

[16]  Barbara Webb,et al.  Biorobotics: Methods and Applications , 2002 .

[17]  R. Menzel,et al.  A new ascending sensory tract to the calyces of the honeybee mushroom body, the subesophageal‐calycal tract , 2003, The Journal of comparative neurology.

[18]  Marie E. Burns,et al.  Enhanced Arrestin Facilitates Recovery and Protects Rods Lacking Rhodopsin Phosphorylation , 2009, Current Biology.

[19]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[20]  M Heisenberg,et al.  Associative odor learning in Drosophila abolished by chemical ablation of mushroom bodies. , 1994, Science.

[21]  P. Arena,et al.  Simple sensors provide inputs for cognitive robots , 2009, IEEE Instrumentation & Measurement Magazine.

[22]  J. Niven,et al.  Are Bigger Brains Better? , 2009, Current Biology.

[23]  Luigi Fortuna,et al.  The winnerless competition paradigm in cellular nonlinear networks: Models and applications , 2009, Int. J. Circuit Theory Appl..

[24]  Ramón Huerta,et al.  Fast and Robust Learning by Reinforcement Signals: Explorations in the Insect Brain , 2009, Neural Computation.

[25]  Nicolas Y. Masse,et al.  Olfactory Information Processing in Drosophila , 2009, Current Biology.

[26]  Wei Zhang,et al.  Functional feedback from mushroom bodies to antennal lobes in the Drosophila olfactory pathway , 2010, Proceedings of the National Academy of Sciences.

[27]  Ramón Huerta,et al.  Decoding Temporal Information Through Slow Lateral Excitation in the Olfactory System of Insects , 2003, Journal of Computational Neuroscience.

[28]  Randolf Menzel,et al.  Dimensions of cognition in an insect, the honeybee. , 2006, Behavioral and cognitive neuroscience reviews.

[29]  Paolo Arena,et al.  Insect inspired unsupervised learning for tactic and phobic behavior enhancement in a hybrid robot , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[30]  Ramón Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001 .

[31]  B. Swinderen,et al.  Attention-like processes in Drosophila require short-term memory genes. , 2007 .

[32]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[33]  A Guo,et al.  Choice Behavior of Drosophila Facing Contradictory Visual Cues , 2001, Science.

[34]  M. Srinivasan,et al.  Visual motor computations in insects. , 2004, Annual review of neuroscience.