Modeling the insect mushroom bodies: application to a delayed match-to-sample task.

Despite their small brains, insects show advanced capabilities in learning and task solving. Flies, honeybees and ants are becoming a reference point in neuroscience and a main source of inspiration for autonomous robot design issues and control algorithms. In particular, honeybees demonstrate to be able to autonomously abstract complex associations and apply them in tasks involving different sensory modalities within the insect brain. Mushroom Bodies (MBs) are worthy of primary attention for understanding memory and learning functions in insects. In fact, even if their main role regards olfactory conditioning, they are involved in many behavioral achievements and learning capabilities, as has been shown in honeybees and flies. Owing to the many neurogenetic tools, the fruit fly Drosophila became a source of information for the neuroarchitecture and biochemistry of the MBs, although the MBs of flies are by far simpler in organization than their honeybee orthologs. Electrophysiological studies, in turn, became available on the MBs of locusts and honeybees. In this paper a novel bio-inspired neural architecture is presented, which represents a generalized insect MB with the basic features taken from fruit fly neuroanatomy. By mimicking a number of different MB functions and architecture, we can replace and improve formerly used artificial neural networks. The model is a multi-layer spiking neural network where key elements of the insect brain, the antennal lobes, the lateral horn region, the MBs, and their mutual interactions are modeled. In particular, the model is based on the role of parts of the MBs named MB-lobes, where interesting processing mechanisms arise on the basis of spatio-temporal pattern formation. The introduced network is able to model learning mechanisms like olfactory conditioning seen in honeybees and flies and was found able also to perform more complex and abstract associations, like the delayed matching-to-sample tasks known only from honeybees. A biological basis of the proposed model is presented together with a detailed description of the architecture. Simulation results and remarks on the biological counterpart are also reported to demonstrate the possible applications of the designed computational model. Such neural architecture, able to autonomously learn complex associations is envisaged to be a suitable basis for an immediate implementation within an robot control architecture.

[1]  Jan Wessnitzer,et al.  A model of associative learning in the mushroom body , 2008, Biological Cybernetics.

[2]  Luigi Fortuna,et al.  Integrating high-level sensor features via STDP for bio-inspired navigation , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[3]  R. Menzel,et al.  Sparsening and temporal sharpening of olfactory representations in the honeybee mushroom bodies. , 2005, Journal of neurophysiology.

[4]  Yueqing Peng,et al.  Dopamine-Mushroom Body Circuit Regulates Saliency-Based Decision-Making in Drosophila , 2007, Science.

[5]  Jan Wessnitzer,et al.  A model of non-elemental olfactory learning in Drosophila , 2011, Journal of Computational Neuroscience.

[6]  Randolf Menzel,et al.  Dimensions of cognition in an insect, the honeybee. , 2006, Behavioral and cognitive neuroscience reviews.

[7]  Kei Ito,et al.  A map of octopaminergic neurons in the Drosophila brain , 2009, The Journal of comparative neurology.

[8]  Glenn C. Turner,et al.  Olfactory representations by Drosophila mushroom body neurons. , 2008, Journal of neurophysiology.

[9]  H. Ishimoto,et al.  Neuronal Mechanisms of Learning and Memory Revealed by Spatial and Temporal Suppression of Neurotransmission Using Shibirets1, a Temperature-Sensitive Dynamin Mutant Gene in Drosophila Melanogaster , 2009, Front. Mol. Neurosci..

[10]  Li Liu,et al.  Context generalization in Drosophila visual learning requires the mushroom bodies , 1999, Nature.

[11]  M Heisenberg,et al.  Associative odor learning in Drosophila abolished by chemical ablation of mushroom bodies. , 1994, Science.

[12]  M. Srinivasan,et al.  The concepts of ‘sameness’ and ‘difference’ in an insect , 2001, Nature.

[13]  Paolo Arena,et al.  An insect brain inspired neural model for object representation and expectation , 2011, The 2011 International Joint Conference on Neural Networks.

[14]  Luigi Fortuna,et al.  A CNN-based chip for robot locomotion control , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[15]  B. Brembs Mushroom Bodies Regulate Habit Formation in Drosophila , 2009, Current Biology.

[16]  Roland Strauss,et al.  Mushroom Bodies Enhance Initial Motor Activity in drosophila , 2009, Journal of neurogenetics.

[17]  R. Strauss,et al.  Behavioral consequences of dopamine deficiency in the Drosophila central nervous system , 2010, Proceedings of the National Academy of Sciences.

[18]  Irina Sinakevitch,et al.  Organization of local interneurons in optic glomeruli of the dipterous visual system and comparisons with the antennal lobes , 2007, Developmental neurobiology.

[19]  Gaia Tavosanis,et al.  Synaptic organization in the adult Drosophila mushroom body calyx , 2009, The Journal of comparative neurology.

[20]  B. Swinderen,et al.  Attention-like processes in Drosophila require short-term memory genes. , 2007 .

[21]  Glenn C. Turner,et al.  Oscillations and Sparsening of Odor Representations in the Mushroom Body , 2002, Science.

[22]  Nasser Kehtarnavaz,et al.  Proceedings of SPIE - The International Society for Optical Engineering , 1991 .

[23]  Wei Zhang,et al.  Functional feedback from mushroom bodies to antennal lobes in the Drosophila olfactory pathway , 2010, Proceedings of the National Academy of Sciences.

[24]  Ramón Huerta,et al.  Decoding Temporal Information Through Slow Lateral Excitation in the Olfactory System of Insects , 2003, Journal of Computational Neuroscience.

[25]  P. Arena,et al.  Simple sensors provide inputs for cognitive robots , 2009, IEEE Instrumentation & Measurement Magazine.

[26]  Bruno van Swinderen,et al.  Shared Visual Attention and Memory Systems in the Drosophila Brain , 2009, PloS one.

[27]  B. Tabashnik,et al.  Development time and resistance to Bt crops , 1999, Nature.

[28]  J. Niven,et al.  Are Bigger Brains Better? , 2009, Current Biology.

[29]  Feng Yu,et al.  Mushroom bodies modulate salience‐based selective fixation behavior in Drosophila , 2008, The European journal of neuroscience.

[30]  W. Gronenberg,et al.  Multisensory Convergence in the Mushroom Bodies of Ants and Bees , 2004, Acta biologica Hungarica.

[31]  Mathias V. Schmidt,et al.  Gene Expression Profiling Following Maternal Deprivation: Involvement of the Brain Renin-Angiotensin System , 2009, Front. Mol. Neurosci..

[32]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[33]  P. Arena,et al.  STDP-based behavior learning on the TriBot robot , 2009, Microtechnologies.

[34]  Luigi Fortuna,et al.  Sensory Feedback in CNN-Based Central Pattern Generators , 2003, Int. J. Neural Syst..

[35]  Paolo Arena,et al.  Learning expectation in insects: A recurrent spiking neural model for spatio-temporal representation , 2012, Neural Networks.

[36]  Stephan J. Sigrist,et al.  Presynapses in Kenyon Cell Dendrites in the Mushroom Body Calyx of Drosophila , 2011, The Journal of Neuroscience.

[37]  Ronald L. Davis,et al.  Eight Different Types of Dopaminergic Neurons Innervate the Drosophila Mushroom Body Neuropil: Anatomical and Physiological Heterogeneity , 2009, Front. Neural Circuits.

[38]  Ramón Huerta,et al.  Self-organization in the olfactory system: one shot odor recognition in insects , 2005, Biological Cybernetics.

[39]  M. Heisenberg,et al.  Visual learning in individually assayed Drosophila larvae , 2004, Journal of Experimental Biology.

[40]  R. Menzel Searching for the memory trace in a mini-brain, the honeybee. , 2001, Learning & memory.

[41]  M Heisenberg,et al.  Mushroom bodies suppress locomotor activity in Drosophila melanogaster. , 1998, Learning & memory.

[42]  S. Sachse,et al.  Role of inhibition for temporal and spatial odor representation in olfactory output neurons: a calcium imaging study. , 2002, Journal of neurophysiology.

[43]  Luigi Fortuna,et al.  Perception for Action: Dynamic Spatiotemporal Patterns Applied on a Roving Robot , 2008, Adapt. Behav..

[44]  Shamik Dasgupta,et al.  A Neural Circuit Mechanism Integrating Motivational State with Memory Expression in Drosophila , 2009, Cell.

[45]  Kei Ito,et al.  Optic Glomeruli and Their Inputs in Drosophila Share an Organizational Ground Pattern with the Antennal Lobes , 2012, The Journal of Neuroscience.

[46]  Nicolas Y. Masse,et al.  Olfactory Information Processing in Drosophila , 2009, Current Biology.

[47]  M. Heisenberg,et al.  Dopamine and Octopamine Differentiate between Aversive and Appetitive Olfactory Memories in Drosophila , 2003, The Journal of Neuroscience.

[48]  Kei Ito,et al.  Neuronal assemblies of the Drosophila mushroom body , 2008, The Journal of comparative neurology.

[49]  A Guo,et al.  Choice Behavior of Drosophila Facing Contradictory Visual Cues , 2001, Science.

[50]  Luigi Fortuna,et al.  Reactive navigation through multiscroll systems: from theory to real-time implementation , 2008, Auton. Robots.

[51]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[52]  R. Menzel,et al.  Learning and memory in honeybees: from behavior to neural substrates. , 1996, Annual review of neuroscience.

[53]  R. Davis,et al.  Tripartite mushroom body architecture revealed by antigenic markers. , 1998, Learning & memory.

[54]  Bertram Gerber,et al.  Olfactory learning in individually assayed Drosophila larvae. , 2003, Learning & memory.

[55]  W. Gronenberg,et al.  Segregation of visual input to the mushroom bodies in the honeybee (Apis mellifera) , 2002, The Journal of comparative neurology.

[56]  M. Hammer An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees , 1993, Nature.

[57]  Leslie B. Vosshall,et al.  Genetic and Functional Subdivision of the Drosophila Antennal Lobe , 2005, Current Biology.

[58]  K. Han,et al.  D1 Dopamine Receptor dDA1 Is Required in the Mushroom Body Neurons for Aversive and Appetitive Learning in Drosophila , 2007, The Journal of Neuroscience.

[59]  Marie E. Burns,et al.  Enhanced Arrestin Facilitates Recovery and Protects Rods Lacking Rhodopsin Phosphorylation , 2009, Current Biology.

[60]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[61]  Luigi Fortuna,et al.  The winnerless competition paradigm in cellular nonlinear networks: Models and applications , 2009, Int. J. Circuit Theory Appl..

[62]  Ronald L. Davis,et al.  Insect olfactory memory in time and space , 2006, Current Opinion in Neurobiology.

[63]  G. Nagel,et al.  Light-Induced Activation of Distinct Modulatory Neurons Triggers Appetitive or Aversive Learning in Drosophila Larvae , 2006, Current Biology.

[64]  Luigi Fortuna,et al.  Learning Anticipation via Spiking Networks: Application to Navigation Control , 2009, IEEE Transactions on Neural Networks.

[65]  Yoshinori Aso,et al.  Specific Dopaminergic Neurons for the Formation of Labile Aversive Memory , 2010, Current Biology.