Re-evaluation of learned information in Drosophila

Animals constantly assess the reliability of learned information to optimize their behaviour. On retrieval, consolidated long-term memory can be neutralized by extinction if the learned prediction was inaccurate. Alternatively, retrieved memory can be maintained, following a period of reconsolidation during which it is labile. Although extinction and reconsolidation provide opportunities to alleviate problematic human memories, we lack a detailed mechanistic understanding of memory updating. Here we identify neural operations underpinning the re-evaluation of memory in Drosophila. Reactivation of reward-reinforced olfactory memory can lead to either extinction or reconsolidation, depending on prediction accuracy. Each process recruits activity in specific parts of the mushroom body output network and distinct subsets of reinforcing dopaminergic neurons. Memory extinction requires output neurons with dendrites in the α and α′ lobes of the mushroom body, which drive negatively reinforcing dopaminergic neurons that innervate neighbouring zones. The aversive valence of these new extinction memories neutralizes previously learned odour preference. Memory reconsolidation requires the γ2α′1 mushroom body output neurons. This pathway recruits negatively reinforcing dopaminergic neurons innervating the same compartment and re-engages positively reinforcing dopaminergic neurons to reconsolidate the original reward memory. These data establish that recurrent and hierarchical connectivity between mushroom body output neurons and dopaminergic neurons enables memory re-evaluation driven by reward-prediction error.

[1]  A. Fiala,et al.  Punishment Prediction by Dopaminergic Neurons in Drosophila , 2005, Current Biology.

[2]  Daryl M. Gohl,et al.  Layered reward signaling through octopamine and dopamine in Drosophila , 2012, Nature.

[3]  Joseph E LeDoux,et al.  Preventing the return of fear in humans using reconsolidation update mechanisms , 2010, Nature.

[4]  M. Kindt,et al.  Prediction error demarcates the transition from retrieval, to reconsolidation, to new learning , 2014, Learning & memory.

[5]  G. Rubin,et al.  Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila , 2014, eLife.

[6]  L. Luo,et al.  A protocol for dissecting Drosophila melanogaster brains for live imaging or immunostaining , 2006, Nature Protocols.

[7]  Jay Hirsh,et al.  Targeted gene expression in Drosophila dopaminergic cells using regulatory sequences from tyrosine hydroxylase. , 2003, Journal of neurobiology.

[8]  Gerald M. Rubin,et al.  Heterosynaptic Plasticity Underlies Aversive Olfactory Learning in Drosophila , 2015, Neuron.

[9]  Shamik Dasgupta,et al.  A Neural Circuit Mechanism Integrating Motivational State with Memory Expression in Drosophila , 2009, Cell.

[10]  Yoshinori Aso,et al.  Three Dopamine Pathways Induce Aversive Odor Memories with Different Stability , 2012, PLoS genetics.

[11]  Scott Waddell,et al.  Olfactory learning skews mushroom body output pathways to steer behavioral choice in Drosophila , 2015, Current Opinion in Neurobiology.

[12]  Joseph E LeDoux,et al.  Detection of a Temporal Error Triggers Reconsolidation of Amygdala-Dependent Memories , 2013, Current Biology.

[13]  M. Kindt,et al.  Beyond extinction: erasing human fear responses and preventing the return of fear , 2009, Nature Neuroscience.

[14]  N. Daw,et al.  Rethinking Extinction , 2015, Neuron.

[15]  P. Greengard,et al.  Writing Memories with Light-Addressable Reinforcement Circuitry , 2009, Cell.

[16]  Johannes Felsenberg,et al.  Activity of Defined Mushroom Body Output Neurons Underlies Learned Olfactory Behavior in Drosophila , 2015, Neuron.

[17]  G. Rubin,et al.  Mushroom body efferent neurons responsible for aversive olfactory memory retrieval in Drosophila , 2011, Nature Neuroscience.

[18]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[19]  S. Waddell,et al.  Rapid Consolidation to a radish and Protein Synthesis-Dependent Long-Term Memory after Single-Session Appetitive Olfactory Conditioning in Drosophila , 2008, The Journal of Neuroscience.

[20]  G. Rubin,et al.  The neuronal architecture of the mushroom body provides a logic for associative learning , 2014, eLife.

[21]  Stefan R. Pulver,et al.  Independent Optical Excitation of Distinct Neural Populations , 2014, Nature Methods.

[22]  Karim Nader,et al.  Reconsolidation and the Dynamic Nature of Memory. , 2015, Cold Spring Harbor perspectives in biology.

[23]  M. E. Pedreira,et al.  Mismatch between what is expected and what actually occurs triggers memory reconsolidation or extinction. , 2004, Learning & memory.

[24]  W. Quinn,et al.  Radish, a Drosophila mutant deficient in consolidated memory. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[25]  C. Chen,et al.  A Memory Retrieval-Extinction Procedure to Prevent Drug Craving and Relapse , 2012, Science.

[26]  Julie H. Simpson,et al.  A GAL4-driver line resource for Drosophila neurobiology. , 2012, Cell reports.

[27]  David J. Anderson,et al.  P1 interneurons promote a persistent internal state that enhances inter-male aggression in Drosophila , 2015, eLife.

[28]  T. Kitamoto.  Conditional modification of behavior in Drosophila by targeted expression of a temperature-sensitive shibire allele in defined neurons. , 2001, Journal of neurobiology.

[29]  Guillem R. Esber,et al.  Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors , 2015, Nature Neuroscience.

[30]  A Switch from Cycloheximide-Resistant Consolidated Memory to Cycloheximide-Sensitive Reconsolidation and Extinction in Drosophila , 2009, The Journal of Neuroscience.

[31]  B. Everitt,et al.  Reconsolidation and Extinction Are Dissociable and Mutually Exclusive Processes: Behavioral and Molecular Evidence , 2014, The Journal of Neuroscience.

[32]  W. Quinn,et al.  Reward learning in normal and mutant Drosophila. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Martin Heisenberg,et al.  Extinction Antagonizes Olfactory Memory at the Subcellular Level , 2002, Neuron.

[34]  G. Miesenböck,et al.  Excitatory Local Circuits and Their Implications for Olfactory Processing in the Fly Antennal Lobe , 2007, Cell.

[35]  G. Rubin,et al.  A subset of dopamine neurons signals reward for odour memory in Drosophila , 2012, Nature.

[36]  Karel Svoboda,et al.  ScanImage: Flexible software for operating laser scanning microscopes , 2003, Biomedical engineering online.

[37]  Oliver Barnstedt,et al.  Aversive Learning and Appetitive Motivation Toggle Feed-Forward Inhibition in the Drosophila Mushroom Body , 2016, Neuron.

[38]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[39]  M. Saitoe,et al.  Shifting transcriptional machinery is required for long-term memory maintenance and modification in Drosophila mushroom bodies , 2016, Nature Communications.

[40]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[41]  Jonathan L. C. Lee,et al.  Ventral Tegmental Dopamine Dysregulation Prevents Appetitive Memory Destabilization , 2013, The Journal of Neuroscience.