Outcome expectations drive learned behaviour in larval Drosophila

Why does Pavlov's dog salivate? In response to the tone, or in expectation of food? While in vertebrates behaviour can be driven by expected outcomes, it is unknown whether this is true for non-vertebrates as well. We find that, in the Drosophila larva, odour memories are expressed behaviourally only if animals can expect a positive outcome from doing so. The expected outcome of tracking down an odour is determined by comparing the value of the current situation with the value of the memory for that odour. Memory is expressed behaviourally only if the expected outcome is positive. This uncovers a hitherto unrecognized evaluative processing step between an activated memory trace and behaviour control, and argues that learned behaviour reflects the pursuit of its expected outcome. Shown in a system with a simple brain, an apparently cognitive process like representing the expected outcome of behaviour seems to be a basic feature of behaviour control.

[1]  Anthony Dickinson,et al.  The 28th Bartlett Memorial Lecture. Causal learning: an associative analysis. , 2001 .

[2]  Alex Kacelnik,et al.  State-Dependent Learned Valuation Drives Choice in an Invertebrate , 2006, Science.

[3]  K. Furukubo-Tokunaga,et al.  Induction of cAMP Response Element-Binding Protein-Dependent Medium-Term Memory by Appetitive Gustatory Reinforcement in Drosophila Larvae , 2005, The Journal of Neuroscience.

[4]  B. Hommel,et al.  Effect anticipation and action control. , 2001, Journal of experimental psychology. Human perception and performance.

[5]  A Borst,et al.  Drosophila mushroom body mutants are deficient in olfactory learning. , 1985, Journal of neurogenetics.

[6]  M. Heisenberg,et al.  The carrot, not the stick: appetitive rather than aversive gustatory stimuli support associative olfactory learning in individually assayed Drosophila larvae , 2005, Journal of Comparative Physiology A.

[7]  Bertram Gerber,et al.  Olfactory learning in individually assayed Drosophila larvae. , 2003, Learning & memory.

[8]  Anthony Dickinson,et al.  The 28th Bartlett Memorial Lecture Causal Learning: An Associative Analysis , 2001, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[9]  Michela Gallagher,et al.  Lesions of Orbitofrontal Cortex Impair Rats' Differential Outcome Expectancy Learning But Not Conditioned Stimulus-Potentiated Feeding , 2005, The Journal of Neuroscience.

[10]  R. Rescorla.  Behavioral studies of Pavlovian conditioning. , 1988, Annual review of neuroscience.

[11]  Bertram Gerber,et al.  The Drosophila larva as a model for studying chemosensation and chemosensory learning: a review. , 2007, Chemical senses.

[12]  Robert A. Rescorla,et al.  Effect of reinforcer devaluation on discriminative control of instrumental behavior. , 1990, Journal of experimental psychology. Animal behavior processes.

[13]  Geoffrey Schoenbaum,et al.  Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. , 2003, Learning & memory.

[14]  Effect of reinforcer devaluation on discriminative control of instrumental behavior. , 1990, Journal of experimental psychology. Animal behavior processes.

[15]  G. Nagel,et al.  Light-Induced Activation of Distinct Modulatory Neurons Triggers Appetitive or Aversive Learning in Drosophila Larvae , 2006, Current Biology.

[16]  Gregory S.X.E. Jefferis,et al.  Glomerular Maps without Cellular Redundancy at Successive Levels of the Drosophila Larval Olfactory Circuit , 2005, Current Biology.

[17]  R. Colwill,et al.  Encoding of the unconditioned stimulus in Pavlovian conditioning , 1994 .

[18]  Joachim Hoffmann,et al.  Anticipatory Behavioral Control , 2003, ABiALS.

[19]  M. Heisenberg,et al.  An engram found? Evaluating the evidence from fruit flies , 2004, Current Opinion in Neurobiology.

[20]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[21]  B. Gerber,et al.  Appetitive olfactory learning in Drosophila larvae: effects of repetition, reward strength, age, gender, assay type and memory span , 2005, Animal Behaviour.