Associative learning in invertebrates.

This work reviews research on neural mechanisms of two types of associative learning in the marine mollusk Aplysia, classical conditioning of the gill- and siphon-withdrawal reflex and operant conditioning of feeding behavior. Basic classical conditioning is caused in part by activity-dependent facilitation at sensory neuron-motor neuron (SN-MN) synapses and involves a hybrid combination of activity-dependent presynaptic facilitation and Hebbian potentiation, which are coordinated by trans-synaptic signaling. Classical conditioning also shows several higher-order features, which might be explained by the known circuit connections in Aplysia. Operant conditioning is caused in part by a different type of mechanism, an intrinsic increase in excitability of an identified neuron in the central pattern generator (CPG) for feeding. However, for both classical and operant conditioning, adenylyl cyclase is a molecular site of convergence of the two signals that are associated. Learning in other invertebrate preparations also involves many of the same mechanisms, which may contribute to learning in vertebrates as well.

[1]  R. Menzel.  Chapter 29 – In Search of the Engram in the Honeybee Brain , 2013 .

[2]  D. Alkon,et al.  Primary changes of membrane currents during retention of associative learning. , 1982, Science.

[3]  R. Rescorla.  Probability of shock in the presence and absence of CS in fear conditioning. , 1968, Journal of comparative and physiological psychology.

[4]  R. Menzel.  Searching for the memory trace in a mini-brain, the honeybee. , 2001, Learning & memory.

[5]  D. A. Baxter,et al.  Classical Conditioning of Feeding in Aplysia: I. Behavioral Analysis , 2000, The Journal of Neuroscience.

[6]  U. Müller.  Memory Phases and Signaling Cascades in Honeybees , 2013 .

[7]  J. Simmers,et al.  Cellular and Network Mechanisms of Operant Learning-Induced Compulsive Behavior in Aplysia , 2009, Current Biology.

[8]  G. A. Clark,et al.  Operant Conditioning of Gill Withdrawal in Aplysia , 2006, The Journal of Neuroscience.

[9]  Enhancement of sensorimotor connections by conditioning-related stimulation in Aplysia depends upon postsynaptic Ca2+. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[11]  Ronald L. Davis,et al.  Dynamics of Learning-Related cAMP Signaling and Stimulus Integration in the Drosophila Olfactory Pathway , 2009, Neuron.

[12]  R. Hawkins.  Interneurons involved in mediation and modulation of gill-withdrawal reflex in Aplysia. III. Identified facilitating neurons increase Ca2+ current in sensory neurons. , 1981, Journal of neurophysiology.

[13]  J. Byrne,et al.  Associative conditioning analog selectively increases cAMP levels of tail sensory neurons in Aplysia. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Ronald L. Davis,et al.  Drosophila Memory Research through Four Eras: Genetic, Molecular Biology, Neuroanatomy, and Systems Neuroscience , 2013 .

[15]  D. A. Baxter,et al.  Molecular Mechanisms Underlying a Cellular Analog of Operant Reward Learning , 2008, Neuron.

[16]  E R Kandel,et al.  Depletion of serotonin in the nervous system of Aplysia reduces the behavioral enhancement of gill withdrawal as well as the heterosynaptic facilitation produced by tail shock , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  L. Lyons,et al.  Massed Training-Induced Intermediate-Term Operant Memory in Aplysia Requires Protein Synthesis and Multiple Persistent Kinase Cascades , 2012, The Journal of Neuroscience.

[18]  E. Kandel,et al.  Classical conditioning in a simple withdrawal reflex in Aplysia californica , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Alan Gelperin,et al.  Associative Memory Mechanisms in Terrestrial Slugs and Snails , 2013 .

[20]  Abraham J Susswein,et al.  Variables affecting long-term memory of learning that a food is inedible in Aplysia. , 1991, Behavioral neuroscience.

[21]  N Dale,et al.  L-glutamate may be the fast excitatory transmitter of Aplysia sensory neurons. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[22]  D. Alkon.  Calcium-mediated reduction of ionic currents: a biophysical memory trace. , 1984, Science.

[23]  G. A. Clark,et al.  Activity-dependent enhancement of presynaptic facilitation provides a cellular mechanism for the temporal specificity of classical conditioning in Aplysia. , 1994, Learning & memory.

[24]  A. Chiang,et al.  Visualizing Long-Term Memory Formation in Two Neurons of the Drosophila Brain , 2012, Science.

[25]  A. Willows,et al.  Invertebrate Learning , 1973, Springer US.

[26]  Ayelet Katzoff,et al.  Nitric Oxide Is Necessary for Multiple Memory Processes after Learning That a Food Is Inedible in Aplysia , 2002, The Journal of Neuroscience.

[27]  T. Carew,et al.  Operant conditioning of head waving in Aplysia. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[28]  E. Kandel,et al.  The Contribution of Facilitation of Monosynaptic PSPs to Dishabituation and Sensitization of the Aplysia Siphon Withdrawal Reflex , 1999, The Journal of Neuroscience.

[29]  J. Byrne,et al.  Learning insights transmitted by glutamate , 2004, Trends in Neurosciences.

[30]  Terry Crow,et al.  Long-Term Enhancement but Not Short-Term inHermissendaIs Dependent upon mRNA Synthesis , 1997, Neurobiology of Learning and Memory.

[31]  L. Kamin.  Predictability, surprise, attention, and conditioning , 1967 .

[32]  D. Glanzman,et al.  Mediation of classical conditioning in Aplysia californica by long-term potentiation of sensorimotor synapses. , 1997, Science.

[33]  E. Kandel,et al.  Is there a cell-biological alphabet for simple forms of learning? , 1984, Psychological review.

[34]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[35]  E. Kandel,et al.  Associative Learning in Aplysia: evidence for conditioned fear in an invertebrate. , 1981, Science.

[36]  G. A. Clark,et al.  Classical conditioning of the Aplysia siphon-withdrawal reflex exhibits response specificity. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[37]  D. Glanzman,et al.  Long-term potentiation of Aplysia sensorimotor synapses in cell culture: regulation by postsynaptic voltage , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[38]  Abraham J Susswein,et al.  Multiple memory processes following training that a food is inedible in Aplysia. , 1998, Learning & memory.

[39]  J. Farley,et al.  Protein kinase C activation induces conductance changes in Hermissenda photoreceptors like those seen in associative learning , 1986, Nature.

[40]  Scott T. Grafton,et al.  The striatum: where skills and habits meet. , 2015, Cold Spring Harbor perspectives in biology.

[41]  R. Colwill,et al.  Pavlovian appetitive discriminative conditioning inAplysia californica , 1997 .

[42]  D. A. Baxter,et al.  Classical and operant conditioning differentially modify the intrinsic properties of an identified neuron , 2006, Nature Neuroscience.

[43]  E. Kandel,et al.  A cellular mechanism of classical conditioning in Aplysia: activity-dependent amplification of presynaptic facilitation. , 1983, Science.

[44]  L. Lyons,et al.  PKA and PKC are required for long-term but not short-term in vivo operant memory in Aplysia. , 2010, Learning & memory.

[45]  S. Waddell,et al.  Drosophila olfactory memory: single genes to complex neural circuits , 2007, Nature Reviews Neuroscience.

[46]  E T Walters.  Transformation of siphon responses during conditioning of Aplysia suggests a model of primitive stimulus-response association. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[47]  R. Hawkins,et al.  Identified serotonergic neurons LCB1 and RCB1 in the cerebral ganglia of Aplysia produce presynaptic facilitation of siphon sensory neurons , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  E. Ringseis,et al.  Operant conditioning of aerial respiratory behaviour in Lymnaea stagnalis , 1996, The Journal of experimental biology.

[49]  E R Kandel,et al.  The Contribution of Activity-Dependent Synaptic Plasticity to Classical Conditioning in Aplysia , 2001, The Journal of Neuroscience.

[50]  E Feldman,et al.  Learned changes of feeding behavior in Aplysia in response to edible and inedible foods , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[51]  Björn Brembs,et al.  Double dissociation of protein-kinase C and adenylyl cyclase manipulations on operant and classical learning in Drosophila , 2008 .

[52]  J. Byrne,et al.  Associative conditioning of single sensory neurons suggests a cellular mechanism for learning. , 1983, Science.

[53]  E. Kandel,et al.  Two endogenous neuropeptides modulate the gill and siphon withdrawal reflex in Aplysia by presynaptic facilitation involving cAMP-dependent closure of a serotonin-sensitive potassium channel. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[54]  E R Kandel,et al.  Classical conditioning, differential conditioning, and second-order conditioning of the Aplysia gill-withdrawal reflex in a simplified mantle organ preparation. , 1998, Behavioral neuroscience.

[55]  R. Rescorla.  Pavlovian conditioning and its proper control procedures. , 1967, Psychological review.

[56]  R. Hawkins.  A Biologically Based Computational Model for Several Simple Forms of Learning , 1989 .

[57]  Thomas Preat,et al.  PKA Dynamics in a Drosophila Learning Center: Coincidence Detection by Rutabaga Adenylyl Cyclase and Spatial Regulation by Dunce Phosphodiesterase , 2010, Neuron.

[58]  Douglas A. Baxter,et al.  Small networks of empirically derived adaptive elements simulate some higher-order features of classical conditioning , 1990, Neural Networks.

[59]  Abraham J Susswein,et al.  Training with inedible food in Aplysia causes expression of C/EBP in the buccal but not cerebral ganglion. , 2008, Learning & memory.

[60]  D. A. Baxter,et al.  Operant Reward Learning in Aplysia: Neuronal Correlates and Mechanisms , 2002, Science.

[61]  D. A. Baxter,et al.  In Vitro Analog of Operant Conditioning inAplysia. I. Contingent Reinforcement Modifies the Functional Dynamics of an Identified Neuron , 1999, The Journal of Neuroscience.

[62]  Robert A. A. Campbell,et al.  Distinct molecular underpinnings of Drosophila olfactory trace conditioning , 2011, Proceedings of the National Academy of Sciences.

[63]  J. Byrne,et al.  Long-term synaptic changes produced by a cellular analog of classical conditioning in Aplysia. , 1990, Science.

[64]  T. Crow,et al.  Retention of an associative behavioral change in Hermissenda. , 1978, Science.

[65]  S. Smith‐Roe,et al.  Coincident Activation of NMDA and Dopamine D1Receptors within the Nucleus Accumbens Core Is Required for Appetitive Instrumental Learning , 2000, The Journal of Neuroscience.

[66]  E. Kandel,et al.  Effects of interstimulus interval and contingency on classical conditioning of the Aplysia siphon withdrawal reflex , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  N. Miller,et al.  Nitric oxide and histamine signal attempts to swallow: A component of learning that food is inedible in Aplysia. , 2009, Learning & memory.

[68]  J. H. Schwartz,et al.  Long-Term Memory Requires PolyADP-ribosylation , 2004, Science.

[69]  R. Hawkins.  Possible contributions of a novel form of synaptic plasticity in Aplysia to reward, memory, and their dysfunctions in mammalian brain , 2013, Learning & memory.

[70]  E. Kandel,et al.  Interneurons involved in mediation and modulation of gill-withdrawal reflex in Aplysia. II. Identified neurons produce heterosynaptic facilitation contributing to behavioral sensitization. , 1981, Journal of neurophysiology.

[71]  D. A. Baxter,et al.  Classical Conditioning of Feeding in Aplysia: II. Neurophysiological Correlates , 2000, The Journal of Neuroscience.

[72]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[73]  E. Kandel,et al.  Interneurons involved in mediation and modulation of gill-withdrawal reflex in Aplysia. IV. Morphological basis of presynaptic facilitation. , 1981, Journal of neurophysiology.

[74]  T. Abrams,et al.  Analysis of sequence-dependent interactions between transient calcium and transmitter stimuli in activating adenylyl cyclase in Aplysia: possible contribution to CS--US sequence requirement during conditioning. , 1998, Learning & memory.

[75]  Abraham J Susswein,et al.  A learned change of response to inedible food in Aplysia. , 1983, Behavioral and neural biology.

[76]  D. Alkon,et al.  Classical conditioning of Hermissenda: origin of a new response , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  S. Schacher,et al.  Identified facilitator neurons L29 and L28 are excited by cutaneous stimuli used in dishabituation, sensitization, and classical conditioning of Aplysia , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[78]  T. Crow,et al.  Chapter 19 - Multisite Cellular and Synaptic Mechanisms in Hermissenda Pavlovian Conditioning , 2013 .

[79]  J. Byrne,et al.  More than synaptic plasticity: role of nonsynaptic plasticity in learning and memory , 2010, Trends in Neurosciences.

[80]  E. Kandel,et al.  Activity-Dependent Presynaptic Facilitation and Hebbian LTP Are Both Required and Interact during Classical Conditioning in Aplysia , 2003, Neuron.

[81]  T. Crow,et al.  Inhibition of protein synthesis blocks long-term enhancement of generator potentials produced by one-trial in vivo conditioning in Hermissenda. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[82]  Ronald L. Davis,et al.  Dopamine Is Required for Learning and Forgetting in Drosophila , 2012, Neuron.

[83]  K. Lukowiak,et al.  The participation of NMDA receptors, PKC, and MAPK in the formation of memory following operant conditioning in Lymnaea , 2010, Molecular Brain.

[84]  R. Malenka,et al.  CREB modulates excitability of nucleus accumbens neurons , 2006, Nature Neuroscience.

[85]  E. Kandel,et al.  A Quantitative Study of the Ca2+/Calmodulin Sensitivity of Adenylyl Cyclase in Aplysia, Drosophila, and Rat , 1992, Journal of neurochemistry.

[86]  D. Glanzman,et al.  Hebbian induction of long-term potentiation of Aplysia sensorimotor synapses: partial requirement for activation of an NMDA-related receptor , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[87]  G. Murphy,et al.  Cellular Analog of Differential Classical Conditioning inAplysia: Disruption by the NMDA Receptor Antagonistdl-2-Amino-5-Phosphonovalerate , 1999, The Journal of Neuroscience.

[88]  A. Kelley,et al.  Appetitive Instrumental Learning Is Impaired by Inhibition of cAMP-Dependent Protein Kinase within the Nucleus Accumbens , 2002, Neurobiology of Learning and Memory.

[89]  Ronald L. Davis,et al.  Olfactory memory formation in Drosophila: from molecular to systems neuroscience. , 2005, Annual review of neuroscience.

[90]  T. Crow,et al.  Phosphorylation of Mitogen-Activated Protein Kinase by One-Trial and Multi-Trial Classical Conditioning , 1998, The Journal of Neuroscience.

[91]  Randolf Menzel,et al.  Small Brains, Bright Minds , 2006, Cell.

[92]  K. Deisseroth,et al.  Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning , 2009, Science.

[93]  D. Alkon,et al.  Protein kinase injection reduces voltage-dependent potassium currents. , 1983, Science.

[94]  Susan Sangha,et al.  A molluscan model system in the search for the engram , 2003, Journal of Physiology-Paris.

[95]  R. Hawkins,et al.  Role of Nitric Oxide in Classical Conditioning of Siphon Withdrawal in Aplysia , 2007, The Journal of Neuroscience.

[96]  V. Castellucci,et al.  Excitatory amino acid neurotransmission at sensory-motor and interneuronal synapses of Aplysia californica. , 1993, Journal of neurophysiology.

[97]  E. Kandel,et al.  Differential classical conditioning of a defensive withdrawal reflex in Aplysia californica. , 1983, Science.

[98]  J. Byrne,et al.  Differential effects of serotonin, FMRFamide, and small cardioactive peptide on multiple, distributed processes modulating sensorimotor synaptic transmission in Aplysia , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[99]  C. Rankin,et al.  Nonassociative Learning in Invertebrates , 2017 .

[100]  E. Kandel,et al.  Classical conditioning and sensitization share aspects of the same molecular cascade in Aplysia. , 1983, Cold Spring Harbor symposia on quantitative biology.

[101]  K. Lukowiak,et al.  Changes in the activity of a CpG neuron after the reinforcement of an operantly conditioned behavior in Lymnaea. , 2002, Journal of neurophysiology.

[102]  E. Kandel,et al.  Biochemical studies of stimulus convergence during classical conditioning in Aplysia: dual regulation of adenylate cyclase by Ca2+/calmodulin and transmitter , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[103]  Eric R. Kandel,et al.  Involvement of Presynaptic and Postsynaptic Mechanisms in a Cellular Analog of Classical Conditioning at AplysiaSensory-Motor Neuron Synapses in Isolated Cell Culture , 1998, The Journal of Neuroscience.

[104]  Beyond the Cellular Alphabet of Learning and Memory in Invertebrates , 2013 .