Occasion setting: a neural network approach.

Classical conditioning data show that a conditioned stimulus (CS) can act either as a simple CS--eliciting conditioned responses (CRs) by signaling the occurrence of an unconditioned stimulus (US)--or as an occasion setter--controlling the responses generated by another CS. In this article, the authors apply a simple extension of a network model of conditioning, originally presented by N. A. Schmajuk and J. J. DiCarlo (S-D; 1992), to the description of these 2 different CS functions. In the model, CS inputs are connected to the CR output both directly and indirectly through a hidden unit layer that codes configural stimuli. In this framework, a CS acts as (a) a simple stimulus through its direct connections with the output units and as (b) an occasion setter through its indirect configural connections via the hidden units. Computer simulations demonstrate that the network accounts for a large part of the data on occasion setting.

[1]  P. Holland,et al.  Summation and transfer of negative occasion setting , 1993 .

[2]  C. Buhusi,et al.  Stimulus configuration, occasion setting, and the hippocampus. , 1997, Behavioral neuroscience.

[3]  L. Jarrard,et al.  On the hippocampus and learned conditional responding: Effects of aspiration versus ibotenate lesions , 1991, Hippocampus.

[4]  R. Sutherland,et al.  Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia , 1989, Psychobiology.

[5]  P. Holland.  Occasion Setting in Pavlovian Conditioning , 1992 .

[6]  P. Holland.  Acquisition and transfer of conditional discrimination performance. , 1989 .

[7]  Paul J. Werbos,et al.  Building and Understanding Adaptive Systems: A Statistical/Numerical Approach to Factory Automation and Brain Research , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  P. Holland,et al.  Transfer of inhibition after serial and simultaneous feature negative discrimination training , 1984 .

[9]  P. Holland.  Learning, Thirst and Drinking , 1991 .

[10]  J. Pearce.  Similarity and Discrimination: A Selective Review and a Connectionist Model , 1994 .

[11]  S. Klein,et al.  Pavlovian conditioning and the status of traditional learning theory , 1991 .

[12]  E. Kehoe.  A layered network model of associative learning: learning to learn and configuration. , 1988, Psychological review.

[13]  G. Hall,et al.  Occasion-Setting Training Renders Stimuli More Similar: Acquired Equivalence between the Targets of Feature-Positive Discriminations , 1994, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[14]  R. Rescorla,et al.  Evidence for the hierarchical structure of instrumental learning , 1990 .

[15]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[16]  A Search for Blocking of Occasion Setting Using a Nonexplicit Training Procedure , 1994 .

[17]  P. Holland.  Occasion Setting With Simultaneous Compounds in Rats , 1989 .

[18]  R. Rescorla.  Facilitation based on inhibition , 1988 .

[19]  J. Pearce,et al.  Selective Transfer of Responding in Conditional Discriminations , 1990, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[20]  R. Rescorla,et al.  Transfer of facilitation in the rat , 1986 .

[21]  P. Holland,et al.  Transfer of negative occasion setting and conditioned inhibition across conditioned and unconditioned stimuli. , 1989, Journal of experimental psychology. Animal behavior processes.

[22]  P. Holland,et al.  Conditioning of simultaneous and serial feature-positive discriminations , 1981 .

[23]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[24]  R. Ross.  Relationships between the determinants of performance in serial feature-positive discriminations , 1983 .

[25]  A. R. Wagner,et al.  Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). , 1989 .

[26]  P. Holland.  Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. , 1977, Journal of experimental psychology. Animal behavior processes.

[27]  Ralph R. Miller,et al.  Information processing in animals : memory mechanisms , 1983 .

[28]  P. Holland,et al.  Transfer of inhibition after serial feature negative discrimination training , 1987 .

[29]  M. Gluck,et al.  Context, conditioning, and hippocampal rerepresentation in animal learning. , 1994, Behavioral neuroscience.

[30]  N. Schmajuk,et al.  Stimulus configuration, classical conditioning, and hippocampal function. , 1992, Psychological review.

[31]  A. R. Wagner,et al.  Modulation of a discrete Pavlovian conditioned reflex by a putative emotive Pavlovian conditioned stimulus , 1991 .

[32]  K. Maccorquodale,et al.  Analysis and Integration of Behavioral Units , 1986 .

[33]  R. Rescorla.  Hierarchical Associative Relations in Pavlovian Conditioning and Instrumental Training , 1992 .

[34]  P. Holland.  Feature extinction enhances transfer of occasion setting , 1989 .

[35]  Ralph R. Miller,et al.  Information processing in animals : conditioned inhibition , 1985 .

[36]  M. Bouton,et al.  Context-specificity of target versus feature inhibition in a feature-negative discrimination. , 1994, Journal of experimental psychology. Animal behavior processes.

[37]  P. Holland.  Transfer after Serial Feature Positive Discrimination Training , 1986 .

[38]  J. Pearce,et al.  A Role for Stimulus Generalization in Conditional Discrimination Learning , 1989, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[39]  D. Swartzentruber,et al.  Modulatory mechanisms in Pavlovian conditioning , 1995 .

[40]  J. Pearce.  A model for stimulus generalization in Pavlovian conditioning. , 1987, Psychological review.

[41]  R. Rescorla.  Facilitation and excitation. , 1986 .

[42]  The Effects of Target Salience in Operant Feature Positive Discriminations , 1993 .

[43]  P. Holland.  Temporal determinants of occasion setting in feature-positive discriminations , 1986 .

[44]  T. Davidson.  The nature and function of interoceptive signals to feed: toward integration of physiological and learning perspectives. , 1993, Psychological review.

[45]  M. Bouton,et al.  Analysis of the associative and occasion-setting properties of contexts participating in a Pavlovian discrimination. , 1986 .

[46]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[47]  J. Pearce,et al.  A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980 .

[48]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[49]  M. Bouton.  Conditioning, remembering, and forgetting. , 1994 .

[50]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[51]  D. Booth,et al.  Thirst: Physiological and Psychological Aspects , 1991 .

[52]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .