Reward value effects on timing in the peak procedure

Abstract Three experiments examined the effect of motivational variables on timing in the peak procedure. In Experiment 1, rats received a 60-s peak procedure that was coupled with long-term, between-phase changes in reinforcer magnitude. Increases in reinforcer magnitude produced a leftward shift in the peak that persisted for 20 sessions of training. In a final phase, the rats received lithium chloride-induced aversion prior to testing and a rightward shift in the peak was observed. Experiment 2 confirmed the rightward shift in the peak under lithium chloride devaluation and induced a comparable shift with satiety devaluation. The degree of rightward shift was neither additive nor multiplicative, suggesting that two processes may have contributed. Experiment 3 examined the effect of extinction on peak responding, revealing a decrease in response rate, but no evidence of any change in the timing of responding. The implications of the results for contemporary timing theories are discussed.

[1]  R. Church,et al.  Application of scalar timing theory to individual trials. , 1994 .

[2]  A. Farrar,et al.  Effects of reinforcer magnitude on an animal model of impulsive behavior , 2003, Behavioural Processes.

[3]  C. Buhusi,et al.  Differential effects of methamphetamine and haloperidol on the control of an internal clock. , 2002, Behavioral neuroscience.

[4]  R. Church,et al.  Alternative representations of time, number, and rate , 1990, Cognition.

[5]  Kimberly S. Kirkpatrick,et al.  Temporal learning in random control procedures. , 2004, Journal of experimental psychology. Animal behavior processes.

[6]  Saul Sternberg,et al.  Methods, models, and conceptual issues , 1998 .

[7]  R. Church,et al.  Methamphetamine and time estimation. , 1981, Journal of experimental psychology. Animal behavior processes.

[8]  W. Meck.  Functional and neural mechanisms of interval timing , 2003 .

[9]  Elliot A. Ludvig,et al.  The effects of reinforcer magnitude on timing in rats. , 2007, Journal of the experimental analysis of behavior.

[10]  Ralph R. Miller,et al.  Temporal integration and temporal backward associations in human and nonhuman subjects , 2003, Learning & behavior.

[11]  P. Killeen,et al.  The effects of rate and amount of reinforcement on the speed of the pacemaker in pigeons’ timing behavior , 1991 .

[12]  H. Terrace,et al.  Autoshaping and Conditioning Theory , 1980 .

[13]  Kimberly S. Kirkpatrick,et al.  Interval duration effects on blocking in appetitive conditioning , 2006, Behavioural Processes.

[14]  C. Wynne,et al.  Effects of d-amphetamine on the behavior of pigeons exposed to the peak procedure , 2006, Behavioural Processes.

[15]  Kimberly S. Kirkpatrick,et al.  CS-US Interval Duration and the US-Preexposure Effect , 2004 .

[16]  J. Gibbon,et al.  Temporal control during maintenance and extinction of conditioned keypecking in ring doves , 1999 .

[17]  R. Church,et al.  Representation of time , 1990, Cognition.

[18]  C. Buhusi.  Dopaminergic Mechanisms of Interval Timing and Attention , 2003 .

[19]  R. Rescorla.  A Pavlovian Analysis of Goal-Directed Behavior. , 1987 .

[20]  H. M. Jenkins,et al.  Blocking of a CS-US Association by a US-US Association , 1988 .

[21]  A. Odum,et al.  Effects of prefeeding, intercomponent-interval food, and extinction on temporal discrimination and pacemaker rate , 2006, Behavioural Processes.

[22]  J. Horvitz,et al.  Amphetamine affects the start of responding in the peak interval timing task , 2007, Behavioural Processes.

[23]  R. Church,et al.  Effects of repeated acquisitions and extinctions on response rate and pattern. , 2006, Journal of experimental psychology. Animal behavior processes.

[24]  J H Wearden,et al.  Feeling the Heat: Body Temperature and the Rate of Subjective Time, Revisited , 1995, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[25]  R. Church,et al.  The pattern of responding after extensive extinction , 2006, Learning & behavior.

[26]  M. Bouton,et al.  Importance of trials versus accumulating time across trials in partially reinforced appetitive conditioning. , 2003, Journal of experimental psychology. Animal behavior processes.

[27]  S. Roberts,et al.  Isolation of an internal clock. , 1981, Journal of experimental psychology. Animal behavior processes.

[28]  R. Bevins,et al.  One-trial context fear conditioning as a function of the interstimulus interval , 1995 .

[29]  P. Balsam,et al.  Timing at the Start of Associative Learning , 2002 .

[30]  P. Killeen,et al.  A behavioral theory of timing , 1988 .

[31]  J. Nevin,et al.  Response strength and temporal control in fixed-interval schedules , 2000 .

[32]  R. Church,et al.  The differential effects of haloperidol and methamphetamine on time estimation in the rat , 2004, Psychopharmacology.

[33]  Edward E. Smith,et al.  An Invitation to cognitive science , 1997 .

[34]  Alex Kacelnik,et al.  Timing and Foraging: Gibbon's Scalar Expectancy Theory and Optimal Patch Exploitation , 2002 .

[35]  M. Çevik.  Effects of methamphetamine on duration discrimination. , 2003, Behavioral neuroscience.

[36]  J. Wearden,et al.  Reinforcer concentration effects on a fixed-interval schedule , 2004, Behavioural Processes.

[37]  J. Richards,et al.  Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons. , 2002, Journal of the experimental analysis of behavior.

[38]  Ralph R. Miller,et al.  The role of temporal variables in inhibition produced through extinction , 2003, Learning & behavior.

[39]  Stimulus and temporal cues in classical conditioning. , 2000 .

[40]  Kimberly S. Kirkpatrick,et al.  Overshadowing and stimulus duration. , 2007, Journal of experimental psychology. Animal behavior processes.

[41]  M. Bateson,et al.  Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions , 2006, Psychopharmacology.

[42]  C. Gallistel,et al.  The Symbolic Foundations of Conditioned Behavior , 2002 .

[43]  Ralph R. Miller,et al.  Time as content in Pavlovian conditioning , 1998, Behavioural Processes.

[44]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[45]  J. Wearden,et al.  Speeding up and (…relatively…) slowing down an internal clock in humans , 1999, Behavioural Processes.

[46]  Michael Tomasello,et al.  Ape and Human Cognition , 2010 .

[47]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[48]  Ewart A. C. Thomas,et al.  Cognitive processing and time perception , 1975 .

[49]  W. Schultz.  Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[50]  Claudette Fortin,et al.  Attentional Time-Sharing in Interval Timing , 2003 .

[51]  J. Staddon,et al.  Time and memory: towards a pacemaker-free theory of interval timing. , 1999, Journal of the experimental analysis of behavior.

[52]  W. Meck.  Selective adjustment of the speed of internal clock and memory processes. , 1983, Journal of experimental psychology. Animal behavior processes.

[53]  C. Bradshaw,et al.  Choice Between Delayed Reinforcers in an Adjusting-Delay Schedule: The Effects of Absolute Reinforcer Size and Deprivation Level , 1992, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[54]  Scott W. Brown.  Attentional resources in timing: Interference effects in concurrent temporal and nontemporal working memory tasks , 1997, Perception & psychophysics.

[55]  W. Meck.  Neuropharmacology of timing and time perception. , 1996, Brain research. Cognitive brain research.

[56]  Kimberly S. Kirkpatrick,et al.  Independent effects of stimulus and cycle duration in conditioning: The role of timing processes , 2000 .

[57]  C. Wynne,et al.  Effects of D-amphetamine on temporal discrimination in pigeons , 2005, Behavioural pharmacology.

[58]  C Fortin,et al.  Expecting a break in time estimation: attentional time-sharing without concurrent processing. , 2000, Journal of experimental psychology. Human perception and performance.

[59]  Kimberly S. Kirkpatrick,et al.  Are separate theories of conditioning and timing necessary? , 1998, Behavioural Processes.

[60]  Robert L. Boughner,et al.  Apparent Incentive Contrast Effects in Autoshaping with Rats , 2001 .

[61]  K. Cheng,et al.  Analysis of single trials in pigeons' timing performance. , 1993 .

[62]  N. Spear,et al.  Long-term retention of a conditioned taste aversion in preweanling and adult rats , 1980 .

[63]  Kimberly S. Kirkpatrick,et al.  Packet theory of conditioning and timing , 2002, Behavioural Processes.

[64]  B. Balleine,et al.  Instrumental Performance following Reinforcer Devaluation Depends upon Incentive Learning , 1991 .

[65]  A. Blaisdell,et al.  Temporal coding in conditioned inhibition: analysis of associative structure of inhibition. , 2004, Journal of experimental psychology. Animal behavior processes.

[66]  J. Maes,et al.  One-trial aversive conditioning to contextual cues: Effects of time of shock presentation on freezing during conditioning and testing , 1992 .

[67]  C. Gallistel,et al.  Sources of variability and systematic error in mouse timing behavior. , 2004, Journal of experimental psychology. Animal behavior processes.

[68]  Kimberly S. Kirkpatrick,et al.  Tracking of the expected time to reinforcement in temporal conditioning procedures , 2003, Learning & behavior.