The effects of reinforcer magnitude on timing in rats.

The relation between reinforcer magnitude and timing behavior was studied using a peak procedure. Four rats received multiple consecutive sessions with both low and high levels of brain stimulation reward (BSR). Rats paused longer and had later start times during sessions when their responses were reinforced with low-magnitude BSR. When estimated by a symmetric Gaussian function, peak times also were earlier; when estimated by a better-fitting asymmetric Gaussian function or by analyzing individual trials, however, these peak-time changes were determined to reflect a mixture of large effects of BSR on start times and no effect on stop times. These results pose a significant dilemma for three major theories of timing (SET, MTS, and BeT), which all predict no effects for chronic manipulations of reinforcer magnitude. We conclude that increased reinforcer magnitude influences timing in two ways: through larger immediate after-effects that delay responding and through anticipatory effects that elicit earlier responding.

[1]  J. Durbin,et al.  Testing for serial correlation in least squares regression. II. , 1950, Biometrika.

[2]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[3]  James L Olds Self-Stimulation of the Brain , 1958, Science.

[4]  J M MARTIN,et al.  The relation of amount of reinforcement to performance under a fixed-in-terval schedule. , 1959, Journal of the experimental analysis of behavior.

[5]  A. Routtenberg,et al.  Effects of the availability of rewarding septal and hypothalamic stimulation on bar pressing for food under conditions of deprivation. , 1965, Journal of comparative and physiological psychology.

[6]  D. Meltzer,et al.  Quantity of reinforcement and fixed-interval performance , 1968 .

[7]  J. Staddon,et al.  Reinforcement omission on fixed-interval schedules. , 1969, Journal of the experimental analysis of behavior.

[8]  B A Schneider,et al.  A two-state analysis of fixed-interval responding in the pigeon. , 1969, Journal of the experimental analysis of behavior.

[10]  J. Staddon Effect of reinforcement duration on fixed-interval responding. , 1970, Journal of the experimental analysis of behavior.

[11]  D. Fallon,et al.  Behavioral aftereffects of reinforcement and its omission as a function of reinforcement magnitude. , 1973, Journal of the experimental analysis of behavior.

[12]  H. Akaike A new look at the statistical model identification , 1974 .

[13]  G. Davey,et al.  Effects of reinforcement magnitude on interval and ratio schedules. , 1974, Journal of the experimental analysis of behavior.

[14]  R. Church,et al.  Bisection of temporal intervals. , 1977, Journal of experimental psychology. Animal behavior processes.

[15]  J. Gibbon Scalar expectancy theory and Weber's law in animal timing. , 1977 .

[16]  S. Roberts,et al.  Isolation of an internal clock. , 1981, Journal of experimental psychology. Animal behavior processes.

[17]  R. Nieuwenhuys,et al.  The medial forebrain bundle of the rat. I. General introduction , 1982, The Journal of comparative neurology.

[18]  A. Phillips,et al.  Differential effects of physostigmine on cues produced by electrical stimulation of the ventral tegmental area using two discrimination procedures , 1987, Pharmacology Biochemistry and Behavior.

[19]  A. Phillips,et al.  Dissociation of dopaminergic and non-dopaminergic substrates for cues produced by electrical stimulation of the ventral tegmental area , 1987, Pharmacology Biochemistry and Behavior.

[20]  M. Bonem,et al.  Elucidating the effects of reinforcement magnitude. , 1988, Psychological bulletin.

[21]  P. Killeen,et al.  A behavioral theory of timing , 1988 .

[22]  R. Wise,et al.  Brain dopamine and reward. , 1989, Annual review of psychology.

[23]  R. Church,et al.  Representation of time , 1990, Cognition.

[24]  Warren H. Meck,et al.  Symmetrical and asymmetrical sources of variance in temporal generalization , 1991 .

[25]  P. Killeen,et al.  The effects of rate and amount of reinforcement on the speed of the pacemaker in pigeons’ timing behavior , 1991 .

[26]  C. Gallistel,et al.  Measuring the subjective magnitude of brain stimulation reward by titration with rate of reward. , 1991, Behavioral neuroscience.

[27]  Peter R. Killeen,et al.  Adjusting the pacemaker , 1991 .

[28]  L. Green,et al.  Economic substitutability of electrical brain stimulation, food, and water. , 1991, Journal of the experimental analysis of behavior.

[29]  T. A. Mark,et al.  Subjective reward magnitude of medial forebrain stimulation as a function of train duration and pulse frequency. , 1993, Behavioral neuroscience.

[30]  K. Cheng,et al.  Analysis of single trials in pigeons' timing performance. , 1993 .

[31]  R. Church,et al.  Application of scalar timing theory to individual trials. , 1994 .

[32]  P. Shizgal,et al.  Competition and summation between rewarding effects of sucrose and lateral hypothalamic stimulation in the rat. , 1994, Behavioral neuroscience.

[33]  Lewis A. Bizo,et al.  Pacemaker rate in the behavioral theory of timing , 1994 .

[34]  P. Shizgal,et al.  Effects of sodium depletion on competition and summation between rewarding effects of salt and lateral hypothalamic stimulation in the rat. , 1994, Behavioral neuroscience.

[35]  C. Gallistel,et al.  Saturation of subjective reward magnitude as a function of current and pulse frequency. , 1994, Behavioral neuroscience.

[36]  M. Zeiler,et al.  Temporal control in fixed-interval schedules. , 1994, Journal of the experimental analysis of behavior.

[37]  Peter R. Killeen,et al.  Categorical scaling of time: implications for clock-counter models. , 1995 .

[38]  J. Gibbon,et al.  Timing processes in the reinforcement-omission effect , 1995 .

[39]  W. Meck Neuropharmacology of timing and time perception. , 1996, Brain research. Cognitive brain research.

[40]  J. Staddon,et al.  Time and memory: towards a pacemaker-free theory of interval timing. , 1999, Journal of the experimental analysis of behavior.

[41]  J. Nevin,et al.  Response strength and temporal control in fixed-interval schedules , 2000 .

[42]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[43]  J. Staddon,et al.  Habituation, memory and the brain: the dynamics of interval timing , 2002, Behavioural Processes.

[44]  C. Buhusi,et al.  Differential effects of methamphetamine and haloperidol on the control of an internal clock. , 2002, Behavioral neuroscience.

[45]  L. M. Lieving,et al.  Effects of D-amphetamine in a temporal discrimination procedure: selective changes in timing or rate dependency? , 2002, Journal of the experimental analysis of behavior.

[46]  J. Richards,et al.  Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons. , 2002, Journal of the experimental analysis of behavior.

[47]  D. Schaal,et al.  Disruption of temporally organized behavior by morphine. , 2002, Journal of the experimental analysis of behavior.

[48]  Elliot A. Ludvig,et al.  The conditions for temporal tracking under interval schedules of reinforcement. , 2004, Journal of experimental psychology. Animal behavior processes.

[49]  W. Meck,et al.  Differential modulation of clock speed by the administration of intermittent versus continuous cocaine. , 2004, Behavioral neuroscience.

[50]  A. Phillips,et al.  Differential effects of cholinergic drugs on discriminative cues and self-stimulation produced by electrical stimulation of the ventral tegmental area , 2004, Psychopharmacology.

[51]  J. Wearden,et al.  Reinforcer concentration effects on a fixed-interval schedule , 2004, Behavioural Processes.

[52]  C. Gallistel,et al.  Sources of variability and systematic error in mouse timing behavior. , 2004, Journal of experimental psychology. Animal behavior processes.

[53]  R. Church,et al.  The differential effects of haloperidol and methamphetamine on time estimation in the rat , 2004, Psychopharmacology.

[54]  Catalin V Buhusi,et al.  Memory for timing visual and auditory signals in albino and pigmented rats. , 2005, Journal of experimental psychology. Animal behavior processes.

[55]  Elliot A. Ludvig,et al.  The effects of interval duration on temporal tracking and alternation learning. , 2005, Journal of the experimental analysis of behavior.

[56]  C. Wynne,et al.  Effects of D-amphetamine on temporal discrimination in pigeons , 2005, Behavioural pharmacology.

[57]  P. Shizgal,et al.  Prolonged rewarding stimulation of the rat medial forebrain bundle: neurochemical and behavioral consequences. , 2006, Behavioral neuroscience.

[58]  C. Wynne,et al.  Effects of d-amphetamine on the behavior of pigeons exposed to the peak procedure , 2006, Behavioural Processes.