Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement

The adjusting-delay task introduced by Mazur (Quantitative analyses of behavior: V. The effect of delay and of intervening events on reinforcement value, 1987, pp. 55-73) has been widely used to study choice of delayed reinforcers. This paradigm involves repeated choice between one reinforcer delivered after a fixed delay and another, typically larger, reinforcer delivered after a variable delay; the variable delay is adjusted depending on the subject's choice until an equilibrium point is reached at which the subject is indifferent between the two alternatives. Rats were trained on a version of this task and their behaviour was examined to determine the nature of their sensitivity to the adjusting delay; these analyses included the use of a cross-correlational technique. No clear evidence of sensitivity to the adjusting delay was found. A number of decision rules, some sensitive to the adjusting delay and some not, were simulated and it was observed that some effects usually supposed to be a consequence of delay sensitivity could be generated by delay-independent processes, such as a consistent, unchanging relative preference between the alternatives. Consequently, the use of explicit analysis of delay sensitivity is advocated in future research on delayed reinforcement.

[1]  John M. Gottman,et al.  Time Series Analysis: A Comprehensive Introduction for Social Scientists. , 1983 .

[2]  J. Alonso,et al.  A 20-year study of wintering common crane fluctuations using time series analysis , 1992 .

[3]  J. E. Mazur Choice, delay, probability, and conditioned reinforcement , 1997 .

[4]  K. Lattal,et al.  Response acquisition with delayed reinforcement. , 1990, Journal of experimental psychology. Animal behavior processes.

[5]  J. E. Mazur Tradeoffs among delay, rate, and amount of reinforcement , 2000, Behavioural Processes.

[6]  H. de Wit,et al.  Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats , 1999, Psychopharmacology.

[7]  Richard A. Berk,et al.  Applied Time Series Analysis for the Social Sciences , 1980 .

[8]  S. Mobini,et al.  Theory and method in the quantitative analysis of ”impulsive choice” behaviour: implications for psychopharmacology , 1999, Psychopharmacology.

[9]  C. Bradshaw,et al.  Choice Between Delayed Reinforcers in an Adjusting-Delay Schedule: The Effects of Absolute Reinforcer Size and Deprivation Level , 1992, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[10]  N. Mackintosh The psychology of animal learning , 1974 .

[11]  T. A. Mark,et al.  Kinetics of matching. , 1994, Journal of experimental psychology. Animal behavior processes.

[12]  J. E. Mazur Estimation of indifference points with an adjusting-delay procedure. , 1988, Journal of the experimental analysis of behavior.

[13]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[14]  C. M. Bradshaw,et al.  Quantification of Steady-State Operant Behavior , 1982 .

[15]  D. C. Howell Statistical methods for psychology, 3rd ed. , 1992 .

[16]  G. Grice The relation of secondary reinforcement to delayed reward in visual discrimination learning. , 1948, Journal of experimental psychology.

[17]  Bjarne Stroustrup,et al.  The C++ Programming Language: Special Edition , 2000 .

[18]  T. Robbins,et al.  Dissociable Deficits in the Decision-Making Cognition of Chronic Amphetamine Abusers, Opiate Abusers, Patients with Focal Damage to Prefrontal Cortex, and Tryptophan-Depleted Normal Volunteers: Evidence for Monoaminergic Mechanisms , 1999, Neuropsychopharmacology.

[19]  D. C. Howell Statistical Methods for Psychology , 1987 .

[20]  J. Evenden,et al.  The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement , 1996, Psychopharmacology.

[21]  W. J. Griffiths,et al.  Free-Operant Acquisition with Delayed Reinforcement , 1992 .

[22]  H. de Wit,et al.  Determination of discount functions in rats with an adjusting-amount procedure. , 1997, Journal of the experimental analysis of behavior.

[23]  J. E. Mazur An adjusting procedure for studying delayed reinforcement. , 1987 .

[24]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[25]  M. Ho,et al.  5-Hydroxytryptamine and impulse control: prospects for a behavioural analysis , 1998, Journal of psychopharmacology.

[26]  J. E. Mazur Tests of an equivalence rule for fixed and variable reinforcer delays. , 1984 .

[27]  T. Robbins,et al.  The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats , 2000, Psychopharmacology.

[28]  M. Commons The effect of delay and of intervening events on reinforcement value , 2013 .

[29]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[30]  Bjarne Stroustrup,et al.  C++ Programming Language , 1986, IEEE Softw..

[31]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .