Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement

Abstract. Rationale: The ascending 5-hydroxytryptaminergic (5-HTergic) pathways are believed to be involved in "impulse control". Rats whose 5-HTergic pathways have been destroyed are more liable than intact rats to select a smaller, immediate reinforcer rather than a larger, delayed reinforcer (impulsive choice), and recent evidence indicates that this effect of central 5-HT depletion reflects a change in the rate of time discounting (i.e. a change in the rate at which reinforcers become devalued as a function of delay). Delay of reinforcement and uncertainty of reinforcer delivery are believed to have equivalent effects on choice behaviour. However, it is not known whether central 5-HT depletion affects choice between probabilistic reinforcers. Objective: We examined the effects of central 5-HT depletion on choice behaviour in two experiments: In experiment 1, rats chose between a smaller immediate reinforcer and a larger delayed reinforcer; in experiment 2, rats chose between a smaller certain reinforcer and a larger probabilistic reinforcer. Methods: Rats received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei or sham lesions. They were trained to press two levers for food-pellet reinforcers in discrete-trials schedules. In free-choice trials, selection of lever A resulted in immediate delivery of one food pellet; selection of lever B resulted in delivery of 2 pellets, either following a delay (dB) (experiment 1) or with a probability (pB) less than 1 (experiment 2). Results: In experiment 1, both groups showed declining choice of lever B (%B) as a function of dB. The lesioned group showed shorter indifference delays (D50: the value of dB corresponding to %B=50) than the sham-lesioned group. In experiment 2, both groups showed declining choice of lever B as a function of the odds against delivery of the two-pellet reinforcer, θB (θB=[1/pB]–1). There was no difference between the "indifference odds" (θ50: the value of θB corresponding to %B=50) between the two groups. In both experiments, the levels of 5-HT and 5-hydroxyindoleacetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not altered. Conclusions: These results provide additional evidence that central 5-HTergic mechanisms are involved in time discounting, but provide no evidence for a similar role of 5-HT in rats' sensitivity to probabilistic reinforcement.

[1]  W. Mischel,et al.  Waiting for rewards and punishments: effects of time and probability on choice. , 1967, Journal of personality and social psychology.

[2]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[3]  Jacob H Jacoby Loy D Lytle Serotonin neurotoxins. , 1978, Annals of the New York Academy of Sciences.

[4]  C. M. Bradshaw,et al.  Quantification of Steady-State Operant Behavior , 1982 .

[5]  M Linnoila,et al.  Low cerebrospinal fluid 5-hydroxyindoleacetic acid concentration differentiates impulsive from nonimpulsive violent behavior. , 1983, Life sciences.

[6]  J. Gibbon,et al.  Cognition and behavior in studies of choice , 1986 .

[7]  J. E. Mazur An adjusting procedure for studying delayed reinforcement. , 1987 .

[8]  A. Logue Research on self-control: An integrating framework , 1988, Behavioral and Brain Sciences.

[9]  H. Rachlin Why do People Gamble and Keep Gambling despite Heavy Losses? , 1990 .

[10]  J. Saiz-ruiz,et al.  Serotonin and gambling dependence , 1991 .

[11]  D. Cross,et al.  Subjective probability and delay. , 1991, Journal of the experimental analysis of behavior.

[12]  G. Loewenstein,et al.  Anomalies in Intertemporal Choice: Evidence and an Interpretation , 1992 .

[13]  C. Bradshaw,et al.  Choice Between Delayed Reinforcers in a Discrete-Trials Schedule: The Effect of Deprivation Level , 1992, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[14]  J. E. Mazur Predicting the Strength of a Conditioned Reinforcer: Effects of Delay and Uncertainty , 1993 .

[15]  A. Logue Self-Control: Waiting Until Tomorrow for What You Want Today , 1994 .

[16]  Howard Rachlin,et al.  Self-control: Beyond commitment. , 1995 .

[17]  J. E. Mazur Choice, delay, probability, and conditioned reinforcement , 1997 .

[18]  E. Coccaro,et al.  The neurobiology of impulsive aggression. , 1997, The Psychiatric clinics of North America.

[19]  M. Ho,et al.  Choice between Delayed Reinforcers: Interaction between Delay and Deprivation Level , 1997 .

[20]  P. Ostaszewski Temperament and the Discounting of Delayed and Probabilistic Rewards: Conjoining European and Americ , 1997 .

[21]  M. Ho,et al.  5-Hydroxytryptamine and impulse control: prospects for a behavioural analysis , 1998, Journal of psychopharmacology.

[22]  J. Evenden Impulsivity: a discussion of clinical and experimental findings , 1999, Journal of psychopharmacology.

[23]  H. de Wit,et al.  Delay or probability discounting in a model of impulsive behavior: effect of alcohol. , 1999, Journal of the experimental analysis of behavior.

[24]  J. Bizot,et al.  Serotonin and tolerance to delay of reward in rats , 1999, Psychopharmacology.

[25]  S. Mitchell,et al.  Measures of impulsivity in cigarette smokers and non-smokers , 1999, Psychopharmacology.

[26]  S. Mobini,et al.  Theory and method in the quantitative analysis of ”impulsive choice” behaviour: implications for psychopharmacology , 1999, Psychopharmacology.

[27]  J. Monterosso,et al.  Beyond discounting: possible experimental models of impulse control , 1999, Psychopharmacology.

[28]  M. Ho,et al.  Effect of central 5-hydroxytryptamine depletion on tolerance of delay of reinforcement: evidence from performance in a discrete-trials “time-left” procedure , 1999, Psychopharmacology.

[29]  S. Mobini,et al.  Effect of central 5-hydroxytryptamine depletion on inter-temporal choice: a quantitative analysis , 2000, Psychopharmacology.

[30]  H O Fekjaer,et al.  [Pathological gambling]. , 2001, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.