The neuroscience of impulsive and self-controlled decisions.

Impulsiveness and self-control are two antagonistic choice patterns. Whereas impulsive decisions can be exemplified by the preference for a small, immediate over a large, delayed reward, self-control can be characterised as the opposite preference order. This review focuses on current developments in investigating the neuroscience of impulsiveness and self-control, with particular emphasis on the neuroanatomy, psychopharmacology, and electrophysiology of this class of decision making. The role of the avian forebrain in representing and processing temporal reward discounting - a chief psychological mechanism responsible for producing impulsiveness - is especially highlighted. In addition to its role in impulsive decision making, the avian forebrain also appears to be involved in processing the key functions required for action- and self-control. In particular, recent electrophysiological studies indicate that single forebrain neurons reflect aspects of response omission strategy and the temporal scheduling of response withholding when execution of action needs to be controlled. In conclusion, the significant advances in this field of research may help to explain neuropathologies that are characterised by exaggerated impulsivity, or lack of self-control, as for instance attention deficit disorders, frontal lobe syndrome, drug addiction, or pathological gambling.

[1]  L. Wilkinson,et al.  Measuring impulsivity in mice using a novel operant delayed reinforcement task: effects of behavioural manipulations and d-amphetamine , 2003, Psychopharmacology.

[2]  Joseph D. Allen,et al.  The effects of total and subtotal prefrontal cortex lesions on the timing ability of the rat , 1997, Psychobiology.

[3]  J. Richards,et al.  Delay of gratification and delay discounting in rats , 2002, Behavioural Processes.

[4]  J. Fuster Cortex and mind : unifying cognition , 2003 .

[5]  R. Romo,et al.  Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. , 2003, Cerebral cortex.

[6]  J. Evenden The pharmacology of impulsive behaviour in rats VII: the effects of serotonergic agonists and antagonists on responding under a discrimination task using unreliable visual stimuli , 1999, Psychopharmacology.

[7]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[8]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[9]  T. Kalenscher,et al.  Single Units in the Pigeon Brain Integrate Reward Amount and Time-to-Reward in an Impulsive Choice Task , 2005, Current Biology.

[10]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[11]  T. Matsushima,et al.  Localized Lesion of Caudal Part of Lobus Parolfactorius Caused Impulsive Choice in the Domestic Chick: Evolutionarily Conserved Function of Ventral Striatum , 2003, The Journal of Neuroscience.

[12]  M. Shadlen,et al.  Representation of Time by Neurons in the Posterior Parietal Cortex of the Macaque , 2003, Neuron.

[13]  C. Bucherelli,et al.  Analysis of mnemonic processing by means of totally reversible neural inactivations. , 1997, Brain research. Brain research protocols.

[14]  J. E. Mazur Estimation of indifference points with an adjusting-delay procedure. , 1988, Journal of the experimental analysis of behavior.

[15]  J. Bizot,et al.  Serotonin and tolerance to delay of reward in rats , 1999, Psychopharmacology.

[16]  Jonathan D. Cohen,et al.  Neuroeconomics: cross-currents in research on decision-making , 2006, Trends in Cognitive Sciences.

[17]  H. Damasio,et al.  Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. , 2000, Brain : a journal of neurology.

[18]  W. Senn,et al.  Climbing Neuronal Activity as an Event-Based Cortical Representation of Time , 2004, The Journal of Neuroscience.

[19]  A. Logue Research on self-control: An integrating framework , 1988, Behavioral and Brain Sciences.

[20]  Daniel Durstewitz,et al.  Self-Organizing Neural Integrator Predicts Interval Times through Climbing Activity , 2003, The Journal of Neuroscience.

[21]  J. Evenden The pharmacology of impulsive behaviour in rats V: the effects of drugs on responding under a discrimination task using unreliable visual stimuli , 1999, Psychopharmacology.

[22]  J. Evenden Varieties of impulsivity , 1999, Psychopharmacology.

[23]  T. Robbins,et al.  The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats , 2000, Psychopharmacology.

[24]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[25]  T. R. Wade,et al.  Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats , 2000, Psychopharmacology.

[26]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[27]  T. Robbins,et al.  Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice , 2004, The Journal of Neuroscience.

[28]  Gerald E. Hough,et al.  Avian brains and a new understanding of vertebrate brain evolution , 2005, Nature Reviews Neuroscience.

[29]  E. Basar,et al.  Brain oscillations in perception and memory. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  I. Divac,et al.  The prefrontal 'cortex' in the pigeon. Behavioral evidence. , 1982, Brain, behavior and evolution.

[31]  J. E. Mazur,et al.  A comparison of delays and ratio requirements in self-control choice. , 1986, Journal of the experimental analysis of behavior.

[32]  J. Leander,et al.  Selective Serotonin Reuptake Inhibitors Decrease Impulsive Behavior as Measured by an Adjusting Delay Procedure in the Pigeon , 2002, Neuropsychopharmacology.

[33]  T. Kalenscher,et al.  Neural architecture of choice behaviour in a concurrent interval schedule , 2003, The European journal of neuroscience.

[34]  H. de Wit,et al.  Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats , 1999, Psychopharmacology.

[35]  T. Robbins,et al.  Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. , 2006, Cerebral cortex.

[36]  Gerald E. Hough,et al.  Revised nomenclature for avian telencephalon and some related brainstem nuclei , 2004, The Journal of comparative neurology.

[37]  M. Rilling,et al.  Reinforcement delay and reinforcement rate as determinants of schedule preference , 1965 .

[38]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[39]  D. Cross,et al.  Subjective probability and delay. , 1991, Journal of the experimental analysis of behavior.

[40]  O. Güntürkün,et al.  Afferent and efferent connections of the caudolateral neostriatum in the pigeon (Columba livia): A retro‐ and anterograde pathway tracing study , 1999, The Journal of comparative neurology.

[41]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[42]  T. Kalenscher,et al.  Neural correlates of a default response in a delayed go/no-go task. , 2005, Journal of the experimental analysis of behavior.

[43]  Onur Güntürkün,et al.  Working Memory Neurons in Pigeons , 2002, The Journal of Neuroscience.

[44]  E. Basar Memory as the "whole brain work": a large-scale model based on "oscillations in super-synergy". , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[45]  J. Richards,et al.  Delay discounting and probability discounting as related to cigarette smoking status in adults , 2004, Behavioural Processes.

[46]  I. Divac,et al.  The Prefrontal 'Cortex' in the Pigeon , 1982 .

[47]  T. Robbins,et al.  Impulsive Choice Induced in Rats by Lesions of the Nucleus Accumbens Core , 2001, Science.

[48]  J. Evenden,et al.  The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement , 1996, Psychopharmacology.

[49]  T. Robbins,et al.  Lesions to the subthalamic nucleus decrease impulsive choice but impair autoshaping in rats: the importance of the basal ganglia in Pavlovian conditioning and impulse control , 2005, The European journal of neuroscience.

[50]  D. S. Grant Symmetrical and asymmetrical coding of food and no-food samples in delayed matching in pigeons , 1991 .

[51]  J. Evenden,et al.  The pharmacology of impulsive behaviour in rats VI: the effects of ethanol and selective serotonergic drugs on response choice with varying delays of reinforcement , 1999, Psychopharmacology.

[52]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.