Addiction as a Computational Process Gone Awry

Addictive drugs have been hypothesized to access the same neurophysiological mechanisms as natural learning systems. These natural learning systems can be modeled through temporal-difference reinforcement learning (TDRL), which requires a reward-error signal that has been hypothesized to be carried by dopamine. TDRL learns to predict reward by driving that reward-error signal to zero. By adding a noncompensable drug-induced dopamine increase to a TDRL model, a computational model of addiction is constructed that over-selects actions leading to drug receipt. The model provides an explanation for important aspects of the addiction literature and provides a theoretic view-point with which to address other aspects.

[1]  Jstor,et al.  Invention in the Industrial Research Laboratory , 1963, Journal of Political Economy.

[2]  H E M.  Journal of Neurophysiology , 1938, Nature.

[3]  W. Brogden.  Annual Review of Psychology , 1957 .

[4]  B. Pitt.  Psychopharmacology , 1968, Mental Health.

[5]  H. J. Gamble.  Trends in Neurosciences , 1980 .

[6]  S. Lea,et al.  Contemporary Animal Learning Theory, Anthony Dickinson. Cambridge University Press, Cambridge (1981), xii, +177 pp. £12.50 hardback, £3.95 paperback , 1981 .

[7]  M. Kuhar,et al.  Cocaine receptors on dopamine transporters are related to self-administration of cocaine. , 1987, Science.

[8]  Kevin M. Murphy,et al.  A Theory of Rational Addiction , 1988, Journal of Political Economy.

[9]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[10]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[11]  M. Woodward,et al.  Self-titration of nicotine: evidence from the Scottish Heart Health Study. , 1993, Addiction.

[12]  M. Carroll,et al.  The economic context of drug and non-drug reinforcers affects acquisition and maintenance of drug-reinforced behavior and withdrawal effects. , 1993, Drug and alcohol dependence.

[13]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[14]  Joel L. Davis,et al.  In : Models of Information Processing in the Basal Ganglia , 2008 .

[15]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  P. Pini.  Addiction , 1996, The Lancet.

[17]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[18]  John T. Williams,et al.  Nicotine activates and desensitizes midbrain dopamine neurons , 1997, Nature.

[19]  T. Bonhoeffer,et al.  Current opinion in neurobiology , 1997, Current Opinion in Neurobiology.

[20]  E. Bullmore,et al.  Society for Neuroscience Abstracts , 1997 .

[21]  Michael Grossman,et al.  The demand for cocaine by young adults: a rational addiction approach. , 1998, Journal of health economics.

[22]  W. Schultz.  Predictive reward signal of dopamine neurons. , 1998, Journal of neurophysiology.

[23]  P. Kalivas,et al.  Neuroadaptations involved in amphetamine and cocaine addiction. , 1998, Drug and alcohol dependence.

[24]  M. Picciotto.  Common aspects of the action of nicotine and other drugs of abuse. , 1998, Drug and alcohol dependence.

[25]  W. Schultz,et al.  A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task , 1999, Neuroscience.

[26]  G. Chiara.  Drug addiction as dopamine-dependent associative learning disorder , 1999 .

[27]  W. Bickel,et al.  Toward a behavioral economic understanding of drug dependence: delay discounting processes. , 2001, Addiction.

[28]  A. Dickinson,et al.  The neuropsychological basis of addictive behaviour , 2001, Brain Research Reviews.

[29]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[30]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[31]  M. Nader,et al.  Progression of Changes in Dopamine Transporter Binding Site Density as a Result of Cocaine Self-Administration in Rhesus Monkeys , 2001, The Journal of Neuroscience.

[32]  G. Koob,et al.  Drug Addiction, Dysregulation of Reward, and Allostasis , 2001, Neuropsychopharmacology.

[33]  J. E. Mazur,et al.  Hyperbolic value addition and general models of animal choice. , 2001, Psychological review.

[34]  J S Fowler,et al.  Role of dopamine in drug reinforcement and addiction in humans: results from imaging studies. , 2002, Behavioural pharmacology.

[35]  C. Bradberry.  Book Review: Dynamics of Extracellular Dopamine in the Acute and Chronic Actions of Cocaine , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[36]  M. Bouton.  Context, ambiguity, and unlearning: sources of relapse after behavioral extinction , 2002, Biological Psychiatry.

[37]  Samuel M. McClure,et al.  A computational substrate for incentive salience , 2003, Trends in Neurosciences.

[38]  S. Grossberg,et al.  Psychological Review , 2003 .

[39]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[40]  S. Mangiavacchi,et al.  Mechanisms by which Dopamine Receptors May Influence Synaptic Plasticity , 2003, Annals of the New York Academy of Sciences.

[41]  N. Daw,et al.  Reinforcement learning models of the dopamine system and their behavioral implications , 2003 .

[42]  S. Henriksen,et al.  Opiate state controls bi-directional reward signaling via GABAA receptors in the ventral tegmental area , 2004, Nature Neuroscience.

[43]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[44]  B. Everitt,et al.  Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration , 2004, Science.

[45]  S. Higgins,et al.  Clinical implications of reinforcement as a determinant of substance use disorders. , 2004, Annual review of psychology.

[46]  David Belin,et al.  Evidence for Addiction-like Behavior in the Rat , 2004, Science.

[47]  M. Carroll,et al.  A concurrently available nondrug reinforcer prevents the acquisition or decreases the maintenance of cocaine-reinforced behavior , 2004, Psychopharmacology.

[48]  Ericka Stricklin-Parker,et al.  Ann , 2005 .

[49]  M. Nader,et al.  Effects of increasing the magnitude of an alternative reinforcer on drug choice in a discrete-trials choice procedure , 2005, Psychopharmacology.

[50]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[51]  R. K. Simpson.  Nature Neuroscience , 2022 .