Brain reward circuitry beyond the mesolimbic dopamine system: A neurobiological theory

Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area.

[1]  N. Chaudhri,et al.  Complex interactions between nicotine and nonpharmacological stimuli reveal multiple roles for nicotine in reinforcement , 2006, Psychopharmacology.

[2]  S. J. Shammah-Lagnado,et al.  Origin of the dopaminergic innervation of the central extended amygdala and accumbens shell: A combined retrograde tracing and immunohistochemical study in the rat , 2002, The Journal of comparative neurology.

[3]  H. Bokor,et al.  Possible glutamatergic/aspartatergic projections to the supramammillary nucleus and their origins in the rat studied by selective [3H]D-aspartate labelling and immunocytochemistry , 2002, Neuroscience.

[4]  A. Phillips,et al.  The role of dopamine in intracranial self-stimulation of the ventral tegmental area , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  K. Montgomery The role of the exploratory drive in learning. , 1954, Journal of comparative and physiological psychology.

[6]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[7]  L. Swanson,et al.  Organization of projections from the basomedial nucleus of the amygdala: A PHAL study in the rat , 1996, The Journal of comparative neurology.

[8]  L. Swanson,et al.  Connections of the rat lateral septal complex 1 Published on the World Wide Web on 2 June 1997. 1 , 1997, Brain Research Reviews.

[9]  P. Shizgal,et al.  A portrait of the substrate for self-stimulation. , 1981, Psychological review.

[10]  A. Siegel,et al.  Efferent connections of the septal area in the rat: An analysis utilizing retrograde and anterograde transport methods , 1977, Brain Research.

[11]  Pressor responses to electrical and chemical stimulation of the rat brain A10 dopaminergic system , 1994, Neuroscience Letters.

[12]  C. Saper Organization of cerebral cortical afferent systems in the rat. II. Magnocellular basal nucleus , 1984, The Journal of comparative neurology.

[13]  W. Pan,et al.  The supramammillary area: its organization, functions and relationship to the hippocampus , 2004, Progress in Neurobiology.

[14]  P. Kalivas Addiction as a pathology in prefrontal cortical regulation of corticostriatal habit circuitry , 2008, Neurotoxicity Research.

[15]  C. Nemeroff,et al.  Muscimol injections into the median raphe nucleus increase serum ACTH and corticosterone concentrations via a nonserotonergic mechanism , 1991, Pharmacology Biochemistry and Behavior.

[16]  O. Hikosaka,et al.  Lateral habenula as a source of negative reward signals in dopamine neurons , 2007, Nature.

[17]  G. Holstege,et al.  Amygdaloid projections to the mesencephalon, pons and medulla oblongata in the cat , 1978, Experimental Brain Research.

[18]  V. David,et al.  Differentiation of intracranial morphine self-administration behavior among five brain regions in mice , 1994, Pharmacology Biochemistry and Behavior.

[19]  S. Ikemoto,et al.  The midbrain raphe nuclei mediate primary reinforcement via GABAA receptors , 2007, The European journal of neuroscience.

[20]  S. Ikemoto,et al.  Role of Dopamine D1 and D2 Receptors in the Nucleus Accumbens in Mediating Reward , 1997, The Journal of Neuroscience.

[21]  L. Hersh,et al.  Patterns of direct projections from the hippocampus to the medial septum-diagonal band complex: Anterograde tracing with Phaseolus vulgaris leucoagglutinin combined with immunohistochemistry of choline acetyltransferase , 1991, Neuroscience.

[22]  P. Cazala,et al.  Self-administration of morphine into the lateral hypothalamus in the mouse , 1987, Brain Research.

[23]  W. Mcbride,et al.  Intracranial Self-Administration of Cocaine within the Posterior Ventral Tegmental Area of Wistar Rats: Evidence for Involvement of Serotonin-3 Receptors and Dopamine Neurons , 2005, Journal of Pharmacology and Experimental Therapeutics.

[24]  D. Berlyne NOVELTY AND CURIOSITY AS DETERMINANTS OF EXPLORATORY BEHAVIOUR1 , 1950 .

[25]  R E Harlan,et al.  The accumbens: beyond the core-shell dichotomy. , 1997, The Journal of neuropsychiatry and clinical neurosciences.

[26]  S. Ikemoto,et al.  Regional Differences Within the Rat Ventral Tegmental Area for Muscimol Self-Infusions , 1998, Pharmacology Biochemistry and Behavior.

[27]  Mark J. Thomas,et al.  Neuroplasticity in the mesolimbic dopamine system and cocaine addiction , 2008, British journal of pharmacology.

[28]  J. Stellar,et al.  N-Methyl-d-aspartic acid-induced lesions of the nucleus accumbens and/or ventral pallidum fail to attenuate lateral hypothalamic self-stimulation reward , 1994, Brain Research.

[29]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[30]  S. Ikemoto,et al.  Administration of the GABAA receptor antagonist picrotoxin into rat supramammillary nucleus induces c-Fos in reward-related brain structures. Supramammillary picrotoxin and c-Fos expression , 2010, BMC Neuroscience.

[31]  P. Shizgal,et al.  Fos-like immunoreactivity in forebrain regions following self-stimulation of the lateral hypothalamus and the ventral tegmental area , 1997, Behavioural Brain Research.

[32]  J. D. Olmos,et al.  The projection field of the stria terminalis in the rat brain. An experimental study , 1972, The Journal of comparative neurology.

[33]  M. Waraczynski The central extended amygdala network as a proposed circuit underlying reward valuation , 2006, Neuroscience & Biobehavioral Reviews.

[34]  S. Ikemoto,et al.  Dual Role of Medial A10 Dopamine Neurons in Affective Encoding , 2008, Neuropsychopharmacology.

[35]  M. Le Moal,et al.  Neurobiological mechanisms for opponent motivational processes in addiction , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  S. Ikemoto,et al.  Microinjections of dopamine agonists and cocaine elevate plasma corticosterone: dissociation effects among the ventral and dorsal striatum and medial prefrontal cortex , 1998, Brain Research.

[37]  Terry E. Robinson,et al.  Reticulo-cortical activity and behavior: A critique of the arousal theory and a new synthesis , 1981, Behavioral and Brain Sciences.

[38]  Larry W. Swanson,et al.  Brain Maps: Structure of the Rat Brain , 1992 .

[39]  Ethan S. Bromberg-Martin,et al.  Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards , 2009, Neuron.

[40]  W. Cowan,et al.  An autoradiographic study of the efferent connections of the lateral hypothalamic area in the rat , 1979, The Journal of comparative neurology.

[41]  Fengli Jiang,et al.  Nicotinic receptor mechanism in supramammillary nucleus mediates physiological regulation of neural activity in dorsal hippocampal field CA1 of anaesthetized rat , 2009, Hippocampus.

[42]  M. Witter,et al.  Organization of the projections from the subiculum to the ventral striatum in the rat. A study using anterograde transport of Phaseolus vulgaris leucoagglutinin , 1987, Neuroscience.

[43]  D. Hebb Drives and the C.N.S. (conceptual nervous system). , 1955, Psychological review.

[44]  A. Wauquier Brain-stimulation Reward , 1976 .

[45]  S. Ikemoto Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex , 2007, Brain Research Reviews.

[46]  Andrew A. Marino,et al.  ELECTRICAL STIMULATION OF , 2005 .

[47]  J. Scheel-Krüger,et al.  GABA in the ventral tegmental area: differential regional effects on locomotion, aggression and food intake after microinjection of GABA agonists and antagonists. , 1979, Life sciences.

[48]  Satoshi Ikemoto,et al.  Mapping of chemical trigger zones for reward , 2004, Neuropharmacology.

[49]  E. Valenstein The Anatomical Locus of Reinforcement , 1966 .

[50]  J. Scheel-Krüger,et al.  Evidence that GABA in the nucleus dorsalis raphé induces stimulation of locomotor activity and eating behavior. , 1979, Life sciences.

[51]  H. Fibiger,et al.  Extinction and recovery of cocaine self-administration following 6-hydroxydopamine lesions of the nucleus accumbens , 1980, Pharmacology Biochemistry and Behavior.

[52]  Jesse Jackson,et al.  Septohippocampal properties of N‐methyl‐D‐aspartate‐induced theta‐band oscillation and synchrony , 2007, Synapse.

[53]  H. Fibiger Drugs and reinforcement mechanisms: a critical review of the catecholamine theory. , 1978, Annual review of pharmacology and toxicology.

[54]  C. Saper,et al.  Efferent connections of the parabrachial nucleus in the rat , 1980, Brain Research.

[55]  W. Willis,et al.  The efferent projections of the periaqueductal gray in the rat: A Phaseolus vulgaris‐leucoagglutinin study. I. Ascending projections , 1995, The Journal of comparative neurology.

[56]  J. Hopfield,et al.  From molecular to modular cell biology , 1999, Nature.

[57]  J. Trowill,et al.  Sniffing and motivated behavior in the rat. , 1971, Physiology & behavior.

[58]  P. Rompré,et al.  Topographical Fos induction within the ventral midbrain and projection sites following self-stimulation of the posterior mesencephalon , 2008, Neuroscience.

[59]  R. Solomon,et al.  An Opponent-Process Theory of Motivation , 1978 .

[60]  N. White,et al.  6-Hydroxydopamine lesions of the olfactory tubercle do not alter (+)-amphetamine-conditioned place preference , 1990, Behavioural Brain Research.

[61]  J. Yeomans Two substrates for medial forebrain bundle self-stimulation: Myelinated axons and dopamine axons , 1989, Neuroscience & Biobehavioral Reviews.

[62]  D. Jacobowitz,et al.  Strong positive reward in median raphe: specific inhibition bypara-chlorophenylalanine , 1975, Brain Research.

[63]  J. L. Kavanau,et al.  Behavior of Captive White-Footed Mice , 1967, Science.

[64]  R. Vertes A PHA‐L analysis of ascending projections of the dorsal raphe nucleus in the rat , 1991, The Journal of comparative neurology.

[65]  K. Deisseroth,et al.  optical technologies for probing neural signals and systems , 2007 .

[66]  G. Koob,et al.  Disruption of cocaine self-administration following 6-hydroxydopamine lesions of the ventral tegmental area in rats , 1982, Pharmacology Biochemistry and Behavior.

[67]  N. Goeders,et al.  Cortical dopaminergic involvement in cocaine reinforcement. , 1983, Science.

[68]  H. Hurwitz Conditioned responses in rats reinforced by light , 1956 .

[69]  R. Wise,et al.  Rewarding Effects of the Cholinergic Agents Carbachol and Neostigmine in the Posterior Ventral Tegmental Area , 2002, The Journal of Neuroscience.

[70]  K. Nakano,et al.  Efferent projections of infralimbic and prelimbic areas of the medial prefrontal cortex in the Japanese monkey, Macaca fuscata , 2001, Brain Research.

[71]  H. Kimura,et al.  The efferent projections of the rat lateral habenular nucleus revealed by the PHA-L anterograde tracing method , 1988, Brain Research.

[72]  Y. Hosoya,et al.  Brainstem projections from the lateral hypothalamic area in the rat, as studied with autoradiography , 1981, Neuroscience Letters.

[73]  L. Wiklund,et al.  Afferents to the median raphe nucleus of the rat: Retrograde cholera toxin and wheat germ conjugated horseradish peroxidase tracing, and selectived-[3H]aspartate labelling of possible excitatory amino acid inputs , 1990, Neuroscience.

[74]  R. Vertes,et al.  Autoradiographic analysis of ascending projections from the pontine and mesencephalic reticular formation and the median raphe nucleus in the rat , 1988, The Journal of comparative neurology.

[75]  M. Le Moal,et al.  Is the dopaminergic mesocorticolimbic system necessary for intracranial self-stimulation? Biochemical and behavioral studies from A10 cell bodies and terminals. , 1979, Behavioral and neural biology.

[76]  M. Fanselow,et al.  Effects of amygdala, hippocampus, and periaqueductal gray lesions on short- and long-term contextual fear. , 1993, Behavioral neuroscience.

[77]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[78]  D. Ruggiero,et al.  Afferents to the midline thalamus issue collaterals to the nucleus tractus solitarii: an anatomical basis for thalamic and visceral reflex integration , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[79]  L. Wiklund,et al.  Possible excitatory amino acid afferents to nucleus raphe dorsalis of the rat investigated with retrograde wheat germ agglutinin and d-[3H]aspartate tracing , 1985, Brain Research.

[80]  L. Swanson,et al.  The projections of the ventral tegmental area and adjacent regions: A combined fluorescent retrograde tracer and immunofluorescence study in the rat , 1982, Brain Research Bulletin.

[81]  Anthony G. Phillips,et al.  Electrical stimulation of reward sites in the ventral tegmental area increases dopamine transmission in the nucleus accumbens of the rat , 1993, Behavioural Brain Research.

[82]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[83]  A. Kelley,et al.  Effects of peripheral and central dopamine blockade on lateral hypothalamic self-stimulation: Evidence for both reward and motor deficits , 1983, Pharmacology Biochemistry and Behavior.

[84]  A. Dickinson,et al.  Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction , 2009, Behavioural Brain Research.

[85]  R. Roth,et al.  Topographical organization of the efferent projections of the medial prefrontal cortex in the rat: An anterograde tract‐tracing study with Phaseolus vulgaris leucoagglutinin , 1989, The Journal of comparative neurology.

[86]  S. E. Gartside,et al.  GABA receptor modulation of 5-HT neuronal firing: characterization and effect of moderate in vivo variations in glucocorticoid levels , 2004, Neurochemistry International.

[87]  W. Willis,et al.  The efferent projections of the periaqueductal gray in the rat: A Phaseolus vulgaris‐leucoagglutinin study. II. Descending projections , 1995, The Journal of comparative neurology.

[88]  O. Phillipson The cytoarchitecture of the interfascicular nucleus and ventral tegmental area of tsai in the rat , 1979, The Journal of comparative neurology.

[89]  G. Mogenson,et al.  Self-stimulation of the olfactory bulb , 1969 .

[90]  R. Vertes,et al.  Injections of muscimol into the median raphe nucleus produce hippocampal theta rhythm in the urethane anesthetized rat , 1995, Psychopharmacology.

[91]  P. Rompré,et al.  Localization of reward-relevant neurons in the pontine tegmentum: a moveable electrode mapping study , 1989, Brain Research.

[92]  James L Olds Self-Stimulation of the Brain , 1958, Science.

[93]  M. Morales,et al.  Glutamatergic neurons are present in the rat ventral tegmental area , 2007, The European journal of neuroscience.

[94]  L. Hersh,et al.  Prefrontal cortical projections to the cholinergic neurons in the basal forebrain , 1991, The Journal of comparative neurology.

[95]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[96]  I. McGregor,et al.  Rewarding brain stimulation induces only sparse Fos-like immunoreactivity in dopaminergic neurons , 1998, Neuroscience.

[97]  A. Spring,et al.  Ventral midbrain stimulation, blood pressure responses and their relation to the dopaminergic nigro-striatal pathways , 1975, Pflügers Archiv.

[98]  J. F. Dashiell A quantitative demonstration of animal drive. , 1925 .

[99]  S. Ikemoto,et al.  A five‐minute, but not a fifteen‐minute, conditioning trial duration induces conditioned place preference for cocaine administration into the olfactory tubercle , 2005, Synapse.

[100]  R. Vertes,et al.  Pharmacological suppression of the median raphe nucleus with serotonin1a agonists, 8-OH-DPAT and buspirone, produces hippocampal theta rhythm in the rat , 1994, Neuroscience.

[101]  R. Solomon,et al.  An opponent-process theory of motivation. I. Temporal dynamics of affect. , 1974, Psychological review.

[102]  Mark G. Baxter,et al.  The Rostromedial Tegmental Nucleus (RMTg), a GABAergic Afferent to Midbrain Dopamine Neurons, Encodes Aversive Stimuli and Inhibits Motor Responses , 2009, Neuron.

[103]  R. Wise,et al.  Brain stimulation reward and dopamine terminal fields. I. Caudate-putamen, nucleus accumbens and amygdala , 1984, Brain Research.

[104]  T. Durkin,et al.  Self-administration of the GABAA antagonist bicuculline into the ventral tegmental area in mice: dependence on D2 dopaminergic mechanisms , 1997, Psychopharmacology.

[105]  D. Corbett,et al.  Regional neuroleptic microinjections indicate a role for nucleus accumbens in lateral hypothalamic self-stimulation reward , 1989, Brain Research.

[106]  C. Saper,et al.  Convergence of autonomic and limbic connections in the insular cortex of the rat , 1982, The Journal of comparative neurology.

[107]  M. Sidman,et al.  The effect of food and water deprivation upon intracranial self-stimulation. , 1957, Journal of comparative and physiological psychology.

[108]  A. Cools Mesolimbic dopamine and its control of locomotor activity in rats: differences in pharmacology and light/dark periodicity between the olfactory tubercle and the nucleus accumbens , 2004, Psychopharmacology.

[109]  J. Sprague,et al.  Progress in physiological psychology , 1966 .

[110]  INTENSE VASOCONSTRICTION AND BRADYCARDIA EVOKED BY STIMULATION OF NEURONES WITHIN THE MIDBRAIN VENTRAL TEGMENTUM OF THE RABBIT , 1983, Clinical and experimental pharmacology & physiology.

[111]  Hong-wei Dong,et al.  Projections from bed nuclei of the stria terminalis, dorsomedial nucleus: Implications for cerebral hemisphere integration of neuroendocrine, autonomic, and drinking responses , 2006, The Journal of comparative neurology.

[112]  R. Vertes,et al.  Injections of excitatory amino acid antagonists into the median raphe nucleus produce hippocampal theta rhythm in the urethane-anesthetized rat , 1994, Brain Research.

[113]  R. Wise Catecholamine theories of reward: A critical review , 1978, Brain Research.

[114]  L. Swanson,et al.  The organization of neural inputs to the medial preoptic nucleus of the rat , 1986, The Journal of comparative neurology.

[115]  R. Vertes,et al.  Projections of the median raphe nucleus in the rat , 1999, The Journal of comparative neurology.

[116]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[117]  I. Shim,et al.  Dissociation of hippocampal serotonin release and locomotor activity following pharmacological manipulations of the median raphe nucleus , 1997, Behavioural Brain Research.

[118]  H. Fibiger,et al.  On the role of ascending catecholaminergic systems in intravenous self-administration of cocaine , 1977, Pharmacology Biochemistry and Behavior.

[119]  J. Janas,et al.  Effects of knife-cut lesions of the medial forebrain bundle in self-stimulating rats. , 1987, Behavioral neuroscience.

[120]  R. Trifunovic,et al.  Nonserotonergic control of nucleus accumbens dopamine metabolism by the median raphe nucleus , 1992, Pharmacology Biochemistry and Behavior.

[121]  L. Wiklund,et al.  Projections from the medial septum and diagonal band of Broca to the dorsal and central superior raphe nuclei: a non-cholinergic pathway , 2004, Experimental Brain Research.

[122]  R. Henderson,et al.  Positive reinforcement of the bar-pressing response by a light stimulus following dark operant pretests with no after effect. , 1955, Journal of comparative and physiological psychology.

[123]  M. Olds Hypothalamic substrate for the positive reinforcing properties of morphine in the rat , 1979, Brain Research.

[124]  W. Mcbride,et al.  Intracranial Self-Administration of Ethanol within the Ventral Tegmental Area of Male Wistar Rats: Evidence for Involvement of Dopamine Neurons , 2004, The Journal of Neuroscience.

[125]  S. Ikemoto,et al.  Primary Reinforcing Effects of Nicotine Are Triggered from Multiple Regions Both Inside and Outside the Ventral Tegmental Area , 2006, The Journal of Neuroscience.

[126]  Bryan Kolb,et al.  Structural plasticity associated with exposure to drugs of abuse , 2004, Neuropharmacology.

[127]  R. Wise,et al.  Rewarding Effects of AMPA Administration into the Supramammillary or Posterior Hypothalamic Nuclei But Not the Ventral Tegmental Area , 2004, The Journal of Neuroscience.

[128]  S. Ikemoto,et al.  Rewarding injections of the cholinergic agonist carbachol into the ventral tegmental area induce locomotion and c-Fos expression in the retrosplenial area and supramammillary nucleus , 2003, Brain Research.

[129]  L. Swanson,et al.  Projections of the medial preoptic nucleus: A Phaseolus vulgaris leucoagglutinin anterograde tract‐tracing study in the rat , 1988, The Journal of comparative neurology.

[130]  T. Borg,et al.  Effects of intracranial self-stimulation on selected physiological variables in rats. , 1993, The American journal of physiology.

[131]  R. Wise,et al.  Effects of nucleus accumbens amphetamine on lateral hypothalamic brain stimulation reward , 1988, Brain Research.

[132]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[133]  Ting-kai Li,et al.  The reinforcing properties of salsolinol in the ventral tegmental area: evidence for regional heterogeneity and the involvement of serotonin and dopamine. , 2008, Alcoholism, clinical and experimental research.

[134]  P. Shizgal,et al.  Fos-like immunoreactivity in the caudal diencephalon and brainstem following lateral hypothalamic self-stimulation , 1997, Behavioural Brain Research.

[135]  J. Besson,et al.  Organization of efferent projections from the parabrachial area to the hypothalamus: a Phaseolus vulgaris‐leucoagglutinin study in the rat , 1997, The Journal of comparative neurology.

[136]  A. Pérez-Villalba Rhythms of the Brain, G. Buzsáki. Oxford University Press, Madison Avenue, New York (2006), Price: GB £42.00, p. 448, ISBN: 0-19-530106-4 , 2008 .

[137]  A. Ghysen,et al.  Afferent Projections , 2002 .

[138]  D. Menétrey,et al.  Cholinergic and peptidergic projections from the medial septum and the nucleus of the diagonal band of broca to dorsal hippocampus, cingulate cortex and olfactory bulb: A combined wheatgerm agglutinin-apohorseradish peroxidase-gold immunohistochemical study , 1989, Neuroscience.

[139]  S. Lorens Effect of lesions in the central nervous system on lateral hypothalamic self-stimulation in the rat. , 1966, Journal of Comparative and Physiological Psychology.

[140]  R. Wise,et al.  Rewarding and Psychomotor Stimulant Effects of Endomorphin-1: Anteroposterior Differences within the Ventral Tegmental Area and Lack of Effect in Nucleus Accumbens , 2002, The Journal of Neuroscience.

[141]  J. Olds Hypothalamic substrates of reward. , 1962, Physiological reviews.

[142]  J. B. Ranck,et al.  Which elements are excited in electrical stimulation of mammalian central nervous system: A review , 1975, Brain Research.

[143]  H. Groenewegen,et al.  Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat , 1992, The Journal of comparative neurology.

[144]  J. Stewart,et al.  Studies in Light-Reinforced Behaviour III. the Effect of Continuous, Zero and Fixed-Ratio Reinforcement , 1958 .

[145]  James L Olds,et al.  A motivational analysis of the reticular activating system. , 1960, Electroencephalography and clinical neurophysiology.

[146]  Larry W Swanson,et al.  Projections from the rhomboid nucleus of the bed nuclei of the stria terminalis: Implications for cerebral hemisphere regulation of ingestive behaviors , 2003, The Journal of comparative neurology.

[147]  S. Ikemoto,et al.  The Functional Divide for Primary Reinforcement of D-Amphetamine Lies between the Medial and Lateral Ventral Striatum: Is the Division of the Accumbens Core, Shell, and Olfactory Tubercle Valid? , 2005, The Journal of Neuroscience.

[148]  G. B. Kish Learning when the onset of illumination is used as reinforcing stimulus. , 1955, Journal of comparative and physiological psychology.

[149]  A. Monaco,et al.  Self-injection of amphetamine directly into the brain , 2004, Psychopharmacology.

[150]  S. Ikemoto,et al.  Localization of brain reinforcement mechanisms: intracranial self-administration and intracranial place-conditioning studies , 1999, Behavioural Brain Research.

[151]  E. Valenstein,et al.  Reinforcing Brain Stimulation in Competition with Water Reward and Shock Avoidance , 1962, Science.

[152]  J. Stellar,et al.  The effects of excitotoxin lesions of the lateral hypothalamus on self-stimulation reward , 1991, Brain Research.

[153]  P. Sanberg,et al.  Neuroscience and Biobehavioral Reviews , 2002, Physiology & Behavior.

[154]  R. Vertes,et al.  Ascending projections of the posterior nucleus of the hypothalamus: PHA‐L analysis in the rat , 1995, The Journal of comparative neurology.

[155]  Albert-László Barabási,et al.  Error and attack tolerance of complex networks , 2000, Nature.

[156]  H. Fibiger,et al.  Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: A retro‐ and antero‐grade transport and immunohistochemical study , 1992, The Journal of comparative neurology.

[157]  Linda J. Porrino,et al.  The role of the olfactory tubercle in the effects of cocaine, morphine and brain-stimulation reward , 1991, Brain Research.

[158]  S. Ikemoto,et al.  Ventral striatal anatomy of locomotor activity induced by cocaine, D-amphetamine, dopamine and D1/D2 agonists 1 1 Part of the present results was presented at the 29th meeting of the Society for Neuroscience at Miami Beach, FL, USA, 1999. , 2002, Neuroscience.

[159]  B. Kocsis,et al.  The supramammillary nucleus: Is it necessary for the mediation of hippocampal theta rhythm? , 1995, Neuroscience.

[160]  Tanemichi Chiba,et al.  Efferent projections of the infralimbic (area 25) region of the medial prefrontal cortex in the rat: an anterograde tracer PHA-L study , 1991, Brain Research.

[161]  S. Ikemoto,et al.  The relationship between self-stimulation and sniffing in rats: does a common brain system mediate these behaviors? , 1994, Behavioural Brain Research.

[162]  M. A. Klitenick,et al.  Evidence against serotonin involvement in the hyperactivity produced by injections of muscimol into the median raphe nucleus , 1987, Pharmacology Biochemistry and Behavior.

[163]  J. Büttner-Ennever The Rat Brain in Stereotaxic Coordinates, 3rd edn. By George Paxinos and Charles Watson. (Pp. xxxiii+80; illustrated; £$69.95 paperback; ISBN 0 12 547623; comes with CD‐ROM.) San Diego: Academic Press. 1996. , 1997 .

[164]  R. Gaykema,et al.  Cortical projection patterns of the medial septum‐diagonal band complex , 1990, The Journal of comparative neurology.

[165]  P. Garris,et al.  Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation , 1999, Nature.

[166]  A GABAergic mechanism in the medial septum influences cortical arousal and locomotor activity but not a previously learned spatial discrimination task , 1994, Neuroscience Letters.

[167]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[168]  R. Llinás,et al.  Afferent projections to the mammillary complex of the rat, with special reference to those from surrounding hypothalamic regions , 1992, The Journal of comparative neurology.

[169]  A. Routtenberg,et al.  Effects of the availability of rewarding septal and hypothalamic stimulation on bar pressing for food under conditions of deprivation. , 1965, Journal of comparative and physiological psychology.

[170]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[171]  A. Phillips,et al.  Decreased intracranial self-stimulation after neuroleptics or 6-hydroxydopamine: Evidence for mediation by motor deficits rather than by reduced reward , 1976, Psychopharmacology.

[172]  S. S. Winans,et al.  An experimental study of the ventral striatum of the golden hamster. II. Neuronal connections of the olfactory tubercle , 1980, The Journal of comparative neurology.

[173]  W. Cowan,et al.  The connections of the septal region in the rat , 1979, The Journal of comparative neurology.

[174]  R. Wise,et al.  Two Brain Sites for Cannabinoid Reward , 2006, The Journal of Neuroscience.

[175]  L. Decorte,et al.  Self-administration of the GABAA agonist muscimol into the medial septum: dependence on dopaminergic mechanisms , 2008, Psychopharmacology.

[176]  Gully Burns,et al.  Projections from the subfornical region of the lateral hypothalamic area , 2005, The Journal of comparative neurology.

[177]  S. Haber The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[178]  James L Olds,et al.  Approach‐avoidance analysis of rat diencephalon , 1963, The Journal of comparative neurology.

[179]  P. Shizgal,et al.  Prolonged rewarding stimulation of the rat medial forebrain bundle: neurochemical and behavioral consequences. , 2006, Behavioral neuroscience.

[180]  S. Haber,et al.  Organization of the output of the ventral striatopallidal system in the rat: Ventral pallidal efferents , 1993, Neuroscience.

[181]  James L Olds Satiation effects in self-stimulation of the brain. , 1958, Journal of comparative and physiological psychology.

[182]  R. C. Pierce,et al.  The mesolimbic dopamine system: The final common pathway for the reinforcing effect of drugs of abuse? , 2006, Neuroscience & Biobehavioral Reviews.

[183]  I. Crawford,et al.  GABAergic agents on the medial septal nucleus affect hippocampal theta rhythm and acetylcholine utilization , 1984, Brain Research.

[184]  W. Nauta,et al.  Efferent connections of the ventral pallidum: Evidence of a dual striato pallidofugal pathway , 1985, The Journal of comparative neurology.

[185]  L. Heimer The Olfactory Cortex and the Ventral Striatum , 1978 .

[186]  R. Wise,et al.  A psychomotor stimulant theory of addiction. , 1987, Psychological review.

[187]  K. Carr Augmentation of drug reward by chronic food restriction Behavioral evidence and underlying mechanisms , 2002, Physiology & Behavior.

[188]  P. Rompré,et al.  Pontine and mesencephalic substrates of self-stimulation , 1985, Brain Research.

[189]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[190]  A Routtenberg,et al.  Self-stimulation in the frontal cortex of Rattus norvegicus. , 1972, Behavioral biology.

[191]  S. Lorens,et al.  Intra-median raphe infusions of muscimol and the substance P analogue DiMe-C7 produce hyperactivity: role of serotonin neurons , 1987, Behavioural Brain Research.

[192]  C. Saper,et al.  Bed nucleus of the stria terminalis: Cytoarchitecture, immunohistochemistry, and projection to the parabrachial nucleus in the rat , 1989, The Journal of comparative neurology.

[193]  S. Glickman,et al.  A biological theory of reinforcement. , 1967, Psychological review.

[194]  T. Robinson,et al.  Signalled versus unsignalled intravenous amphetamine: large differences in the acute psychomotor response and sensitization , 1996, Brain Research.

[195]  P. Shizgal,et al.  Increased ipsilateral expression of Fos following lateral hypothalamic self-stimulation , 1996, Brain Research.

[196]  C. Gallistel,et al.  Destruction of the medial forebrain bundle caudal to the site of stimulation reduces rewarding efficacy but destruction rostrally does not. , 1996, Behavioral neuroscience.

[197]  I. Gritti,et al.  Projections of GABAergic and cholinergic basal forebrain and GABAergic preoptic‐anterior hypothalamic neurons to the posterior lateral hypothalamus of the rat , 1994, The Journal of comparative neurology.

[198]  Ting-kai Li,et al.  Cocaine Is Self-Administered into the Shell but Not the Core of the Nucleus Accumbens of Wistar Rats , 2002, Journal of Pharmacology and Experimental Therapeutics.

[199]  Anthony G. Phillips,et al.  Reward, Motivation, Cognition: Psychobiology of Mesotelencephalic Dopamine Systems , 2011 .

[200]  S. Ikemoto,et al.  Amphetamine Administration into the Ventral Striatum Facilitates Behavioral Interaction with Unconditioned Visual Signals in Rats , 2010, PloS one.

[201]  I. Pavlov,et al.  Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex , 2010, Annals of Neurosciences.

[202]  Larry W Swanson,et al.  Projections from bed nuclei of the stria terminalis, anteromedial area: Cerebral hemisphere integration of neuroendocrine, autonomic, and behavioral aspects of energy balance , 2006, The Journal of comparative neurology.

[203]  M. Marcinkiewicz,et al.  CNS connections with the median raphe nucleus: Retrograde tracing with WGA‐apoHRP‐gold complex in the rat , 1989, The Journal of comparative neurology.

[204]  Intracranial self-administration of MDMA into the ventral striatum of the rat: differential roles of the nucleus accumbens shell, core, and olfactory tubercle , 2008, Psychopharmacology.

[205]  C. H. Vanderwolf,et al.  Limbic-diencephalic mechanisms of voluntary movement. , 1971, Psychological review.

[206]  E. Nestler,et al.  Topographical organization of GABAergic neurons within the ventral tegmental area of the rat , 2007, Synapse.

[207]  L. Swanson The Rat Brain in Stereotaxic Coordinates, George Paxinos, Charles Watson (Eds.). Academic Press, San Diego, CA (1982), vii + 153, $35.00, ISBN: 0 125 47620 5 , 1984 .

[208]  E. Bullmore,et al.  Society for Neuroscience Abstracts , 1997 .

[209]  W. Nauta,et al.  Efferent connections of the substantia nigra and ventral tegmental area in the rat , 1979, Brain Research.

[210]  G. Koob Drugs of abuse: anatomy, pharmacology and function of reward pathways. , 1992, Trends in pharmacological sciences.

[211]  R. Vertes PHA‐L analysis of projections from the supramammillary nucleus in the rat , 1992, The Journal of comparative neurology.

[212]  R. Wise,et al.  Habit-forming actions of nomifensine in nucleus accumbens , 1995, Psychopharmacology.

[213]  P. Dutar,et al.  Cortical projections of the nucleus of the diagonal band of broca and of the substantia innominata in the rat: An anatomical study using the anterograde transport of a conjugate of wheat germ agglutinin and horseradish peroxidase , 1984, Neuroscience.

[214]  K. E. Moore,et al.  Destruction of dopaminergic nerve terminals in nucleus accumbens: Effect on d-amphetamine self-administration , 1979, Pharmacology Biochemistry and Behavior.

[215]  H. Groenewegen,et al.  Organization of the thalamostriatal projections in the rat, with special emphasis on the ventral striatum , 1990, The Journal of comparative neurology.

[216]  O. Phillipson Afferent projections to the ventral tegmental area of Tsai and interfascicular nucleus: A horseradish peroxidase study in the rat , 1979, The Journal of comparative neurology.

[217]  R. Wise,et al.  Rewarding Actions of Phencyclidine and Related Drugs in Nucleus Accumbens Shell and Frontal Cortex , 1996, The Journal of Neuroscience.

[218]  S. Ikemoto,et al.  Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. , 1996, Behavioral neuroscience.

[219]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[220]  J I Morrell,et al.  An autoradiographic study of projections ascending from the midbrain central gray, and from the region lateral to it, in the rat , 1985, The Journal of comparative neurology.

[221]  S. Ikemoto,et al.  The GABAB receptor agonist baclofen administered into the median and dorsal raphe nuclei is rewarding as shown by intracranial self-administration and conditioned place preference in rats , 2010, Psychopharmacology.

[222]  K. Zyo,et al.  Neuroanatomical study of afferent projections to the supramammillary nucleus of the rat , 1993, Anatomy and Embryology.

[223]  S. Ikemoto Involvement of the Olfactory Tubercle in Cocaine Reward: Intracranial Self-Administration Studies , 2003, The Journal of Neuroscience.

[224]  R. Moore,et al.  Efferent projections of the paraventricular thalamic nucleus in the rat , 1995, The Journal of comparative neurology.

[225]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[226]  P. Shizgal Toward a cellular analysis of intracranial self-stimulation: Contributions of collision studies , 1989, Neuroscience & Biobehavioral Reviews.

[227]  B. Westerink,et al.  The pharmacology of mesolimbic dopamine neurons: a dual-probe microdialysis study in the ventral tegmental area and nucleus accumbens of the rat brain , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[228]  J. Mitrofanis,et al.  Organization of the basal forebrain projection to the thalamus in rats , 1999, Neuroscience Letters.

[229]  W. Nauta,et al.  Efferent connections of the habenular nuclei in the rat , 1979, The Journal of comparative neurology.

[230]  6-OHDA-treated weanling rats show normal neuroleptic sensitivity as adults on LHSS , 1993, Pharmacology Biochemistry and Behavior.

[231]  K. Deisseroth,et al.  Circuit-breakers: optical technologies for probing neural signals and systems , 2007, Nature Reviews Neuroscience.

[232]  Kuei Yuan Tseng,et al.  Formation of accumbens GluR2-lacking AMPA receptors mediates incubation of cocaine craving , 2008, Nature.

[233]  C. Saper,et al.  Organization of cerebral cortical afferent systems in the rat. II. Hypothalamocortical projections , 1985, The Journal of comparative neurology.

[234]  S. Geisler,et al.  Afferents of the ventral tegmental area in the rat‐anatomical substratum for integrative functions , 2005, The Journal of comparative neurology.

[235]  S. Dworkin,et al.  Neuropharmacological assessment of cocaine self-administration into the medial prefrontal cortex , 1986, Pharmacology Biochemistry and Behavior.

[236]  R. Vertes,et al.  Descending projections of the posterior nucleus of the hypothalamus: Phaseolus vulgaris leucoagglutinin analysis in the rat , 1996, The Journal of comparative neurology.

[237]  M. Segal Brain stem afferents to the rat medial septum. , 1976, The Journal of physiology.

[238]  P. Veinante,et al.  Afferents to the GABAergic tail of the ventral tegmental area in the rat , 2009, The Journal of comparative neurology.

[239]  A. Routtenberg,et al.  Brainstem pathways of reward. , 1969, Journal of comparative and physiological psychology.

[240]  N. Mizuno,et al.  The sites of origin of dopaminergic afferent fibers to the lateral habenular nucleus in the rat , 1993, The Journal of comparative neurology.

[241]  Olaf Sporns,et al.  Modeling the Impact of Lesions in the Human Brain , 2009, PLoS Comput. Biol..

[242]  P. Young The role of affective processes in learning and motivation. , 1959, Psychological review.

[243]  S. J. Shammah-Lagnado,et al.  Organization of ventral tegmental area projections to the ventral tegmental area–nigral complex in the rat , 2008, Neuroscience.

[244]  W. K. Honig Operant behavior : areas of research and application , 1966 .

[245]  James M. Murphy,et al.  Self-infusion of GABA(A) antagonists directly into the ventral tegmental area and adjacent regions. , 1997, Behavioral Neuroscience.

[246]  T. Chiba,et al.  Afferent and efferent connections of the medial preoptic area in the rat: A WGA-HRP study , 1985, Brain Research Bulletin.

[247]  T. R. Stratford,et al.  Studies on the behavioral activation produced by stimulation of GABAB receptors in the median raphe nucleus , 1993, Behavioural Brain Research.

[248]  J. Bizot,et al.  Hippocampal theta rhythm in anesthetized rats: role of AMPA glutamate receptors. , 1999, Neuroreport.

[249]  T. Jhou,et al.  The mesopontine rostromedial tegmental nucleus: A structure targeted by the lateral habenula that projects to the ventral tegmental area of Tsai and substantia nigra compacta , 2009, The Journal of comparative neurology.

[250]  C. Saper,et al.  Organization of cortical, basal forebrain, and hypothalamic afferents to the parabrachial nucleus in the rat , 1990, The Journal of comparative neurology.

[251]  S. Ikemoto The Supramammillary Nucleus Mediates Primary Reinforcement via GABAA Receptors , 2005, Neuropsychopharmacology.

[252]  G. Di Chiara,et al.  Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[253]  D. S. Zahm,et al.  The ventral striatopallidothalamic projection: I. The striatopallidal link originating in the striatal parts of the olfactory tubercle , 1987, The Journal of comparative neurology.

[254]  P. Fletcher,et al.  Median raphe injections of 8-OH-DPAT lower frequency thresholds for lateral hypothalamic self-stimulation , 1995, Pharmacology Biochemistry and Behavior.

[255]  J. Bolam,et al.  Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli , 2004, Science.

[256]  T. Shippenberg,et al.  Neuroanatomical substrates mediating the aversive effects of D-1 dopamine receptor antagonists , 2005, Psychopharmacology.

[257]  J. Panksepp,et al.  Analysis of the relationships between self-stimulation sniffing and brain-stimulation sniffing , 1992, Physiology & Behavior.

[258]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[259]  Vanderwolf Ch Limbic-diencephalic mechanisms of voluntary movement. , 1971 .

[260]  J. Fallon,et al.  Catecholamine innervation of the basal forebrain IV. Topography of the dopamine projection to the basal forebrain and neostriatum , 1978, The Journal of comparative neurology.

[261]  J. Cornwall,et al.  Afferent and efferent connections of the laterodorsal tegmental nucleus in the rat , 1990, Brain Research Bulletin.

[262]  P. Garris,et al.  Simultaneous dopamine and single-unit recordings reveal accumbens GABAergic responses: implications for intracranial self-stimulation. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[263]  W. Nauta,et al.  Afferent connections of the habenular nuclei in the rat. A horseradish peroxidase study, with a note on the fiber‐of‐passage problem , 1977, The Journal of comparative neurology.

[264]  T. Robinson,et al.  Influence of novel versus home environments on sensitization to the psychomotor stimulant effects of cocaine and amphetamine , 1995, Brain Research.

[265]  C. Gallistel Motivation as central organizing process: the psychophysical approach to its functional and neurophysiological analysis. , 1975, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[266]  Ting-kai Li,et al.  Regional Heterogeneity for the Intracranial Self-Administration of Ethanol and Acetaldehyde within the Ventral Tegmental Area of Alcohol-Preferring (P) Rats: Involvement of Dopamine and Serotonin , 2005, Neuropsychopharmacology.

[267]  R. Vertes Differential projections of the infralimbic and prelimbic cortex in the rat , 2004, Synapse.

[268]  Ralph Norgren,et al.  Projections of the Parabrachial Nucleus in the Old World Monkey , 2000, Experimental Neurology.

[269]  J. Jhamandas,et al.  Efferent projections from the parabrachial nucleus demonstrated with the anterograde tracer Phaseolus vulgaris leucoagglutinin , 1993, Brain Research Bulletin.

[270]  M. Luskin,et al.  The topographic organization of associational fibers of the olfactory system in the rat, including centrifugal fibers to the olfactory bulb , 1983, The Journal of comparative neurology.

[271]  P. Fletcher,et al.  Conditioned place preference induced by microinjection of 8-OH-DPAT into the dorsal or median raphe nucleus , 2005, Psychopharmacology.

[272]  W. Mcbride,et al.  The Reinforcing Actions of a Serotonin-3 Receptor Agonist within the Ventral Tegmental Area: Evidence for Subregional and Genetic Differences and Involvement of Dopamine Neurons , 2007, Journal of Pharmacology and Experimental Therapeutics.

[273]  O. Hikosaka Basal ganglia — possible role in motor coordination and learning , 1991, Current Opinion in Neurobiology.

[274]  James L Olds,et al.  Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. , 1954, Journal of comparative and physiological psychology.

[275]  R. Vertes,et al.  Projections of the dorsal raphe nucleus to the brainstem: PHA‐L analysis in the rat , 1994, The Journal of comparative neurology.

[276]  A. Norena,et al.  Differential involvement of the lateral and medial divisions of the septal area on spatial learning processes as revealed by intracranial self-administration of morphine in mice , 1998, Behavioural Brain Research.

[277]  R. Wise Neuroleptics and operant behavior: The anhedonia hypothesis , 1982, Behavioral and Brain Sciences.

[278]  N. McNaughton,et al.  Mapping the differential effects of procaine on frequency and amplitude of reticularly elicited hippocampal rhythmical slow activity , 1993, Hippocampus.

[279]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[280]  E. Tolman Purpose and cognition: the determiners of animal learning. , 1925 .