The Wick in the Candle of Learning: Epistemic Curiosity Activates Reward Circuitry and Enhances Memory

Curiosity has been described as the "wick in the candle of learning" but its underlying mechanisms are not well-understood. We scanned subjects with fMRI while they read trivia questions. The level of curiosity when reading questions is correlated with activity in caudate regions previously suggested to be involved in anticipated reward or encoding prediction error. This finding led to a behavioral study showing that subjects spend more scarce resources (either limited tokens, or waiting time) to find out answers when they are more curious. The fMRI also showed that curiosity increases activity in memory areas when subjects guess incorrectly, which suggests that curiosity may enhance memory for surprising new information. This prediction about memory enhancement is confirmed in a behavioral study- higher curiosity in the initial session is correlated with better recall of surprising answers 10 days later.

[1]  D. Berlyne A theory of human curiosity. , 1954, British journal of psychology.

[2]  E. Hess,et al.  Pupil Size as Related to Interest Value of Visual Stimuli , 1960, Science.

[3]  W. S. Peavler,et al.  Incentive effects and pupillary changes in association learning. , 1969, Journal of experimental psychology.

[4]  Peter G. Bergmann,et al.  Albert Einstein: Creator and Rebel , 1972 .

[5]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[6]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[7]  G. Loewenstein The psychology of curiosity: A review and reinterpretation. , 1994 .

[8]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[9]  Karl J. Friston,et al.  Incorporating Prior Knowledge into Image Registration , 1997, NeuroImage.

[10]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[11]  J. Desmond,et al.  Making memories: brain activity that predicts how well visual experience will be remembered. , 1998, Science.

[12]  A. Dale,et al.  Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. , 1998, Science.

[13]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[14]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[15]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[16]  T. Robbins,et al.  Choosing between Small, Likely Rewards and Large, Unlikely Rewards Activates Inferior and Orbital Prefrontal Cortex , 1999, The Journal of Neuroscience.

[17]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[18]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[19]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[20]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[21]  D. Schacter,et al.  On the Tip of the Tongue An Event-Related fMRI Study of Semantic Retrieval Failure and Cognitive Conflict , 2001, Neuron.

[22]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[23]  D. Boussaoud,et al.  Spatial attention and memory versus motor preparation: premotor cortex involvement as revealed by fMRI. , 2002, Journal of neurophysiology.

[24]  K. Paller,et al.  Observing the transformation of experience into memory , 2002, Trends in Cognitive Sciences.

[25]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[26]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[27]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[28]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[29]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[30]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[31]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[32]  R. Wise Dopamine, learning and motivation , 2004, Nature Reviews Neuroscience.

[33]  M. Gluck,et al.  Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. , 2004, Journal of neurophysiology.

[34]  D. D. de Quervain,et al.  The Neural Basis of Altruistic Punishment , 2004, Science.

[35]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[36]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[37]  Todd S Woodward,et al.  The influence of working memory load on phase specific patterns of cortical activity. , 2004, Brain research. Cognitive brain research.

[38]  S. Quartz,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[39]  Kenneth R. Olson,et al.  Induced mood and curiosity , 1987, Cognitive Therapy and Research.

[40]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[41]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[42]  Edward A. Vessel,et al.  Perceptual Pleasure and the Brain , 2006 .

[43]  Colin Camerer,et al.  Social neuroeconomics: the neural circuitry of social preferences , 2007, Trends in Cognitive Sciences.

[44]  P. Dayan,et al.  Differential Encoding of Losses and Gains in the Human Striatum , 2007, The Journal of Neuroscience.

[45]  Erkut Y. Ozbay,et al.  Understanding Overbidding: Using the Neural Circuitry of Reward to Design Economic Auctions , 2008, Science.

[46]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.