Boredom, Information-Seeking and Exploration

Any adaptive organism faces the choice between taking actions with known benefits (exploitation), and sampling new actions to check for other, more valuable opportunities available (exploration). The latter involves informationseeking, a drive so fundamental to learning and long-term reward that it can reasonably be considered, through evolution or development, to have acquired its own value, independent of immediate reward. Similarly, behaviors that fail to yield information may have come to be associated with aversive experiences such as boredom, demotivation, and task disengagement. In accord with these suppositions, we propose that boredom reflects an adaptive signal for managing the exploration-exploitation tradeoff, in the service of optimizing information acquisition and long-term reward. We tested participants in three experiments, manipulating the information content in their immediate task environment, and showed that increased perceptions of boredom arise in environments in which there is little useful information, and that higher boredom correlates with higher exploration. These findings are the first step toward a model formalizing the relationship between exploration, exploitation and boredom.

[1]  Richard N. Aslin,et al.  The Goldilocks Effect: Human Infants Allocate Attention to Visual Sequences That Are Neither Too Simple Nor Too Complex , 2012, PloS one.

[2]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[3]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[4]  Angela L. Duckworth,et al.  An opportunity cost model of subjective effort and task performance. , 2013, The Behavioral and brain sciences.

[5]  M. Fenske,et al.  The Unengaged Mind , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[7]  J. Gottlieb Attention, Learning, and the Value of Information , 2012, Neuron.

[8]  J. Bensing,et al.  Complaints of Fatigue: Related to Too Much as Well as Too Little External Stimulation? , 1999, Journal of Behavioral Medicine.

[9]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  Andrew G. Barto,et al.  An intrinsic reward mechanism for efficient exploration , 2006, ICML.

[11]  Ethan S. Bromberg-Martin,et al.  Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards , 2009, Neuron.

[12]  Heather C. Lench,et al.  On the Function of Boredom , 2013, Behavioral sciences.

[13]  B. Hayden,et al.  The Psychology and Neuroscience of Curiosity , 2015, Neuron.

[14]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[15]  E. Bjork,et al.  Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. , 2011 .

[16]  Jürgen Schmidhuber,et al.  An intrinsic value system for developing multiple invariant representations with incremental slowness learning , 2013, Front. Neurorobot..

[17]  Peter Bossaerts,et al.  Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings , 2011, PLoS Comput. Biol..

[18]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[19]  Jonathan D. Cohen,et al.  Humans use directed and random exploration to solve the explore-exploit dilemma. , 2014, Journal of experimental psychology. General.

[20]  E. Soetens,et al.  Psychophysiological investigation of vigilance decrement: Boredom or cognitive fatigue? , 2008, Physiology & Behavior.

[21]  A. B. Hill,et al.  Towards a model of boredom. , 1985, British journal of psychology.

[22]  H. Fowler,et al.  Satiation and Curiosity: Constructs for a Drive and Incentive-Motivational Theory of Exploration1 , 1967 .

[23]  Dan Zakay,et al.  Psychological time as information: the case of boredom , 2014, Front. Psychol..