Is Difficulty Overrated?: The Effects of Choice, Novelty and Suspense on Intrinsic Motivation in Educational Games

Many game designers aim to optimize difficulty to make games that are "not too hard, not too easy." However, recent experiments have shown that even moderate difficulty can reduce player engagement. The present work investigates other design factors that may account for the purported benefits of difficulty, such as choice, novelty and suspense. These factors were manipulated in three design experiments involving over 20,000 play sessions of an online educational game. The first experiment (n=10,472) randomly assigned some players to a particular level of difficulty but allowed other players to freely choose their difficulty. Moderately difficult levels were most motivating when self-selected; yet, when difficulty was blindly assigned, the easiest games were most motivating. The second experiment (n=5,065) randomly assigned players to differing degrees of novelty. Moderate novelty was optimal, while too much or too little novelty reduced intrinsic motivation. A final experiment (n=6,511) investigated the role of suspense in "close games", where it was found to be beneficial. If difficulty decreases motivation while novelty and suspense increase it, then an implication for educational game designers is to make easy, interesting games that are "not too hard, not too boring."

[1]  Robin Hunicke,et al.  AI for Dynamic Difficulty Adjustment in Games , 2004 .

[2]  Thomas W. Malone,et al.  Toward a Theory of Intrinsically Motivating Instruction , 1981, Cogn. Sci..

[3]  K. Teigen Yerkes-Dodson: A Law for all Seasons , 1994 .

[4]  Kenneth R. Koedinger,et al.  Optimizing challenge in an educational game using large-scale design experiments , 2013, CHI.

[5]  Staffan Björk,et al.  Patterns In Game Design , 2004 .

[6]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[7]  Radek Pelánek,et al.  Impact of Adaptive Educational System Behaviour on Student Motivation , 2015, AIED.

[8]  Jeffrey C. Ely,et al.  Suspense and Surprise , 2015, Journal of Political Economy.

[9]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[10]  Zoran Popovic,et al.  Experimentation, Human Factors , 2022 .

[11]  D. Berlyne Novelty, complexity, and hedonic value , 1970 .

[12]  Eleanor O'Rourke,et al.  Brain points: a growth mindset incentive structure boosts persistence in an educational game , 2014, CHI.

[13]  P. Kline The New Psychometrics: Science, Psychology and Measurement , 1998 .

[14]  Peta Wyeth,et al.  Operationalising and Evaluating Sub-Optimal and Optimal Play Experiences through Challenge-Skill Manipulation , 2016, CHI.

[15]  S. Harter Pleasure Derived from Challenge and the Effects of Receiving Grades on Children's Difficulty Level Choices. , 1978 .

[16]  M. Lepper,et al.  Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. , 1996 .

[17]  Angela L. Duckworth,et al.  An opportunity cost model of subjective effort and task performance. , 2013, The Behavioral and brain sciences.

[18]  M. Csíkszentmihályi,et al.  Optimal experience: Psychological studies of flow in consciousness. , 1988 .

[19]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[20]  Georgios N. Yannakakis,et al.  TOWARDS OPTIMIZING ENTERTAINMENT IN COMPUTER GAMES , 2007, Appl. Artif. Intell..

[21]  Mu Wu,et al.  No One Likes to Lose , 2014, J. Media Psychol. Theor. Methods Appl..

[22]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[23]  Stéphane Natkin,et al.  Measuring the level of difficulty in single player video games , 2011, Entertain. Comput..

[24]  B. Weiner An attributional theory of achievement motivation and emotion. , 1985, Psychological review.

[25]  R. Hockey The Psychology of Fatigue: Work, Effort and Control , 2013 .

[26]  Christina E. Shalley,et al.  Effects of Goal Difficulty and Expected External Evaluation on Intrinsic Motivation: A Laboratory Study , 1985 .

[27]  Yun-En Liu,et al.  Designing Engaging Games Using Bayesian Optimization , 2016, CHI.

[28]  HeijdenHans User acceptance of hedonic information systems , 2004 .

[29]  D. Hebb Drives and the C.N.S. (conceptual nervous system). , 1955, Psychological review.

[30]  M. Csíkszentmihályi,et al.  The Importance of Challenge for the Enjoyment of Intrinsically Motivated, Goal-Directed Activities , 2012, Personality & social psychology bulletin.

[31]  Hans van der Heijden,et al.  User Acceptance of Hedonic Information Systems , 2004, MIS Q..

[32]  Paul J. Silvia,et al.  Curiosity and Interest: The Benefits of Thriving on Novelty and Challenge , 2009 .

[33]  Kenneth R. Koedinger,et al.  Interface Design Optimization as a Multi-Armed Bandit Problem , 2016, CHI.

[34]  Ron Kohavi,et al.  Controlled experiments on the web: survey and practical guide , 2009, Data Mining and Knowledge Discovery.

[35]  A. Barto,et al.  Novelty or Surprise? , 2013, Front. Psychol..

[36]  Noriyuki Inoue,et al.  Why Face a Challenge? The Reason behind Intrinsically Motivated Students' Spontaneous Choice of Challenging Tasks. , 2007 .

[37]  C. Dweck,et al.  Implicit theories, attributions, and coping : A meaning system approach , 1999 .

[38]  R. Vallerand Deci and Ryan's self-determination theory: A view from the hierarchical model of intrinsic and extrinsic motivation. , 2000 .

[39]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[40]  Charles F. Hofacker,et al.  Primacy and Recency Effects on Clicking Behavior , 2006, J. Comput. Mediat. Commun..

[41]  J. Eccles,et al.  Motivational beliefs, values, and goals. , 2002, Annual review of psychology.

[42]  Julie L. Booth,et al.  Instructional Complexity and the Science to Constrain It , 2013, Science.

[43]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[44]  Ayelet Fishbach,et al.  How feedback infl uences persistence, disengagement, and change in goal pursuit , 2012 .

[45]  Michele D. Dickey Engaging by design: How engagement strategies in popular computer and video games can inform instructional design , 2005 .

[46]  Z. Shapira Task choice and assigned goals as determinants of task motivation and performance , 1989 .

[47]  Radek Pelánek,et al.  Impact of data collection on interpretation and evaluation of student models , 2016, LAK.