Choosing versus Receiving Feedback: The Impact of Feedback Valence on Learning in an Assessment Game

Studies examining feedback in educational settings have largely focused on feedback that is received, rather than chosen, by students. This study investigates whether adult participants learn more from choosing rather than receiving feedback from virtual characters in a digital poster design task. We employed a yoked study design and two versions of an online game-based assessment, Posterlet, to compare the learning outcomes of N=264 Mechanical Turk adults in two conditions: when they chose the feedback valence versus when they received the same feedback valence and order. In Posterlet, players design posters and learn graphic design principles from feedback. We found that the more the participants chose critical feedback, the more time they spent designing posters, but there were no differences in learning, revision, and time spent designing posters between conditions. In each condition, critical feedback correlated with performance and revision, suggesting that feedback valence is important for performance, regardless of being a choice.

[1]  Valerie J. Shute,et al.  Games, Learning, and Assessment , 2012 .

[2]  David Dunning,et al.  How chronic self-views influence (and potentially mislead) estimates of performance. , 2003, Journal of personality and social psychology.

[3]  B. Zimmerman.  Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[4]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[5]  L. Standing.  Learning 10000 pictures , 1973 .

[6]  K. Koedinger,et al.  Improving students’ help-seeking skills using metacognitive feedback in an intelligent tutoring system , 2011, Learning and Instruction.

[7]  C. Dweck,et al.  Understanding overconfidence: Theories of intelligence, preferential attention, and distorted self-assessment , 2016 .

[8]  Jennifer A. Mangels,et al.  Why do beliefs about intelligence influence learning success? A social cognitive neuroscience model. , 2006, Social cognitive and affective neuroscience.

[9]  P. Black,et al.  Developing the theory of formative assessment , 2009 .

[10]  Daniel L. Schwartz,et al.  Measuring What Matters Most: Choice-Based Assessments for the Digital Age , 2013 .

[11]  Daniel L. Schwartz,et al.  A time for telling , 1998 .

[12]  Daniel L. Schwartz,et al.  Posterlet: A Game-Based Assessment of Children's Choices to Seek Feedback and to Revise , 2015, J. Learn. Anal..

[13]  Ayelet Fishbach,et al.  Tell Me What I Did Wrong: Experts Seek and Respond to Negative Feedback , 2012 .

[14]  Daniel L. Schwartz,et al.  Rethinking transfer: A simple proposal with multiple implica-tions , 1999 .

[15]  Daniel L. Schwartz,et al.  Guardian Angels of Our Better Nature: Finding Evidence of the Benefits of Design Thinking , 2015 .

[16]  L. Vygotsky,et al.  The collected works of L. S. Vygotsky, Vol. 3: Problems of the theory and history of psychology. , 1997 .

[17]  M. Nageotte,et al.  Obstetric outcomes and maternal satisfaction in nulliparous women using patient-controlled epidural analgesia. , 2011, American journal of obstetrics and gynecology.

[18]  Daniel L. Schwartz,et al.  Constructivism in an age of non-constructivist assessments , 2009 .

[19]  David Dunning,et al.  Trait Importance and Modifiability as Factors Influencing Self-Assessment and Self-Enhancement Motives , 1995 .

[20]  L. Standing.  Learning 10,000 pictures. , 1973, The Quarterly journal of experimental psychology.

[21]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[22]  D. Garrison.  Self-Directed Learning: Toward a Comprehensive Model , 1997 .

[23]  James G. March,et al.  Explorations in Organizations , 2008 .

[24]  A. Kluger,et al.  Feedback Interventions , 1998 .