Improving metacognition in the classroom through instruction, training, and feedback

Accurately judging one’s performance in the classroom can be challenging considering most students tend to be overconfident and overestimate their actual performance. The current work draws upon the metacognition and decision making literatures to examine improving metacognition in the classroom. Using historical data from several semesters of an upper-level undergraduate course (N = 127), we analyzed students’ judgments of their performance and their actual performance for two exams. Students were instructed on the concepts of overconfidence, received feedback on exams, and were given incentives for accurate calibration. We found results consistent with the “unskilled and unaware” effect Kruger & Dunning (Journal of Personality and Social Psychology, 77(6), 1121–1134, 1999) where lower performing students initially displayed overconfidence and the highest performing students initially displayed underconfidence. Importantly, students were able to change both judgments and performance such that metacognitive accuracy improved significantly from the first to the second exam. In a second study, two additional semesters for the same course used in Study 1 were examined (N = 90). For one of the semesters feedback was not provided, allowing us to determine whether feedback can improve both metacognitive judgments and performance. Our findings revealed significant improvements in performance paired with decreases in overconfidence on Exam 2, but only for students who received feedback about their performance and judgments. We postulate that feedback may be an important component in improvement metacognitive judgments.

[1]  John Dunlosky,et al.  Improving students’ self-evaluation of learning for key concepts in textbook materials , 2007 .

[2]  Linda Bol,et al.  Metacognition in education: A focus on calibration. , 2008 .

[3]  M. McDaniel,et al.  Testing the testing effect in the classroom , 2007 .

[4]  J. Metcalfe,et al.  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Metacognitive Judgments and Control of Study , 2022 .

[5]  Lisa Geraci,et al.  Training metacognition in the classroom: the influence of incentives and feedback on exam predictions , 2011 .

[6]  John Dunlosky,et al.  Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention , 2012 .

[7]  P. Juslin,et al.  Naive empiricism and dogmatism in confidence research: a critical examination of the hard-easy effect. , 2000, Psychological review.

[8]  Lyle Brenner,et al.  Overconfidence in Probability and Frequency Judgments: A Critical Examination , 1996 .

[9]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[10]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .

[11]  Linda Bol,et al.  Explaining calibration accuracy in classroom contexts: the effects of incentives, reflection, and explanatory style , 2008 .

[12]  Ruth H. Maki,et al.  Individual Differences in Absolute and Relative Metacomprehension Accuracy. , 2005 .

[13]  Michael J. Renner,et al.  But I thought I knew that: using confidence estimation as a debiasing technique to improve classroom performance , 2001 .

[14]  B. Fischhoff,et al.  Training for calibration. , 1980 .

[15]  Gideon Keren,et al.  Facing uncertainty in the game of bridge: A calibration study , 1987 .

[16]  Maria T. Potenza,et al.  Constraints on the Calibration of Performance , 1993 .

[17]  R. Maki,et al.  Basis of metamemory judgments for text with multiple‐choice, essay and recall tests , 2009 .

[18]  S. Ludwig,et al.  Beliefs about overconfidence , 2011 .

[19]  Lisa Geraci,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition Unskilled but Aware : Reinterpreting Overconfidence in Low-Performing Students , 2011 .

[20]  Gregory Schraw,et al.  The Effect of Knowledge and Strategy Training on Monitoring Accuracy , 2002 .

[21]  John L. Nietfeld,et al.  College Students' Metacognitive Awareness of Difficulties in Learning the Class Content Does Not Automatically Lead to Adjustment of Study Strategies 1 , 2007 .

[22]  Gregory Schraw,et al.  Measure for Measure: Calibrating Ten Commonly Used Calibration Scores. , 2013 .

[23]  Marissa K. Hartwig,et al.  The contribution of judgment scale to the unskilled-and-unaware phenomenon: How evaluating others can exaggerate over- (and under-) confidence , 2014, Memory & cognition.

[24]  G. Keren.  Calibration and probability judgements: Conceptual and methodological issues , 1991 .

[25]  P. Koellinger,et al.  "I Think I Can, I Think I Can": Overconfidence and Entrepreneurial Behavior , 2007 .

[26]  J. Metcalfe,et al.  Evidence that judgments of learning are causally related to study choice , 2008, Psychonomic bulletin & review.

[27]  Asher Koriat,et al.  Monitoring and control processes in the strategic regulation of memory accuracy , 1996 .

[28]  John L. Nietfeld,et al.  Using strategy instruction and confidence judgments to improve metacognitive monitoring , 2009 .

[29]  E. Loftus,et al.  INSIGHTFUL OR WISHFUL: Lawyers' Ability to Predict Case Outcomes , 2010 .

[30]  Kerri L. Johnson,et al.  Why People Fail to Recognize Their Own Incompetence , 2003 .

[31]  Li Cao,et al.  Metacognitive Monitoring Accuracy and Student Performance in the Postsecondary Classroom. , 2005 .

[32]  Janet Metcalfe,et al.  The role of memory for past test in the underconfidence with practice effect. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[33]  Linda Bol,et al.  Test prediction and performance in a classroom context. , 2000 .

[34]  Douglas J. Hacker,et al.  The Influence of Overt Practice, Achievement Level, and Explanatory Style on Calibration Accuracy and Performance , 2005 .

[35]  B. Hout-Wolters,et al.  Metacognition and learning: conceptual and methodological considerations , 2006 .

[36]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[37]  P Delhomme,et al.  Comparing one's driving with others': assessment of abilities and frequency of offences. Evidence for a superior conformity of self-bias? , 1991, Accident; analysis and prevention.