Self-regulation of secondary school students: self-assessments are inaccurate and insufficiently used for learning-task selection

Self-assessment and task selection are important self-regulated learning skills for secondary school students. More specifically, selecting new tasks based on self-assessments is very important for them, because teachers are not always present or able to select tasks for them individually. However, little is known about the processes underlying these self-regulated learning skills, and thus no guidelines exist for teaching self-assessment and the selection of subsequent learning-tasks. We propose a model for self-regulated learning-task selection (SRLTS) which represents a possible pathway for the task-selection process, and which students could use as a norm when making task selections. The model could help students to decide what possible new tasks might be suitable for their current skill level, based on self-assessments. The aim of this study is to evaluate to what extent secondary school students select learning tasks according to this model, and whether they use self-assessments to this end. Secondary school students (N = 15) selected learning tasks in the domain of genetics from a structured task database. The tasks varied in difficulty and amount of support provided (i.e., completion problems vs. traditional problems). We used eye tracking, performance estimates, estimates of mental effort, judgments of learning, and open questions to gain more insight in what students focus on and think about when selecting a task. Results suggest that students roughly follow the SRLTS model, but they base their decisions on inaccurate self-assessments. This implies that students might benefit from self-assessment and task-selection advice, which could provide feedback on self-assessments and stimulate students to use self-assessment information as input for task selection in the way the model prescribes to optimize their learning.

[1]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[2]  H. Andrade Students as the Definitive Source of Formative Assessment: Academic Self-Assessment and the Self-Regulation of Learning , 2010 .

[3]  Glenn Regehr,et al.  Exploring the divergence between self-assessment and self-monitoring , 2010, Advances in health sciences education : theory and practice.

[4]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[5]  Huei-Tse Hou,et al.  Visual attention for solving multiple-choice science problem: An eye-tracking analysis , 2012, Comput. Educ..

[6]  E. A. Locke,et al.  A theory of goal setting & task performance , 1990 .

[7]  B. Zimmerman,et al.  The Psychology of Problem Solving: Motivating Self-Regulated Problem Solvers , 2003 .

[8]  T. Gog,et al.  Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning , 2012 .

[9]  J. Bruner The Process of Education , 1960 .

[10]  D. Boud,et al.  Quantitative studies of student self-assessment in higher education: a critical analysis of findings , 1989 .

[11]  Liesbeth Kester,et al.  Dynamic task selection: Effects of feedback and learner control on efficiency and motivation , 2009 .

[12]  Ernesto Panadero,et al.  Self-assessment: Theoretical and Practical Connotations. When it Happens, How is it Acquired and what to do to Develop it in our Students , 2013 .

[13]  Philip H. Winne,et al.  Students’ calibration of knowledge and learning processes: Implications for designing powerful software learning environments , 2004 .

[14]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[15]  Liesbeth Kester,et al.  Combining shared control with variability over surface features: Effects on transfer test performance and task involvement , 2009, Comput. Hum. Behav..

[16]  John Dunlosky,et al.  Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention , 2012 .

[17]  Gavin T. L. Brown,et al.  The Future of Student Self-Assessment: a Review of Known Unknowns and Potential Directions , 2016 .

[18]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[19]  Gavin T. L. Brown,et al.  Accuracy in student self-assessment: directions and cautions for research , 2015 .

[20]  David Istance,et al.  Future directions for learning environments in the 21st century , 2010 .

[21]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[22]  H. Hoeken,et al.  Evoking and Measuring Identification with Narrative Characters – A Linguistic Cues Framework , 2017, Front. Psychol..

[23]  F. Paas Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[24]  T. Gog,et al.  Effects of training self-assessment and using assessment standards on retrospective and prospective monitoring of problem solving , 2014 .

[25]  Tamara van Gog,et al.  Improving self-monitoring and self-regulation: From cognitive psychology to the classroom , 2012 .

[26]  Ernesto Panadero,et al.  A Review of Self-regulated Learning: Six Models and Four Directions for Research , 2017, Front. Psychol..

[27]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[28]  Gavin T. L. Brown,et al.  The Future of Self-Assessment in Classroom Practice: Reframing Self-Assessment as a Core Competency. , 2014 .

[29]  Paul A. Kirschner,et al.  Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design , 2007 .

[30]  Harold Pashler,et al.  Optimizing distributed practice: theoretical analysis and practical implications. , 2009, Experimental psychology.

[31]  Eric N. Wiebe,et al.  Haptic feedback and students' learning about levers: Unraveling the effect of simulated touch , 2009, Comput. Educ..

[32]  J. Metcalfe,et al.  Evidence that judgments of learning are causally related to study choice , 2008, Psychonomic bulletin & review.

[33]  Wim H. Gijselaers,et al.  Why advice on task selection may hamper learning in on-demand education , 2013, Comput. Hum. Behav..

[34]  A. Efklides Interactions of Metacognition With Motivation and Affect in Self-Regulated Learning: The MASRL Model , 2011 .

[35]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[36]  Fred Paas,et al.  Self-assessment and task selection in learner-controlled instruction: Differences between effective and ineffective learners , 2010, Comput. Educ..

[37]  Fred Paas,et al.  Dynamic problem selection in air traffic control training: a comparison between performance, mental effort and mental efficiency , 2001, Comput. Hum. Behav..

[38]  R. Atkinson,et al.  Structuring the Transition From Example Study to Problem Solving in Cognitive Skill Acquisition: A Cognitive Load Perspective , 2003 .

[39]  Philip H. Winne,et al.  Self-regulated learning viewed from models of information processing. , 2001 .

[40]  J. Merriënboer,et al.  Selecting learning tasks: Effects of adaptation and shared control on learning efficiency and task involvement☆ , 2008 .

[41]  A. Koriat Monitoring one's own knowledge during study : A cue-utilization approach to judgments of learning , 1997 .

[42]  F. Paas,et al.  Uncovering the problem-solving process: cued retrospective reporting versus concurrent and retrospective reporting. , 2005, Journal of experimental psychology. Applied.

[43]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[44]  K. A. Ericsson,et al.  Protocol analysis: Verbal reports as data, Rev. ed. , 1993 .

[45]  Fred Paas,et al.  Completion of partially worked-out examples as a generation strategy for improving monitoring accuracy , 2013 .

[46]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[47]  J. Merriënboer,et al.  The effects of portfolio-based advice on the development of self-directed learning skills in secondary vocational education , 2009 .

[48]  Fred Paas,et al.  Teaching students self-assessment and task-selection skills with video-based modeling examples , 2010 .

[49]  Heidi Andrade,et al.  Student responses to criteria‐referenced self‐assessment , 2007 .

[50]  R. Bjork,et al.  Self-regulated learning: beliefs, techniques, and illusions. , 2013, Annual review of psychology.

[51]  Liesbeth Kester,et al.  Learner-controlled selection of tasks with different surface and structural features: Effects on transfer and efficiency , 2011, Comput. Hum. Behav..

[52]  Kent J. Crippen,et al.  Promoting Self-Regulation in Science Education: Metacognition as Part of a Broader Perspective on Learning , 2006 .

[53]  T. O. Nelson Metamemory: A Theoretical Framework and New Findings , 1990 .

[54]  B. Zimmerman Becoming a Self-Regulated Learner: An Overview , 2002 .

[55]  Kerri L. Johnson,et al.  Why People Fail to Recognize Their Own Incompetence , 2003 .

[56]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[57]  Sofie M. M. Loyens,et al.  Self-Directed Learning in Problem-Based Learning and its Relationships with Self-Regulated Learning , 2008 .