Can Students Identify the Relevant Information to Solve a Problem?

Solving non-routine problems is one of the most important skills for the 21st century. Traditional paper– pencil tests cannot assess this type of skill well because of their lack of interactivity and inability to capture procedural data. Tools such as MicroDYN and MicroFIN have proved to be trustworthy in assessing complex problem-solving performances in the dynamic environments representing linear structural equations and finite state automata. In contrast to previous studies, this paper introduces a system that assesses how an individual acquires information to solve real-life problems. Specifically, the system investigated whether fifth-grade students could recognize a situation in which additional information is needed, acquire the relevant information, and finally apply it to solve their problems. By running an experiment with a total of 32 fifth-grade students, we found that the students were usually able to recognize situations when they needed additional information. However, students sometimes spent too much time reading irrelevant materials, which was significantly correlated with worse problem-solving performance (r = 0.417, p = .018).

[1]  Samuel Greiff,et al.  Computer-generated log-file analyses as a window into students' minds? A showcase study based on the PISA 2012 assessment of problem solving , 2015, Comput. Educ..

[2]  Hsin-Kai Wu,et al.  Toward an integrated model for designing assessment systems: An analysis of the current status of computer-based assessments in science , 2013, Comput. Educ..

[3]  Kurt VanLehn,et al.  Evaluation of a meta-tutor for constructing models of dynamic systems , 2014, Comput. Educ..

[4]  Gill Livingston,et al.  The effectiveness of problem‐based learning compared to traditional teaching in undergraduate psychiatry , 2004, Medical education.

[5]  A. Graesser,et al.  Domain-general problem solving skills and education in the 21st century , 2014 .

[6]  R. Mislevy.  Evidence and inference in educational assessment , 1994 .

[7]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[8]  Russell G. Almond,et al.  Bayesian Networks in Educational Assessment , 2015 .

[9]  Milena K. Nigam,et al.  The Equivalence of Learning Paths in Early Science Instruction: Effects of Direct Instruction and Discovery Learning , 2022 .

[10]  Samuel Greiff,et al.  Validity of the MicroDYN approach: Complex problem solving predicts school grades beyond working memory capacity , 2013 .

[11]  Daniel L. Schwartz,et al.  Interactive Metacognition: Monitoring and Regulating a Teachable Agent , 2009 .

[12]  E. Gaygısız,et al.  The Organisation for Economic Co-operation and Development (OECD) , 2022 .

[13]  David Wood,et al.  The Why? What? When? and How? of Tutoring: The Development of Helping and Tutoring Skills in Children. , 2003 .

[14]  Martha W. Alibali,et al.  Noticing relevant problem features: activating prior knowledge affects problem solving by guiding encoding , 2013, Front. Psychol..

[15]  V. Elizabeth Owen,et al.  Game-based assessment: an integrated model for capturing evidence of learning in play , 2014, Int. J. Learn. Technol..

[16]  Samuel Greiff,et al.  On the relation of complex problem solving, personality, fluid intelligence, and academic achievement , 2014 .

[17]  H. Barrows,et al.  Problem-Based Learning Outcomes: The Glass Half-Full , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[18]  V. Shute.  SteAlth ASSeSSment in computer-BASed GAmeS to Support leArninG , 2011 .

[19]  Eric J. Johnson,et al.  Aspects of Endowment: A Query Theory of Value Construction , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Peter Rillero,et al.  Problem-Based Learning in K–8 Mathematics and Science Education: A Literature Review , 2017 .

[21]  Steve Graham,et al.  Constructivism: Principles, Paradigms, and Integration , 1994 .

[22]  J. Tuovinen,et al.  A comparison of cognitive load associated with discovery learning and worked examples , 1999 .

[23]  Samuel Greiff,et al.  Construct validity of complex problem solving: A comprehensive view on different facets of intelligence and school grades , 2016 .

[24]  David Gijbels,et al.  Deep and surface learning in problem-based learning: a review of the literature , 2015, Advances in Health Sciences Education.

[25]  Xiao Luo,et al.  Assessing Higher-Order Cognitive Constructs by Using an Information-Processing Framework , 2016 .

[26]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[27]  V. Patel,et al.  Reasoning and Instruction in Medical Curricula , 1993 .

[28]  Noor Hisham Jalani,et al.  The Example-Problem-Based Learning Model: Applying Cognitive Load Theory , 2015 .

[29]  Samuel Greiff,et al.  The Assessment of 21st Century Skills in Industrial and Organizational Psychology: Complex and Collaborative Problem Solving , 2015, Industrial and Organizational Psychology.

[30]  William G. Holliday,et al.  A Balanced Approach To Science Inquiry Teaching , 2006 .