Assessing and Teaching 21st Century Skills: Collaborative Problem Solving as a Case Study

This chapter describes the assessment of collaborative problem solving using human-to-human interaction. Tasks were designed to require partners to contribute resources or skills that they uniquely controlled. Issues were task design, data capture, item and data definition, calibration, and the link to teaching intervention. The interpretation of the student performance is mapped to a criterion-referenced interpretation framework, and reports are designed to assist teachers to intervene at a Vygotsky zone of proximal development in order to promote development of the student ability in collaborative problem solving. The data analytics demonstrate how the equivalent of test items are developed and issues such a local independence are discussed.

[1]  Mark Wilson,et al.  Measuring Progressions: Assessment Structures Underlying a Learning Progression , 2009 .

[2]  Douglas M. Bates,et al.  Estimating the Multilevel Rasch Model: With the lme4 Package , 2007 .

[3]  Samuel Greiff,et al.  The Process of Solving Complex Problems , 2012, J. Probl. Solving.

[4]  Claire Scoular,et al.  Collaborative Problem Solving Tasks , 2015 .

[5]  R. Glaser.  Education and Thinking: The Role of Knowledge. , 1984 .

[6]  Friedrich W. Hesse,et al.  A Framework for Teachable Collaborative Problem Solving Skills , 2015 .

[7]  J. Herman,et al.  Defining Twenty-First Century Skills , 2012 .

[8]  Patrick Griffin,et al.  Log-file data as indicators for problem-solving processes , 2017 .

[9]  Patrick Griffin,et al.  Linking Developmental Progressions to Teaching , 2015 .

[10]  Pierre Dillenbourg,et al.  Sharing Solutions: Persistence and Grounding in Multimodal Collaborative Problem Solving , 2006 .

[11]  B. Wright,et al.  Best test design , 1979 .

[12]  Gregory K. W. K. Chung,et al.  Issues in the Computer-based Assessment of Collaborative Problem Solving , 2003 .

[13]  Patrick Griffin,et al.  The Changing Role of Education and Schools , 2012 .

[14]  Patrick Griffin,et al.  Assessment and teaching of 21st century skills : methods and approach , 2015 .

[15]  N. Rummel,et al.  Learning to Collaborate: An Instructional Approach to Promoting Collaborative Problem Solving in Computer-Mediated Settings , 2005 .

[16]  Claire Scoular,et al.  Automatic Coding Procedures for Collaborative Problem Solving , 2015 .

[17]  Siu Cheung Kong,et al.  An evaluation study of the use of a cognitive tool in a one-to-one classroom for promoting classroom-based dialogic interaction , 2011, Comput. Educ..

[18]  T. Bentley,et al.  The shared work of learning: lifting educational achievement through collaboration , 2015 .

[19]  L. Vygotsky.  Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[20]  Patrick Griffin,et al.  Performance assessment of higher order thinking. , 2014, Journal of applied measurement.