An Approach to Assessment of Collaborative Problem Solving

The Assessment and Teaching of 21st Century Skills (ATC21STM) project had a research and development plan that reflected a traditional approach to conceptualisation of constructs, and then establishment of test blueprints followed by test construction. The test construction process included several stages – of drafting task ideas, panelling these with teachers, then piloting revised tasks, and trialling these with students. Within the conceptualisation phase, the project focused on the definition of 21st century skills. This paper outlines the process of moving from the definition to the assessment of one such set of skills – collaborative problem solving. It describes how this led to the development of hypothesised learning progressions which portray how the skills might vary acrossmore and less adept individuals. In the process of development of collaborative problem solving assessments, the tasks were reviewed in terms of how they might reflect the construct and how they might engage students such that their thinking processes could be captured, coded, scored and interpreted. The overall method of this process together with its rationale is described.

[1]  Gregory K. W. K. Chung,et al.  Issues in the Computer-based Assessment of Collaborative Problem Solving , 2003 .

[2]  Mark Wilson,et al.  Constructing Measures: An Item Response Modeling Approach , 2004 .

[3]  Patrick Griffin,et al.  Assessment and Teaching of 21st Century Skills , 2011 .

[4]  Samuel Greiff,et al.  The Process of Solving Complex Problems , 2012, J. Probl. Solving.

[5]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[6]  Samuel Greiff From interactive to collaborative problem solving: Current issues in the Programme for International Student Assessment , 2012 .

[7]  Robert Glaser Instructional Technology and the Measwement of Learning Outcomes: Some Questions1 , 2005 .

[8]  Jonathan Templin,et al.  Perspectives on Methodological Issues , 2012 .

[9]  DeSeCo Oecd Definition and Selection of Key Competencies-Executive Summary , 2005 .

[10]  L. Vygotsky Interaction between learning and development , 1978 .

[11]  P. Campbell How to Solve It: A New Aspect of Mathematical Method , 2005 .

[12]  Randall S. Peterson,et al.  Leadership as Group Regulation , 2004 .

[13]  John D. Bransford,et al.  New Assessments and Environments for Knowledge Building , 2012 .

[14]  Dominique Simone Rychen,et al.  Key Competencies for a Successful Life and a Well-Functioning Society , 2003 .

[15]  Patrick Griffin,et al.  Performance assessment of higher order thinking. , 2014, Journal of applied measurement.

[16]  Randy Elliot Bennett,et al.  Technological Issues for Computer-Based Assessment , 2012 .

[17]  Harold F. O'Neil,et al.  Perspectives on computer-based performance assessment of problem solving , 1999 .

[18]  Friedrich W. Hesse,et al.  A Framework for Teachable Collaborative Problem Solving Skills , 2015 .

[19]  J. Herman,et al.  Defining Twenty-First Century Skills , 2012 .

[20]  Alisha R Pollastri,et al.  The Collaborative Problem Solving Approach: Outcomes Across Settings , 2013, Harvard review of psychiatry.

[21]  Peter Mortimore,et al.  Learning: The Treasure Within , 1999 .

[22]  Linda Darling-Hammond Policy Frameworks for New Assessments , 2012 .

[23]  Jean Gordon,et al.  Key Competences in Europe: Opening Doors for Lifelong Learners Across the School Curriculum and Teacher Education , 2009 .

[24]  Patrick Griffin,et al.  The Comfort of Competence and the Uncertainty of Assessment. , 2007 .

[25]  Kristen E. DiCerbo,et al.  Assessment and teaching of 21st century skills , 2014 .

[26]  William B. Locander,et al.  The Psychology of Leadership: New Perspectives and Research , 2005 .

[27]  Robert Glaser,et al.  Instructional technology and the measurement of learing outcomes: Some questions. , 1963 .

[28]  Friedrich W. Hesse,et al.  Guiding knowledge communication in CSCL via group knowledge awareness , 2011, Comput. Hum. Behav..

[29]  Jean Underwood,et al.  Task effects on co-operative and collaborative learning with computers , 1999 .

[30]  Patrick Griffin,et al.  Assessment and teaching of 21st century skills : methods and approach , 2015 .