Issues in the Computer-based Assessment of Collaborative Problem Solving

Abstract Collaborative problem solving skills are considered necessary skills for success in today's world of work and school. Collaborative learning refers to learning environments in which small groups of people work together to achieve a common goal, and problem solving is using cognitive processing to find a solution to a problem. Thus, collaborative problem solving is defined as problem solving activities that involve interactions among a group of individuals. This paper will address several key issues (e.g. theory and measurement of collaborative problem solving and issues in measuring problem solving processes). We rely on computerisation of the administration, scoring and reporting of collaborative problem solving skills, thus potentially increasing reliability and validity.

[1]  Philip Smith Roger Bakeman John M. Gottman , 1987, Animal Behaviour.

[2]  Harold F. O'Neil,et al.  Perspectives on computer-based performance assessment of problem solving , 1999 .

[3]  Catrina Williams Internet Access in U.S. Public Schools and Classrooms: 1994-99. Stats in Brief. , 2000 .

[4]  Gregory K. W. K. Chung,et al.  Reliability and validity of a computer-based knowledge mapping system to measure content understanding , 1999 .

[5]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[6]  Miodrag Potkonjak,et al.  Smart kindergarten: sensor-based wireless networks for smart developmental problem-solving environments , 2001, MobiCom '01.

[7]  Mani B. Srivastava,et al.  A Support Infrastructure for the Smart Kindergarten , 2002, IEEE Pervasive Comput..

[8]  Eduardo Salas,et al.  Analyzing Communication Sequences for Team Training Needs Assessment , 1998, Hum. Factors.

[9]  Randy Hirokawa,et al.  A comparative analysis of communication patterns within effective and ineffective decision‐making groups , 1980 .

[10]  R. Sternberg,et al.  "Dynamic testing": Erratum. , 1998 .

[11]  H. O'Neil Review of workforce readiness theoretical frameworks , 1997 .

[12]  Eva L. Baker,et al.  Measuring problem solving in computer environments: current and future states , 2002, Comput. Hum. Behav..

[13]  Candace Schau,et al.  Select-and-Fill-in Concept Map Scores as a Measure of Students’ Connected Understanding of Science , 2001 .

[14]  Richard E. Mayer,et al.  Problem-solving transfer. , 1996 .

[15]  Eva L. Baker,et al.  Model‐based performance assessment , 1997 .

[16]  Gregory K. W. K. Chung,et al.  Computer-based performance assessments: a solution to the narrow measurement and reporting of problem-solving , 1999 .

[17]  I-Lin Gloria Hsieh,et al.  Types of feedback in a computer-based collaborative problem-solving group task , 2002, Comput. Hum. Behav..

[18]  Gregory K. W. K. Chung,et al.  Computer-Based Collaborative Knowledge Mapping To Measure Team Processes and Team Outcomes. , 1999 .

[19]  T. Schack,et al.  Dynamic testing , 2003 .

[20]  John M. Gottman,et al.  Sequential Analysis: Frontmatter , 1990 .

[21]  Jean Underwood,et al.  Task effects on co-operative and collaborative learning with computers , 1999 .

[22]  John M. Gottman,et al.  Sequential Analysis: The timetable and the contextual design , 1990 .

[23]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[24]  Ronald H. Stevens,et al.  Cognitive process validation of an online problem solving assessment , 2002, Comput. Hum. Behav..

[25]  David H. Jonassen,et al.  Instructional design models for well-structured and III-structured problem-solving learning outcomes , 1997 .

[26]  H. Becker Internet Use by Teachers: Conditions of Professional Use and Teacher-Directed Student Use. Teaching, Learning, and Computing: 1998 National Survey. Report #1. , 1999 .

[27]  Basmat Parsad,et al.  Internet Access in U.S. Public Schools and Classrooms: 1994?2003. ED TAB. NCES 2005-015. , 2005 .

[28]  B. B. Morgan,et al.  An Analysis of Team Evolution and Maturation , 1993 .

[29]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[30]  K. Sinclair Workforce competencies of college graduates , 1997 .

[31]  Jiajie Zhang,et al.  A Distributed Representation Approach to Group Problem Solving , 1998, J. Am. Soc. Inf. Sci..

[32]  R. Bakeman,et al.  Observing interaction: An introduction to sequential analysis, 2nd ed. , 1997 .

[33]  A. W. Lazonder Exploring novice users' training needs in searching information on the WWW , 2000, J. Comput. Assist. Learn..

[34]  Jamal Abedi,et al.  Reliability and Validity of a State Metacognitive Inventory: Potential for Alternative Assessment , 1996 .

[35]  Richard E. Mayer,et al.  Computer-Based Assessment of Problem Solving. , 1999 .

[36]  Harold F. O'Neil,et al.  Workforce Readiness: Competencies and Assessment. , 1997 .

[37]  Harold F. O'Neil,et al.  Use of networked simulations as a context to measure team competencies , 1997 .

[38]  Gerald L. Abegg,et al.  A Teacher's Perspective on Technology in the Classroom: Computer Visualization, Concept Maps and Learning Logs , 1999 .

[39]  Alexander W. Chizhik,et al.  Equity Issues in Collaborative Group Assessment: Group Composition and Performance , 1998 .