An analysis framework for collaborative problem solving in practice-based learning activities: a mixed-method approach

Systematic investigation of the collaborative problem solving process in open-ended, hands-on, physical computing design tasks requires a framework that highlights the main process features, stages and actions that then can be used to provide 'meaningful' learning analytics data. This paper presents an analysis framework that can be used to identify crucial aspects of the collaborative problem solving process in practice-based learning activities. We deployed a mixed-methods approach that allowed us to generate an analysis framework that is theoretically robust, and generalizable. Additionally, the framework is grounded in data and hence applicable to real-life learning contexts. This paper presents how our framework was developed and how it can be used to analyse data. We argue for the value of effective analysis frameworks in the generation and presentation of learning analytics for practice-based learning activities.

[1]  Carol K. K. Chan,et al.  Students assessing their own collaborative knowledge building , 2006, Int. J. Comput. Support. Collab. Learn..

[2]  N. Rummel,et al.  Learning to Collaborate: An Instructional Approach to Promoting Collaborative Problem Solving in Computer-Mediated Settings , 2005 .

[3]  Robert Glaser,et al.  Thinking and Learning Skills : Volume 1: Relating Instruction To Research , 2014 .

[4]  Ulrik Schroeder,et al.  Application of Qualitative Content Analysis in User-Program Interaction Research , 2005 .

[5]  C. Hmelo‐Silver Problem-Based Learning: What and How Do Students Learn? , 2004 .

[6]  Timothy Koschmann,et al.  Problematizing the Problem , 2003, CSCL.

[7]  Maren Scheffel,et al.  Developing an evaluation framework of quality indicators for learning analytics , 2015, LAK.

[8]  S. Järvelä,et al.  The Levels of Web-Based Discussions: Using Perspective Taking Theory as an Analytical Tool , 2003 .

[9]  R. Millar The role of practical work in the teaching and learning of science , 2004 .

[10]  Ian Abrahams,et al.  Does Practical Work Really Work? A study of the effectiveness of practical work as a teaching and learning method in school science , 2008 .

[11]  Cindy E. Hmelo-Silver,et al.  Problem-Based Learning: What and How Do , 2004 .

[12]  Erica Halverson,et al.  The Maker Movement in Education , 2014, Oxford Research Encyclopedia of Education.

[13]  S. Elo,et al.  Qualitative Content Analysis , 2014 .

[14]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[15]  Marcelo Worsley,et al.  Analyzing Engineering Design through the Lens of Computation , 2014, J. Learn. Anal..

[16]  PISA 2015 collaborative problem ‐ solving framework , 2022 .

[17]  Rosemary Luckin,et al.  Analysing Project Based Learning Scenarios to Inform the Design of Learning Analytics: Learning from Related Concepts , 2015, AIED Workshops.

[18]  Jill Willis,et al.  A cognitive processing framework for learning analytics , 2014, LAK.