A multicase study for the evaluation of a pattern-based visual design process for collaborative learning

Collage is a pattern-based visual design authoring tool for the creation of collaborative learning scripts computationally modelled with IMS Learning Design (LD). The pattern-based visual approach aims to provide teachers with design ideas that are based on broadly accepted practices. Besides, it seeks hiding the LD notation so that teachers can easily create their own designs. The use of visual representations supports both the understanding of the design ideas and the usability of the authoring tool. This paper presents a multicase study comprising three different cases that evaluate the approach from different perspectives. The first case includes workshops where teachers use Collage. A second case implies the design of a scenario proposed by a third-party using related approaches. The third case analyzes a situation where students follow a design created with Collage. The cross-case analysis provides a global understanding of the possibilities and limitations of the pattern-based visual design approach.

[1]  Gilbert Paquette.  Discussion of Collaborative Learning Designs, Languages, Models and Tools - LICEF-Télé-université's Contribution , 2006, ICALT.

[2]  Jan-Willem Strijbos,et al.  Designing for interaction: Six steps to designing computer-supported group-based learning , 2004, Comput. Educ..

[3]  Yannis Dimitriadis,et al.  Diagrams of learning flow patterns' solutions as visual representations of refinable IMS Learning Design templates , 2008 .

[4]  Davinia Hernández Leo,et al.  The added value of implementing the Planet Game scenario with Collage and Gridcole , 2008 .

[5]  Barbara Ann Kitchenham.  Evaluating software engineering methods and tool—part 2: selecting an appropriate evaluation method—technical criteria , 1996, SOEN.

[6]  Rob Koper,et al.  Representing the Learning Design of Units of Learning , 2004, J. Educ. Technol. Soc..

[7]  Manuel Lama,et al.  Modelling and Implementation of the Astronomy Case Study with an IMS-LD Ontology , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[8]  Robert E. Stake,et al.  Multiple Case Study Analysis , 2005 .

[9]  E. Guba.  Criteria for assessing the trustworthiness of naturalistic inquiries , 1981 .

[10]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[11]  Barbara Ann Kitchenham,et al.  Evaluating software engineering methods and tool part 1: The evaluation context and evaluation methods , 1996, SOEN.

[12]  Christine Ferraris,et al.  Comparing Educational Modeling Languages on a Case Study , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[13]  Davinia Hernández Leo,et al.  Free- and Open-Source Software for a Course on Network Management: Authoring and Enactment of Scripts Based on Collaborative Learning Strategies , 2007, IEEE Transactions on Education.

[14]  Colin Tattersall.  Comparing Educational Modelling Languages on a CaseStudy: An Approach using IMS Learning Design , 2006 .

[15]  Davinia Hernández Leo,et al.  InstanceCollage: A Tool for the Particularization of Collaborative IMS-LD Scripts , 2009, J. Educ. Technol. Soc..

[16]  Aude Dufresne.  Explor@Graph Scenarios Editor - Designing a Collaborative Task , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[17]  Heidi Norrström.  Multiple Case Study , 2022, The SAGE Encyclopedia of Research Design.

[18]  Christine Ferraris,et al.  Modeling the Case Study with LDL and Implementing it with LDI , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[19]  Davinia Hernández Leo,et al.  Incorporating assessment in a pattern-based design process for CSCL scripts , 2009, Comput. Hum. Behav..

[20]  Jan-Willem Strijbos,et al.  Designing electronic collaborative learning environments , 2004 .

[21]  Davinia Hernández Leo,et al.  COLLAGE: A collaborative Learning Design editor based on patterns , 2006, J. Educ. Technol. Soc..

[22]  James Roland Dalziel.  Lessons from LAMS for IMS Learning Design , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[23]  G. Paquette.  Discussion of Collaborative Learning Designs, Languages, Models and Tools - LICEF-Télé-université’s Contribution , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[24]  Jinhong Jung.  A multiple case study , 2005 .

[25]  A. Dufresne.  Explor@Graph Scenarios Editor - Designing a Collaborative Task , 2006 .

[26]  Jonathan Grudin,et al.  Utility and Usability: Research Issues and Development Contexts , 1992, Interact. Comput..

[27]  Patrick Jermann,et al.  Designing Integrative Scripts , 2007 .

[28]  Yannis A. Dimitriadis,et al.  Gridcole: A tailorable grid service based system that supports scripted collaborative learning , 2008, Comput. Educ..

[29]  Patricia Goubil-Gambrell.  A Practitioner's Guide to Research Methods. , 1992 .

[30]  Yannis A. Dimitriadis,et al.  Semantic search of tools for collaborative learning with the Ontoolsearch system , 2010, Comput. Educ..

[31]  Davinia Hernández-Leo,et al.  A pattern-based design process for the creation of cscl macro-scripts computationally represented with ims ld , 2007 .

[32]  Peter Goodyear,et al.  Educational design and networked learning: Patterns, pattern languages and design practice , 2005 .

[33]  Frank Fischer,et al.  Scripting Computer-Supported Collaborative Learning : cognitive, computational, and educational perspectives , 2007 .

[34]  Heinz Mandl,et al.  Scripting Computer-Supported Collaborative Learning , 2007 .