Time is precious: Variable- and event-centred approaches to process analysis in CSCL research

Although temporality is a key characteristic of the core concepts of CSCL—interaction, communication, learning, knowledge building, technology use—and although CSCL researchers have privileged access to process data, the theoretical constructs and methods employed in research practice frequently neglect to make full use of information relating to time and order. This is particularly problematic when collaboration and learning processes are studied in groups that work together over weeks, and months, as is often the case. The quantitative method dominant in the social and learning sciences—variable-centred variance theory—is of limited value for studying change on longer time scales. We introduce the event-centred view of process as a more generally applicable approach, not only for quantitative analysis, but also for providing closer links between qualitative and quantitative research methods. A number of methods for variable- and event-centred analysis of process data are described and compared, using examples from CSCL research. I conclude with suggestions on how experimental, descriptive, and design-oriented research orientations can become better integrated.

[1]  Arthur C. Danto,et al.  Narration and Knowledge , 1985 .

[2]  Finbarr C. Sloane Multilevel Models in Design Research , 2008 .

[3]  A. Abbott,et al.  Measuring Resemblance in Sequence Data: An Optimal Matching Analysis of Musicians' Careers , 1990, American Journal of Sociology.

[4]  Michael E. Holmes Optimal matching analysis of negotiation phase sequences in simulated and authentic hostage negotiations , 1997 .

[5]  J. Coleman Introduction to Mathematical Sociology , 1965 .

[6]  F. Fischer,et al.  Collaboration Scripts – A Conceptual Analysis , 2006 .

[7]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[8]  Arthur Gill,et al.  Introduction to the theory of finite-state machines , 1962 .

[9]  Manu Kapur,et al.  Problem solving as a complex, evolutionary activity: a methodological framework for analyzing problem-solving processes in a computer-supported collaborative environment , 2005, CSCL.

[10]  P. Abell Narrative Explanation: An Alternative to Variable-Centered Explanation? , 2004 .

[11]  Jan-Willem Strijbos,et al.  A new direction for log file analysis in CSCL: experiences with a spatio-temporal metric , 2005, CSCL.

[12]  D. R. Heise,et al.  The Syntax of Social Life: The Theory and Method of Comparative Narratives. , 1989 .

[13]  Jörg Zumbach,et al.  Influence of Feedback on Distributed Problem Based Learning , 2003, CSCL.

[14]  Lawrence B. Mohr,et al.  Explaining organizational behavior , 1982 .

[15]  C. Goodwin Action and embodiment within situated human interaction , 2000 .

[16]  Daniel D. Suthers,et al.  Computer Supported Collaborative Learning 2005 : the next 10 years! : Proceedings International Conference on Computer Supported Collaborative Learning 2005, Taipei, May 30-June 4, 2005 , 2005 .

[17]  Daniel D. Suthers,et al.  A Qualitative Analysis of Collaborative Knowledge Construction through Shared Representations , 2006, Res. Pract. Technol. Enhanc. Learn..

[18]  Judy Kay,et al.  Visualisations for team learning: small teams working on long-term projects , 2007, CSCL.

[19]  F. Tschan,et al.  Temporal Matters in Social Psychology: Examining the Role of Time in the Lives of Groups and Individuals , 2003 .

[20]  Barbara Wasson,et al.  Designing for Change in Networked Learning Environments, Proceedings of the International Conference on Computer Support for Collaborative Learning, CSCL 2003, Bergen, Norway, June 14-18, 2003 , 2003, CSCL.

[21]  Penelope M. Sanderson,et al.  Exploratory sequential data analysis: foundations , 1994 .

[22]  Holly Arrow,et al.  Small Groups as Complex Systems: Formation, Coordination, Development, and Adaptation , 2000 .

[23]  Anthony E. Kelly,et al.  Design Research and the Study of Change , 2008 .

[24]  Gerry Stahl,et al.  Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology) , 2006 .

[25]  Gijsbert Erkens,et al.  CSCL 2007 : Rutgers University : the Computer Supported Collaborative Learning (CSCL) Conference 2007 : Rutgers, the State University of New Jersey, New Brunswick, New Jersey, USA, July 16th -- July 21st, 2007 , 2007 .

[26]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[27]  Lina Markauskaite,et al.  Enhancing and scaling-up design-based research: the potential of e-research , 2008, ICLS.

[28]  Daniel D. Suthers,et al.  A framework for eclectic analysis of collaborative interaction , 2007, CSCL.

[29]  Janyce Wiebe,et al.  A machine learning approach to assessing knowledge sharing during collaborative learning activities , 2002, CSCL.

[30]  J. Cowan,et al.  Some mathematical questions in biology , 1974 .

[31]  Hiroshi Kato,et al.  ProBoPortable: does the cellular phone software promote emergent division of labor in project-based learning? , 2007, CSCL.

[32]  Ulrike Cress,et al.  The need for considering multilevel analysis in CSCL research—An appeal for the use of more advanced statistical methods , 2008, Int. J. Comput. Support. Collab. Learn..

[33]  A. Abbott,et al.  Event sequence and event duration: colligation and measurement [in medicine]. , 1984, Historical methods.

[34]  John G. Kemeny,et al.  Finite Markov chains , 1960 .

[35]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[36]  Kai Hakkarainen,et al.  Process-and context-sensitive research on academic knowledge practices: developing CASS-tools and methods , 2007, CSCL.

[37]  M. S. Poole,et al.  Decision Development in Small Groups IV A Typology of Group Decision Paths , 1989 .

[38]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[39]  Aristotle,et al.  The Basic Works of Aristotle , 1941 .

[40]  Gregor Kennedy,et al.  Meeting at the Crossroads. Proceedings of the Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE 2001) (18th, Melbourne, Australia, December 9-12, 2001). , 2001 .

[41]  James D. Herbsleb,et al.  Characterizing the sequential structure of interactive behaviors through statistical and grammatical techniques , 1994 .

[42]  Robert M. Miura,et al.  Some mathematical questions in biology : DNA sequence analysis , 1986 .

[43]  A. Langley Strategies for Theorizing from Process Data , 1999 .

[44]  Wil M. P. van der Aalst,et al.  Finding Structure in Unstructured Processes: The Case for Process Mining , 2007, Seventh International Conference on Application of Concurrency to System Design (ACSD 2007).

[45]  Christos G. Cassandras,et al.  Discrete-Event Systems , 2005, Handbook of Networked and Embedded Control Systems.

[46]  E. Schegloff Sequence Organization In Interaction , 2007 .

[47]  Andrew Abbott,et al.  A Primer on Sequence Methods , 1990 .

[48]  Amy B. Woszczynski,et al.  The Handbook of Information Systems Research , 2003 .

[49]  Wolfgang Reisig Petri Nets: An Introduction , 1985, EATCS Monographs on Theoretical Computer Science.

[50]  G. DeSanctis,et al.  Structuration Theory in Information Systems Research: Methods and Controversies , 2004 .

[51]  Frank E. Ritter,et al.  In order to learn : how the sequence of topics influences learning , 2007 .

[52]  Pierre Dillenbourg,et al.  The mechanics of CSCL macro scripts , 2008, Int. J. Comput. Support. Collab. Learn..

[53]  Neil Mercer,et al.  The Seeds of Time: Why Classroom Dialogue Needs a Temporal Analysis , 2008 .

[54]  Klaus Krickeberg,et al.  Markov learning models for multiperson interactions , 1962 .

[55]  Berner Lindström,et al.  A relational, indirect, meso-level approach to CSCL design in the next decade , 2006, Int. J. Comput. Support. Collab. Learn..

[56]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..