A framework for conceptualizing, representing, and analyzing distributed interaction

The relationship between interaction and learning is a central concern of the learning sciences, and analysis of interaction has emerged as a major theme within the current literature on computer-supported collaborative learning. The nature of technology-mediated interaction poses analytic challenges. Interaction may be distributed across actors, space, and time, and vary from synchronous, quasi-synchronous, and asynchronous, even within one data set. Often multiple media are involved and the data comes in a variety of formats. As a consequence, there are multiple analytic artifacts to inspect and the interaction may not be apparent upon inspection, being distributed across these artifacts. To address these problems as they were encountered in several studies in our own laboratory, we developed a framework for conceptualizing and representing distributed interaction. The framework assumes an analytic concern with uncovering or characterizing the organization of interaction in sequential records of events. The framework includes a media independent characterization of the most fundamental unit of interaction, which we call uptake. Uptake is present when a participant takes aspects of prior events as having relevance for ongoing activity. Uptake can be refined into interactional relationships of argumentation, information sharing, transactivity, and so forth for specific analytic objectives. Faced with the myriad of ways in which uptake can manifest in practice, we represent data using graphs of relationships between events that capture the potential ways in which one act can be contingent upon another. These contingency graphs serve as abstract transcripts that document in one representation interaction that is distributed across multiple media. This paper summarizes the requirements that motivate the framework, and discusses the theoretical foundations on which it is based. It then presents the framework and its application in detail, with examples from our work to illustrate how we have used it to support both ideographic and nomothetic research, using qualitative and quantitative methods. The paper concludes with a discussion of the framework’s potential role in supporting dialogue between various analytic concerns and methods represented in CSCL.

[1]  Hans Spada,et al.  Barriers and Biases in Computer-Mediated Knowledge Communication , 2005 .

[2]  D. Schiffrin,et al.  The Handbook of Discourse Analysis , 2001 .

[3]  Françoise Détienne,et al.  Thematic coherence and quotation practices in OSS design-oriented online discussions , 2005, GROUP.

[4]  Stephanie D. Teasley.  Talking about reasoning : How important is the peer in peer collaboration? , 1997 .

[5]  Timothy Koschmann,et al.  Reconsidering Common Ground: Examining Clark's Contribution Theory in the OR , 2003, ECSCW.

[6]  Daniel D. Suthers,et al.  The Temporal Development of Representational Practices: Implications for Theory and Analysis of Situated Learning , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[7]  Allan Jeong.  A Guide to Analyzing Message–Response Sequences and Group Interaction Patterns in Computer‐mediated Communication , 2005 .

[8]  Daniel D. Suthers,et al.  A Qualitative Analysis of Collaborative Knowledge Construction through Shared Representations , 2006, Res. Pract. Technol. Enhanc. Learn..

[9]  E. L. Harder,et al.  The Institute of Electrical and Electronics Engineers, Inc. , 2019, 2019 IEEE International Conference on Software Architecture Companion (ICSA-C).

[10]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[11]  Merrilee H. Salmon,et al.  Reasoning in Conversation , 1993 .

[12]  Daniel D. Suthers,et al.  Consistent practices in artifact-mediated collaboration , 2006, Int. J. Comput. Support. Collab. Learn..

[13]  J. Chatwin.  Conversation analysis. , 2004, Complementary therapies in medicine.

[14]  Timothy Koschmann,et al.  How Do People Learn , 2005 .

[15]  A. Bruni,et al.  Reassembling the Social—An Introduction to Actor Network Theory , 2007 .

[16]  Hongyan Ma,et al.  Process-aware information systems: Bridging people and software through process technology , 2007, J. Assoc. Inf. Sci. Technol..

[17]  D. Garrison,et al.  Methodological Issues in the Content Analysis of Computer Conference Transcripts , 2007 .

[18]  Katerine Bielaczyc,et al.  Designing Social Infrastructure: Critical Issues in Creating Learning Environments With Technology , 2006 .

[19]  Susan Leigh Star,et al.  Institutional Ecology, `Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39 , 1989 .

[20]  Daniel D. Suthers,et al.  An Abstract Transcript Notation for Analyzing Interactional Construction of Meaning in Online Learning , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[21]  Hans Spada,et al.  Learning in Humans and Machines: Towards an Interdisciplinary Learning Science , 1995 .

[22]  N. Ding,et al.  Computer Supported Collaborative Learning Practices – CSCL2009 Conference Proceedings , 2009 .

[23]  Nikolaos Avouris,et al.  Beyond logging of fingertip actions: analysis of collaborative learning using multiple sources of data , 2007 .

[24]  D. Herman.  Narrative Theory and the Cognitive Sciences , 2001 .

[25]  E. Schegloff,et al.  Opening up Closings , 1973 .

[26]  Jean-Jacques Girardot,et al.  Tatiana: an environment to support the CSCL analysis process , 2009, CSCL.

[27]  Marcelo Milrad,et al.  Physical Activities and Playful Learning Using Mobile Games , 2008, Res. Pract. Technol. Enhanc. Learn..

[28]  G. Stasser,et al.  Discovery of hidden profiles by decision-making groups: Solving a problem versus making a judgment. , 1992 .

[29]  John R. Bourne,et al.  Paradigms for on-line learning: a case study in the design and implementation of an asynchronous learning networks (ALN) course , 1997, Proceedings Frontiers in Education 1997 27th Annual Conference. Teaching and Learning in an Era of Change.

[30]  T. Koschmann,et al.  The Video Analyst’s Manifesto (or The Implications of Garfinkel’s Policies for Studying Practice within Design-based Research) , 2007 .

[31]  J. Roschelle.  Designing for cognitive communication: epistemic fidelity or mediating collaborative inquiry? , 1997, Computers, Communication and Mental Models.

[32]  Marlene Scardamalia,et al.  Computer Support for Knowledge-Building Communities , 1994 .

[33]  A. C. Kruger.  Peer collaboration: conflict, cooperation, or both? , 1993 .

[34]  Wil M. P. van der Aalst.  Process mining , 2012, CACM.

[35]  J. M. Atkinson.  Structures of Social Action: Contents , 1985 .

[36]  Daniel D. Suthers,et al.  Representational Practices in VMT , 2009 .

[37]  Timothy Koschmann,et al.  Dewey's contribution to the foundations of CSCL research , 2002, CSCL.

[38]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[39]  Daniel D. Suthers,et al.  Conceptual representations enhance knowledge construction in asynchronous collaboration , 2007, CSCL.

[40]  M. Cole.  A cultural-historical approach to distributed cognition , 1993 .

[41]  J. Lemke.  The Long and the Short of It: Comments on Multiple Timescale Studies of Human Activity , 2001 .

[42]  James D. Herbsleb,et al.  Characterizing the sequential structure of interactive behaviors through statistical and grammatical techniques , 1994 .

[43]  G. Salomon.  Distributed cognitions : psychological and educational considerations , 1997 .

[44]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[45]  Sasha A. Barab,et al.  Constructing Networks of Action-Relevant Episodes: An In Situ Research Methodology , 2001 .

[46]  Alessandro Duranti,et al.  Transcripts, Like Shadows on a Wall , 2006 .

[47]  Johan F. Hoorn,et al.  Distributed cognition , 2005, Cognition, Technology & Work.

[48]  Daniel D. Suthers,et al.  Tracing interaction in distributed collaborative learning. , 2011 .

[49]  Hans-Rüdiger Pfister,et al.  How to Support Synchronous Net-Based Learning Discourses: Principles and Perspectives , 2005 .

[50]  K. A. Renninger,et al.  Building Virtual Communities: Learning and Change in Cyberspace , 2002 .

[51]  H. Garfinkel.  Studies in Ethnomethodology , 1968 .

[52]  Daniel D. Suthers,et al.  Comparing the roles of representations in face-to-face and online computer supported collaborative learning , 2003, Comput. Educ..

[53]  M. Baker.  COMPUTER-MEDIATED ARGUMENTATIVE INTERACTIONS FOR THE CO-ELABORATION OF SCIENTIFIC NOTIONS , 2003 .

[54]  Noel Enyedy.  Inventing Mapping: Creating Cultural Forms to Solve Collective Problems , 2005 .

[55]  Berner Lindström,et al.  A relational, indirect, meso-level approach to CSCL design in the next decade , 2006, Int. J. Comput. Support. Collab. Learn..

[56]  Roy Pea.  Designing for Virtual Communities in the Service of Learning: Foreword , 2004 .

[57]  Stephanie D. Teasley.  Constructing a Joint Problem Space: The Computer as a Tool for Sharing Knowledge , 1993 .

[58]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[59]  Penelope M. Sanderson,et al.  Exploratory Sequential Data Analysis: Foundations , 1994, Hum. Comput. Interact..

[60]  Susanne P. Lajoie,et al.  Computers As Cognitive Tools , 2020 .

[61]  Heinz Mandl,et al.  Knowledge Convergence in Computer-Supported Collaborative Learning: The Role of External Representation Tools , 2005 .

[62]  Daniel D. Suthers,et al.  Bridging Socio-Technical Capital in an Online Learning Environment , 2009 .

[63]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[64]  Gerry Stahl,et al.  Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology) , 2006 .

[65]  Gijsbert Erkens,et al.  CSCL 2007 : Rutgers University : the Computer Supported Collaborative Learning (CSCL) Conference 2007 : Rutgers, the State University of New Jersey, New Brunswick, New Jersey, USA, July 16th -- July 21st, 2007 , 2007 .

[66]  Susan C. Herring.  Interactional Coherence in CMC , 1999, J. Comput. Mediat. Commun..

[67]  Yvonne Rogers,et al.  The Role of Mobile Devices in Facilitating Collaborative Inquiry in situ , 2008, Res. Pract. Technol. Enhanc. Learn..

[68]  Michael J. Baker,et al.  Arguing to Learn: Confronting Cognitions in Computer-Supported Collaborative Learning Environments , 2003 .

[69]  Frank M. Shipman,et al.  Supporting knowledge-base evolution with incremental formalization , 1994, CHI '94.

[70]  Richard Alterman,et al.  Tracking Online Collaborative Work as Representational Practice: Analysis and Tool , 2007 .

[71]  Daniel D. Suthers,et al.  Is representational guidance culturally relative? , 2009, CSCL.

[72]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[73]  Tim Conley.  Narrative Theory and the Cognitive Sciences , 2005 .

[74]  Daniel D. Suthers,et al.  An Experimental Study of the Effects of Representational Guidance on Collaborative Learning Processes , 2003 .

[75]  R. Sawyer.  The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[76]  Peter Reimann,et al.  Time is precious: Variable- and event-centred approaches to process analysis in CSCL research , 2009, Int. J. Comput. Support. Collab. Learn..

[77]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[78]  E. Hutchins.  Cognition in the wild , 1995 .

[79]  G. Stasser,et al.  Information sampling in structured and unstructured discussions of three- and six-person groups. , 1989 .

[80]  Cindy E. Hmelo-Silver,et al.  Analyzing collaborative knowledge construction: multiple methods for integrated understanding , 2003, Comput. Educ..

[81]  Daniel D. Suthers,et al.  Computer-supported collaborative learning: An historical perspective , 2006 .

[82]  M. Castells.  Die Internet-Galaxie , 2001 .

[83]  H. Blumer,et al.  Symbolic Interactionism: Perspective and Method , 1988 .

[84]  Caroline Haythornthwaite,et al.  Networks of information sharing among computer-supported distance learners , 1999, CSCL.

[85]  Daniel D. Suthers,et al.  An Activity System Analysis of a tripartite Technology-Supported Partnership for School Reform , 2007, Res. Pract. Technol. Enhanc. Learn..

[86]  Manuel Castells,et al.  The Internet Galaxy: Reflections on the Internet, Business, and Society , 2001 .

[87]  L. S. Vygotksy.  Mind in society: the development of higher psychological processes , 1978 .

[88]  Hans Spada,et al.  Barriers, Biases and Opportunities of Communication and Cooperation with Computers: Introduction and Overview , 2005 .

[89]  Daniel D. Suthers,et al.  Bringing representational practice from log to light , 2008, ICLS.

[90]  Daniel D. Suthers,et al.  Information sharing is incongruous with collaborative convergence: the case for interaction , 2007, CSCL.

[91]  Joyce Yukawa,et al.  Co-reflection in online learning: Collaborative critical thinking as narrative , 2006, Int. J. Comput. Support. Collab. Learn..

[92]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[93]  S. Woolgar,et al.  Representation in Scientific Practice , 1990 .

[94]  W. R. Howard.  Acting with Technology: Activity Theory and Interaction Design , 2007 .

[95]  M. Azmitia,et al.  Friendship, transactive dialogues, and the development of scientific reasoning , 1993 .

[96]  B. Latour.  Drawing Things Together , 2011 .

[97]  Dan Suthers,et al.  Transcendent communities , 2007, CSCL.

[98]  James H. Gray,et al.  Designing for Virtual Communities in the Service of Learning: COMING TO TERMS WITH COMMUNITY , 2004 .

[99]  Daniel D. Suthers,et al.  Using a Contingency Graph to Discover Representational Practices in an Online Collaborative Environment , 2009, Res. Pract. Technol. Enhanc. Learn..

[100]  L. Resnick,et al.  Discourse, Tools, and Reasoning: Essays on Situated Cognition , 1997 .

[101]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[102]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[103]  Tony P. Pridmore,et al.  The experience of using Digital Replay System for social science research , 2008 .

[104]  J. Wertsch.  Mind as action , 1998 .

[105]  Daniel D. Suthers,et al.  Technology affordances for intersubjective meaning making: A research agenda for CSCL , 2006, Int. J. Comput. Support. Collab. Learn..

[106]  Rosemary Luckin.  Between the lines: documenting the multiple dimensions of computer-supported collaborations , 2003, Comput. Educ..

[107]  Daniel D. Suthers,et al.  Collaborative representations: supporting face to face and online knowledge-building discourse , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[108]  S. Herring.  Computer‐Mediated Discourse , 2005 .

[109]  Gerry Stahl,et al.  Studying Virtual Math Teams , 2010 .

[110]  Daniel D. Suthers,et al.  Beyond threaded discussion: Representational guidance in asynchronous collaborative learning environments , 2008, Comput. Educ..

[111]  Daniel D. Suthers,et al.  A framework for eclectic analysis of collaborative interaction , 2007, CSCL.

[112]  Angela Cora Garcia,et al.  The Eyes of the Beholder: Understanding the Turn-Taking System in Quasi-Synchronous Computer-Mediated Communication , 1999 .