Rainbow: A framework for analysing computer-mediated pedagogical debates

In this paper we present a framework for analysing when and how students engage in a specific form of interactive knowledge elaboration in CSCL environments: broadening and deepening understanding of a space of debate. The framework is termed “Rainbow,” as it comprises seven principal analytical categories, to each of which a colour is assigned, thus enabling informal visualisation by the analyst of the extent to which students are engaging in interaction relating to potential achievement of its pedagogical goal. The categories distinguish between activities that are part of the prescribed assignment and activities that are not, and between task-focused and non-task-focused activities. Activities focused on managing the interaction itself are distinguished from argumentative interaction. Notably, an operational definition of what it means to broaden and deepen understanding in this case is also provided here. The functional Rainbow analysis is complemented by an analysis of topics and subtopics that enables identification of one form of conceptual deepening of the question. In comparison with existing analysis techniques, Rainbow synthesises much of what is known into a single framework, with a broad theoretical base. The usability and educational relevance of the framework has been validated experimentally across a variety of collaborative learning tasks and communication media. Possible and actual extensions to the framework are discussed, with respect to additional CSCL tools, domains and tasks.

[1]  F. H. Eemeren,et al.  Handboek van de argumentatietheorie. Historische achtergronden en hedendaagse ontwikkelingen [Vertaling van: 'Fundamentals of Argumentation Theory. Handbook of Historical Backgrounds and Contemporary Developments, Lawrence Erlbaum Ass., Mawhaw N.J.] , 1997 .

[2]  Susan Leigh Star,et al.  The Structure of Ill-Structured Solutions: Boundary Objects and Heterogeneous Distributed Problem Solving , 1989, Distributed Artificial Intelligence.

[3]  Noel L. Corbett,et al.  Argumentation et conversation: Éléments pour une analyse pragmatique du discours@@@Argumentation et conversation: Elements pour une analyse pragmatique du discours , 1987 .

[4]  Victor Goldschmidt,et al.  28. Perelman (Ch.) et Olbrechts-Tyteca (L.). La nouvelle rhétorique ; Traité de l'Argumentation (Coll. Logos). Paris, Presses Universitaires de France, 1958 , 1958 .

[5]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[6]  M. Baker,et al.  Computer-Mediated Epistemic Dialogue: Explanation and Argumentation as Vehicles for Understanding Scientific Notions , 2002 .

[7]  F. H. Eemeren,et al.  Speech acts in argumentative discussions , 1984 .

[8]  Barbara J. Grosz,et al.  Focusing and Description in Natural Language Dialogues , 1979 .

[9]  G. Stahl Building Collaborative Knowing , 2006 .

[10]  Matthieu Quignard Matthieu Quignard, Modélisation cognitive de l’argumentation dialoguée. Etude de dialogues d’élèves en résolution de problème de sciences physiques, Thèse en sciences cognitives de l'université Joseph Fourier, Grenoble, 28 janvier 2000 , 2000 .

[11]  Daniel D. Suthers,et al.  An Abstract Transcript Notation for Analyzing Interactional Construction of Meaning in Online Learning , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[12]  Nikol Rummel,et al.  A new method to assess the quality of collaborative process in CSCL , 2005, CSCL.

[13]  Daniel D. Suthers,et al.  An integrated approach to implementing collaborative inquiry in the classroom , 1997, CSCL.

[14]  Barbara Wasson,et al.  Designing for change in networked learning environments : proceedings of the International Conference on Computer Support for Collaborative Learning 2003 , 2003 .

[15]  Jerry Andriessen,et al.  Representational Tools in Computer-Supported Collaborative Argumentation-Based Learning: How Dyads Work With Constructed and Inspected Argumentative Diagrams , 2007 .

[16]  Deanna Kuhn,et al.  The development of argument skills. , 2003, Child development.

[17]  Daniel D. Suthers,et al.  A Qualitative Analysis of Collaborative Knowledge Construction through Shared Representations , 2006, Res. Pract. Technol. Enhanc. Learn..

[18]  Michael J. Baker,et al.  Argumentation, Computer Support, and the Educational Context of Confronting Cognitions , 2003 .

[19]  Jean-Jacques Girardot,et al.  DREW : A Dialogical Reasoning Web Tool , 2002 .

[20]  J. F. Voss Argumentation in Psychology : A Special Double Issue of Discourse Processes , 2002 .

[21]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[22]  W. Edmondson Spoken Discourse: A Model for Analysis , 1982 .

[23]  Michael J. Baker,et al.  Computer-Supported Collaborative Learning in the Space of Debate , 2003, CSCL.

[24]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[25]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[26]  Paul A. Kirschner,et al.  Designing External Representations to Support Solving Wicked Problems , 2003 .

[27]  Jerry Andriessen,et al.  Exploring Relational Regulation in Computer-Mediated (Collaborative) Learning Interaction: A Developmental Perspective , 2004, Cyberpsychology Behav. Soc. Netw..

[28]  R. Martinez Informal Logic: A Handbook for Critical Argumentation , 1990 .

[29]  Carla Bazzanella,et al.  Argumentation et conversation. Eléments pour une analyse pragmatique du discours, Jacques Moeschler (Ed.). Hatier-Crédif, Paris (1985), 203 pp. FF 72.00. , 1988 .

[30]  S. Toulmin The uses of argument , 1960 .

[31]  Robert Vion,et al.  La communication verbale : analyse des interactions , 2000 .

[32]  Martine Batt,et al.  Comment représenter le passage de l'intersubjectif à l'intrasubjectif ? Essai de Logique Interlocutoire : Coopérer et apprendre par le dialogue , 2003 .

[33]  Hans Spada,et al.  Learning in Humans and Machines , 1995 .

[34]  Merrilee H. Salmon,et al.  Reasoning in Conversation , 1993 .

[35]  Anne-Nelly Perret-Clermont,et al.  The social construction of meaning and cognitive activity in elementary school children , 1991, Perspectives on socially shared cognition.

[36]  C. Perelman,et al.  Traité de l'argumentation , 1958 .

[37]  S. Erduran,et al.  TAPping into argumentation: Developments in the application of Toulmin's Argument Pattern for studying science discourse , 2004 .

[38]  Gijsbert Erkens,et al.  Argumentation as Negotiation in Electronic Collaborative Writing , 2003 .

[39]  Alan H. Bond,et al.  Distributed Artificial Intelligence , 1988 .

[40]  C. Perelman,et al.  La nouvelle rhétorique , 1956 .

[41]  John R. Searle,et al.  (on) Searle on Conversation: Compiled and Introduced by Herman Parret and Jef Verschueren , 1992 .

[42]  Michael J. Baker,et al.  Promoting reflective interactions in a CSCL environment , 1997, J. Comput. Assist. Learn..

[43]  Michael J. Baker,et al.  Promoting reflective interactions in a computer-supported collaborative learning environment , 1997 .

[44]  Erik C. W. Krabbe,et al.  From axiom to dialogue , 1982 .

[45]  Michael J. Baker,et al.  Arguing to Learn: Confronting Cognitions in Computer-Supported Collaborative Learning Environments , 2003 .

[46]  E. Roulet L'articulation du discours en français contemporain , 1991 .

[47]  P. Houtlosser,et al.  Argumentation in Practice , 2005 .

[48]  Jan-Willem Strijbos,et al.  What we know about CSCL: ...and what we do not (but need to) know about CSCL , 2004 .

[49]  R. J. Beun,et al.  Dialogue and Instruction: Modelling Interaction in Intelligent Tutoring Systems , 1995 .

[50]  Douglas B. Clark,et al.  Analytic Frameworks for Assessing Dialogic Argumentation in Online Learning Environments , 2007 .

[51]  M. Baker ARGUMENTATION AND CONSTRUCTIVE INTERACTION , 2009 .

[52]  Arne Naess,et al.  Communication and argument : elements of applied semantics , 1968 .

[53]  Joakim Nivre,et al.  On the Semantics and Pragmatics of Linguistic Feedback , 1992, J. Semant..

[54]  M. Baker COMPUTER-MEDIATED ARGUMENTATIVE INTERACTIONS FOR THE CO-ELABORATION OF SCIENTIFIC NOTIONS , 2003 .

[55]  M. Quignard,et al.  Modélisation cognitive de l'argumentation dialoguée : étude de dialogues d'élèves en résolution de problèmes de sciences physiques , 2000 .

[56]  T. Wilkerson An Essay on Belief and Acceptance , 1994 .

[57]  Timo Salminen,et al.  Computer‐based and Face‐to‐face Collaborative Argumentation in Secondary Schools in England and Finland , 2005 .

[58]  R. Duschl,et al.  "Doing the Lesson" or "Doing Science": Argument in High School Genetics , 2000 .

[59]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[60]  J. Sinclair,et al.  Towards an Analysis of Discourse: The English Used by Teachers and Pupils , 1975 .

[61]  M. Quignard A collaborative model of argumentation in dyadic problem-solving interactions , 2002 .

[62]  J. A. Blair,et al.  Fundamentals of Argumentation Theory : A Handbook of Historical Backgrounds and Contemporary Developments , 1997 .

[63]  H. C. Bunt Dialogue control functions and interaction design , 1994 .

[64]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[65]  B. Webber,et al.  Elements of Discourse Understanding , 1983 .

[66]  Alain Trognon,et al.  How Does the Process of Interaction Work When Two Interlocutors Try to Resolve a Logical Problem , 1993 .

[67]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[68]  D. Bouwhuis,et al.  The Structure of Multimodal Dialogue , 1989 .

[69]  Selma Leitão,et al.  The Potential of Argument in Knowledge Building , 2000, Human Development.

[70]  A. Veerman Constructive Discussions through Electronic Dialogue , 2003 .

[71]  M. Baker ARGUMENTATIVE INTERACTIONS, DISCURSIVE OPERATIONS AND LEARNING TO MODEL IN SCIENCE , 2002 .

[72]  P. Coirier,et al.  Foundations of argumentative text processing , 2000 .

[73]  G. Stahl Building collaborative knowing: elements of a social theory of CSCL , 2004 .