LASAD: Flexible representations for computer-based collaborative argumentation

Teaching argumentation is challenging, and the factors of how to effectively support the acquisition of argumentation skills through technology are not fully explored yet. One of the key reasons for that is the lack of comparability between studies. In this article, we describe LASAD, a collaborative argumentation framework that can be flexibly parameterized. We illustrate the flexibility of the framework with respect to visualization, structural definitions and kind of cooperation. Using this framework, this paper presents an evaluation of the impact of using an argumentation system with different argument representations and with collaborative vs. individual use on the outcomes of scientific argumentation. We investigate which combinations of these factors produces the best results concerning argument production and learning outcomes. The results of this controlled lab study with 36 participants showed that the use of simple representational formats is superior compared to highly structured ones. Even though the latter encouraged the provision of additional non-given material, the former is less error-prone. A hypothesized structural guidance provided by more complex formats could not be confirmed. With respect to collaboration, the results highlight that arguing in groups lead to more cluttered argumentation maps, including a higher amount of duplicate elements. An expected peer-reviewing between group members did not occur. Yet, groups also tended to include more points-of-view in their arguments, leading to more elaborated argument maps.

[1]  D. Suthers,et al.  Belvedere: Engaging students in critical discussion of science and public policy issues. , 1995 .

[2]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[3]  P. R. Laughlin,et al.  Groups perform better than the best individuals on letters-to-numbers problems: effects of group size. , 2006, Journal of Personality and Social Psychology.

[4]  D. Suthers Representational guidance for collaborative inquiry. , 2003 .

[5]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[6]  R. Sawyer The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[7]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[8]  D. Suthers,et al.  “Mapping to know”: The effects of representational guidance and reflective assessment on scientific inquiry , 2002 .

[9]  Niels Pinkwart,et al.  Computer-Supported Collaborative Learning DOI 10.1007/s11412-009-9080-x Computer-supported argumentation: A review of the state of the art , 2009 .

[10]  Chad S. Carr Using Computer Supported Argument Visualization to Teach Legal Argumentation , 2003, Visualizing Argumentation.

[11]  Baruch B. Schwarz,et al.  The role of floor control and of ontology in argumentative activities with discussion-based tools , 2005, Int. J. Comput. Support. Collab. Learn..

[12]  Christian D. Schunn,et al.  Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system , 2007, Comput. Educ..

[13]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[14]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[15]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[16]  Michael J. Baker,et al.  Arguing to Learn: Confronting Cognitions in Computer-Supported Collaborative Learning Environments , 2003 .

[17]  Jeroen Janssen,et al.  Effects of representational guidance during computer-supported collaborative learning , 2008, ICLS.

[18]  Maralee Harrell No Computer Program Required : Even Pencil-and-Paper Argument Mapping Improves Critical-Thinking Skills , 2008 .

[19]  D. Charles Hair LEGALESE: a legal argumentation tool , 1991, SGCH.

[20]  D. Kuhn Science as argument : Implications for teaching and learning scientific thinking , 1993 .

[21]  D. Kuhn THE SKILLS OF ARGUMENT , 2008, Education for Thinking.

[22]  Niels Pinkwart,et al.  Learning to Argue Using Computers - A View from Teachers, Researchers, and System Developers , 2010, Intelligent Tutoring Systems.

[23]  Simon Buckingham Shum,et al.  Visualizing Argumentation: Software Tools for Collaborative and Educational Sense-Making , 2012 .

[24]  Henry Prakken,et al.  The Carneades model of argument and burden of proof , 2007, Artif. Intell..

[25]  Bruce M. McLaren,et al.  Supporting Collaborative Learning and E-Discussions Using Artificial Intelligence Techniques , 2010, Int. J. Artif. Intell. Educ..

[26]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[27]  Niels Pinkwart,et al.  Computer-Supported Argumentation Learning: A Survey of Teachers, Researchers, and System Developers , 2010, EC-TEL.

[28]  S. Toulmin The uses of argument , 1960 .

[29]  Vincent Aleven,et al.  'Tis Better to Construct than to Receive? The Effects of Diagram Tools on Causal Reasoning , 2007, AIED.

[30]  Vincent Aleven,et al.  Re-evaluating LARGO in the Classroom: Are Diagrams Better Than Text for Teaching Argumentation Skills? , 2008, Intelligent Tutoring Systems.

[31]  Vincent Aleven,et al.  Concepts, Structures, and Goals: Redefining Ill-Definedness , 2009, Int. J. Artif. Intell. Educ..

[32]  Ronald Prescott Loui,et al.  Progress on Room 5: a testbed for public interactive semi-formal legal argumentation , 1997, ICAIL '97.

[33]  Vittorio Scarano,et al.  Face to Face Cooperation with CoFFEE , 2008, EC-TEL.

[34]  S. Erduran,et al.  Arguing to learn and learning to argue: Case studies of how students' argumentation relates to their scientific knowledge , 2008 .

[35]  Jonathan Osborne,et al.  Arguing to Learn in Science: The Role of Collaborative, Critical Discourse , 2010, Science.

[36]  D. Jonassen,et al.  Arguing to learn and learning to argue: design justifications and guidelines , 2010 .

[37]  Niels Pinkwart,et al.  Disburdening Tutors in E-Learning Environments via Web 2.0 Techniques , 2009, Semantic Web Technologies for e-Learning.

[38]  Jerry Andriessen,et al.  The role of diagrams in collaborative argumentation-based learning , 2003 .

[39]  Nikol Rummel,et al.  Can People Learn Computer-Mediated Collaboration by Following A Script? , 2007 .

[40]  Niels Pinkwart,et al.  Automated Analysis and Feedback Techniques to Support and Teach Argumentation: A Survey , 2012 .

[41]  Charlotte Magnusson,et al.  Developing the art of argumentation - a software approach , 2002 .

[42]  Edward F. Gehringer,et al.  Electronic peer review and peer grading in computer-science courses , 2001, SIGCSE '01.

[43]  Yair Neuman,et al.  Two Wrongs May Make a Right ... If They Argue Together! , 2000 .

[44]  Eileen Scanlon,et al.  Combining interaction and context design to support collaborative argumentation using a tool for synchronous CMC , 2004, J. Comput. Assist. Learn..

[45]  Karsten Stegmann,et al.  Facilitating argumentative knowledge construction with computer-supported collaboration scripts , 2007, Int. J. Comput. Support. Collab. Learn..

[46]  Douglas B. Clark,et al.  The Impact of Collaboration on the Outcomes of Scientific Argumentation. , 2009 .

[47]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[48]  Michael J. Baker,et al.  How do argumentation diagrams compare when student pairs use them as a means for debate or as a tool for representing debate? , 2007, Int. J. Comput. Support. Collab. Learn..