Learning to Learn and Work in Net-Based Teams: Supporting Emergent Collaboration with Visualization Tools

This chapter reports on research into the development and use of automatically generated visualizations to support teachers and students in net-based collaborative learning. Methods and tools are introduced that we developed to provide information about participation intensity and patterns as well as about structural aspects of the emerging group artifacts. Some of the visualizations are specific to the kinds of project-oriented learning typical for Higher Education, such as capstone projects in Computer Science, while others are more generic in nature and can be applied, for instance, to any form of collaborative writing task. We motivate our methods for providing mirroring and feedback information to teachers and students by an analysis of research on collaborative artifact production, in particular on collaborative writing with wikis, and by a review of methods for team-skills development. We also describe observations on student teams that engaged with our tools. The chapter ends with a discussion of how computational methods that focus on mirroring and feedback (formative assessment) can contribute to new forms of summative assessment, such as grading students’ collaborative work.

[1]  Catherine E. Volpe,et al.  Defining Competencies and Establishing Team Training Requirements , 1995 .

[2]  Manuel Zacklad Documentarisation Processes in Documents for Action (DofA): The Status of Annotations and Associated Cooperation Technologies , 2006, Computer Supported Cooperative Work (CSCW).

[3]  Carol K. K. Chan,et al.  Students assessing their own collaborative knowledge building , 2006, Int. J. Comput. Support. Collab. Learn..

[4]  Jill Burstein,et al.  Automated Essay Scoring : A Cross-disciplinary Perspective , 2003 .

[5]  Jonathan J. Cadiz,et al.  Coordination, overload and team performance: effects of team communication strategies , 1998, CSCW '98.

[6]  S. Kozlowski,et al.  Multilevel Theory, Research, and Methods in Organizations: Foundations, Extensions, and New Directions , 2000 .

[7]  M. Scardamalia,et al.  Knowledge Building: Theory, Pedagogy, and Technology , 2006 .

[8]  K. Popper Objective Knowledge: An Evolutionary Approach , 1972 .

[9]  B. Mullen,et al.  Theories of group behavior , 1987 .

[10]  Gabriel Ripoche,et al.  Experiences in Automating the Analysis of Linguistic Interactions for the Study of Distributed Collectives , 2006, Computer Supported Cooperative Work (CSCW).

[11]  Judy Kay,et al.  WikiNavMap: a visualisation to supplement team-based wikis , 2007, CHI Extended Abstracts.

[12]  F. Fischer,et al.  Collaboration Scripts – A Conceptual Analysis , 2006 .

[13]  J.F. Nunamaker,et al.  The impact of process structure on novice, virtual collaborative writing teams , 2005, IEEE Transactions on Professional Communication.

[14]  Eduardo Salas,et al.  The Effect of Team Building on Performance , 1999 .

[15]  R. Gillies The effects of cooperative learning on junior high school students during small group learning , 2004 .

[16]  E. Soloway,et al.  Creating a Framework for Research on Systemic Technology Innovations , 2004 .

[17]  R. Sawyer The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[18]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[19]  D. Wegner Transactive Memory: A Contemporary Analysis of the Group Mind , 1987 .

[20]  R. Gillies,et al.  Teaching collaborative skills to primary school children in classroom-based work groups , 1996 .

[21]  M. Scardamalia,et al.  Higher Levels of Agency for Children in Knowledge Building: A Challenge for the Design of New Knowledge Media , 1991 .

[22]  Stuart O. Yager,et al.  The Impact of Group Processing on Achievement in Cooperative Learning Groups , 1986 .

[23]  Thérèse Laferrière,et al.  Technology in Support of Collaborative Learning , 2007 .

[24]  Elizabeth Bagley,et al.  Epistemic network analysis : a Prototype for 21 st Century assessment of Learning , 2009 .

[25]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[26]  P. Lowry,et al.  Building a Taxonomy and Nomenclature of Collaborative Writing to Improve Interdisciplinary Research and Practice , 2004 .

[27]  J. Stoker,et al.  Advances in Interdisciplinary Studies of Work Teams , 1997 .

[28]  John Scott Social Network Analysis , 1988 .

[29]  P. Buller,et al.  Effects of Team Building and Goal Setting on Productivity: A Field Experiment , 1986 .

[30]  K. Hakkarainen,et al.  The Knowledge Creation Metaphor – An Emergent Epistemological Approach to Learning , 2005 .

[31]  Tim S. Roberts Online Collaborative Learning: Theory and Practice , 2003 .

[32]  Beatriz Barros,et al.  Analysing student interaction processes in order to improve collaboration. The DEGREE approach , 2000 .

[33]  Gerry Stahl,et al.  Sustaining Group Cognition in a Math Chat Environment , 2006, Res. Pract. Technol. Enhanc. Learn..

[34]  Alejandra Martínez-Monés,et al.  Supporting Members of a Learning Community Using Interaction Analysis Tools: The Example of the Kaleidoscope NoE Scientific Network , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[35]  Carolyn Penstein Rosé,et al.  Supporting CSCL with automatic corpus analysis technology , 2005, CSCL.

[36]  C. Dwyer,et al.  The Future of Assessment : Shaping Teaching and Learning , 2008 .

[37]  J. McGrath Time, Interaction, and Performance (TIP) , 1991 .

[38]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[39]  Kathleen M. Carley An approach for relating social structure to cognitive structure , 1986 .

[40]  Rafael A. Calvo,et al.  Glosser: Enhanced Feedback for Student Writing Tasks , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[41]  Wolfgang Reisig Petri Nets: An Introduction , 1985, EATCS Monographs on Theoretical Computer Science.

[42]  E. Entin,et al.  Communication overhead: The hidden cost of team cognition. , 2004 .

[43]  L. Lipponen,et al.  Models of Innovative Knowledge Communities and Three Metaphors of Learning , 2004 .

[44]  J. Guthrie Encyclopedia of Education , 2002 .

[45]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994 .

[46]  Peter W. Foltz,et al.  The Measurement of Textual Coherence with Latent Semantic Analysis. , 1998 .

[47]  Thomas W. Malone,et al.  Coordination Theory and Collaboration Technology , 2001 .

[48]  Janet L. Kolodner,et al.  Problem-Based Learning Meets Case-Based Reasoning in the Middle-School Science Classroom: Putting Learning by Design(tm) Into Practice , 2003 .

[49]  Kurt VanLehn Intelligent Tutoring Systems for Continuous, Embedded Assessment , 2007 .

[50]  Jerry Andriessen,et al.  Representational Tools in Computer-Supported Collaborative Argumentation-Based Learning: How Dyads Work With Constructed and Inspected Argumentative Diagrams , 2007 .

[51]  Susanne Bødker,et al.  Computer Support for Social Awareness in Flexible Work , 2006, Computer Supported Cooperative Work (CSCW).

[52]  J. Prichard,et al.  Training students to work in teams: why and how? , 2004 .

[53]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[54]  Daniel R. Ilgen,et al.  Enhancing the Effectiveness of Work Groups and Teams , 2006, Psychological science in the public interest : a journal of the American Psychological Society.

[55]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[56]  Robert Albanese,et al.  Rational Behavior in Groups: The Free-Riding Tendency , 1985 .

[57]  Judy Kay,et al.  The Big Five and Visualisations of Team Work Activity , 2006, Intelligent Tutoring Systems.

[58]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[59]  Silvan Reinhold WikiTrails: augmenting Wiki structure for collaborative, interdisciplinary learning , 2006, WikiSym '06.

[60]  Kathleen M. Carley,et al.  AutoMap User's Guide , 2006 .

[61]  Manu Kapur,et al.  Productive Failure: A Hidden Efficacy of Seemingly Unproductive Production , 2006 .

[62]  Gijsbert Erkens,et al.  Coordination processes in computer supported collaborative writing , 2005, Comput. Hum. Behav..

[63]  Daniel T. Hickey,et al.  Balancing varied assessment functions to attain systemic validity: Three is the magic number , 2006 .

[64]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[65]  Daniela E. Damian,et al.  Essential communication practices for Extreme Programming in a global software development team , 2006, Inf. Softw. Technol..

[66]  J. Prichard,et al.  Team-skills training enhances collaborative learning , 2006 .

[67]  David H. Jonassen,et al.  Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge , 1993 .

[68]  Peter Reimann,et al.  How to support groups in learning: more than problem solving , 2003 .

[69]  F. Tschan,et al.  Temporal Matters in Social Psychology: Examining the Role of Time in the Lives of Groups and Individuals , 2003 .

[70]  S. Ohlsson,et al.  Complex Declarative Learning. , 2005 .

[71]  Melanie J. Ashleigh,et al.  The Effects of Team-Skills Training on Transactive Memory and Performance , 2007 .

[72]  V. Shute Focus on Formative Feedback , 2008 .

[73]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[74]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[75]  A. Sfard On Two Metaphors for Learning and the Dangers of Choosing Just One , 1998 .

[76]  David W. Johnson,et al.  Impact of Group Processing on Achievement in Cooperative Groups. , 1990, The Journal of social psychology.

[77]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..

[78]  Michael J. Jacobson,et al.  Emergence of learning in computer-supported, large-scale collective dynamics: a research agenda , 2007, CSCL.

[79]  Holly Arrow,et al.  Small Groups as Complex Systems: Formation, Coordination, Development, and Adaptation , 2000 .

[80]  Kathleen M. Carley Extracting team mental models through textual analysis , 1997 .

[81]  Wil M. P. van der Aalst,et al.  Process Aware Information Systems: Bridging People and Software Through Process Technology , 2005 .

[82]  Eduardo Salas,et al.  Making decisions under stress: Implications for individual and team training. , 1998 .

[83]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[84]  Curtis J. Bonk,et al.  Electronic Collaborators: Learner-Centered Technologies for Literacy, Apprenticeship, and Discourse , 1998 .

[85]  Adam Souzis,et al.  Building a Semantic Wiki , 2005, IEEE Intell. Syst..

[86]  David Williamson Shaffer,et al.  Education in the digital age , 2008 .

[87]  E. Wenger Communities of Practice: Learning, Meaning, and Identity , 1998 .

[88]  C. Hardy,et al.  Discourse and Institutions , 2004 .