Providing Cognitive and Social Networking Assessment to Virtualized Collaborative Learning in Engineering Courses

In previous research we proposed a new type of learning resource named Collaborative Complex Learning Resource (CC-LR) in support for teaching and learning engineering education by the virtualization of live collaborative sessions, with the aim to leverage the knowledge elicited during the collaboration and produce interactive and attractive resources to be played by engineering learners. We claimed this type of pedagogically and technologically augmented learning resources is able to overcome endemic problems found in collaborative learning of on-line engineering courses, such as lack of authentic interactivity, user empowerment, social identity and challenge, thus having a positive effect in learner engagement. In order to enhance further learning engagement we endowed CC-LR with a multifold cognitive assessment approach that provided effective awareness and constructive feedback to learners from both the live collaborative interaction amongst group members (deferred or retrospective assessment) and the immediate assessment of the learners consuming the CC-LR. In this paper we focus and concentrate in deferred assessment and extend it with innovative assessment indicators from analyzing and representing social network interaction during the live collaboration. These new indicators are integrated into our multi-fold assessment approach to produce a personalized assessment feedback to ultimately enhance and improve the collaborative learning experience with CC-LRs.

[1]  Sebastián Ventura,et al.  Data mining in education , 2013, WIREs Data Mining Knowl. Discov..

[2]  Stanley Wasserman,et al.  Social Network Analysis: Social Network Analysis in the Social and Behavioral Sciences , 1994 .

[3]  Barbara J. Millis,et al.  Cooperative Learning for Higher Education Faculty , 1997 .

[4]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[5]  J. Stanley,et al.  Book Review: Taxonomy of Educational Objectives, The Classification of Educational Goals, Handbook I: Cognitive Domain , 1957 .

[6]  Fatos Xhafa,et al.  A layered framework for evaluating on-line collaborative learning interactions , 2006, Int. J. Hum. Comput. Stud..

[7]  Cristina L. Abad Learning through creating learning objects: experiences with a class project in a distributed systems course , 2008, SIGCSE 2008.

[8]  Ulrik Brandes,et al.  Social Networks , 2013, Handbook of Graph Drawing and Visualization.

[9]  Cristina L. Abad Learning through creating learning objects: experiences with a class project in a distributed systems course , 2008, ITiCSE.

[10]  David Wiley,et al.  Connecting learning objects to instructional design theory: A definition, a metaphor, and a taxonomy , 2000 .

[11]  Ellen Rusman,et al.  Design Patterns For Collaborative Learning: From Practice To Theory And Back , 2004 .

[12]  Santi Caballe,et al.  Collaborative Complex Learning Objects in Support for Social and Collaborative Just-in-Time Networking , 2011 .

[13]  T. Dary Erwin,et al.  Assessing Student Learning and Development: A Guide to the Principles, Goals, and Methods of Determining College Outcomes , 1991 .

[14]  B Pena-ShaffJudith,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004 .

[15]  Jordi Conesa,et al.  CC-LR: providing interactive, challenging and attractive Collaborative Complex Learning Resources , 2014, J. Comput. Assist. Learn..

[16]  Qiyun Wang,et al.  Designing a web-based constructivist learning environment , 2009, Interact. Learn. Environ..

[17]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[18]  Vic Lally,et al.  Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for Social Network Analysis , 2007, Int. J. Comput. Support. Collab. Learn..

[19]  Daniel L. Schwartz,et al.  The Productive Agency that Drives Collaborative Learning , 1998 .

[20]  Sarah Schrire,et al.  Knowledge building in asynchronous discussion groups: Going beyond quantitative analysis , 2006, Comput. Educ..

[21]  Barry Wellman,et al.  Social Network Analysis: An Introduction 1 , 2010 .

[22]  Judith B. Pena-Shaff,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004, Comput. Educ..

[23]  Malcolm D. Swan,et al.  Collaborative Learning in Mathematics: A Challenge to Our Beliefs and Practices , 2006 .

[24]  John A. Self,et al.  Formal Approaches to Student Modelling , 1994 .

[25]  Daniel J. Brass,et al.  Network Analysis in the Social Sciences , 2009, Science.

[26]  Davinia Hernández Leo,et al.  Computational Representation of Collaborative Learning Flow Patterns using IMS Learning Design , 2005, J. Educ. Technol. Soc..

[27]  Bert Bredeweg,et al.  Student Modelling: The Key to Individualized Knowledge-Based Instruction , 2010, NATO ASI Series.

[28]  Angel A. Juan,et al.  Providing effective feedback, monitoring and evaluation to on-line collaborative learning discussions , 2011, Comput. Hum. Behav..

[29]  Tammy Schellens,et al.  Fostering knowledge construction in university students through asynchronous discussion groups , 2006, Comput. Educ..

[30]  Thanasis Daradoumis,et al.  Towards a Multi-fold Assessment Approach to Enrich the Virtualization of Collaborative Learning , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[31]  Fatos Xhafa,et al.  Modeling and performance analysis of networking and collaborative systems , 2011, Simul. Model. Pract. Theory.

[32]  Qiyun Wang,et al.  Investigating critical thinking and knowledge construction in an interactive learning environment , 2009, Interact. Learn. Environ..

[33]  Jordi Conesa,et al.  Design of an emotion aware e-learning system , 2012, Int. J. Knowl. Learn..

[34]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[35]  P. Fahy Online and face-to-face group interaction processes compared using Bales’ Interaction Process Analysis (IPA). , 2006 .

[36]  Osmar R. Zaïane,et al.  Analyzing Participation of Students in Online Courses Using Social Network Analysis Techniques , 2011, EDM.