Studying the effectiveness of multi-user immersive environments for collaborative evaluation tasks

Massively Multiuser On-line Learning (MMOL) Platforms, often called ''virtual learning worlds'', constitute a still unexplored context for communication-enhanced learning, where synchronous communication skills in an explicit social setting enhance the potential of effective collaboration. In this paper, we report on an experimental study of collaborative evaluation in an MMOL setting with 21 graduate students enrolled in university courses in technology-mediated teaching and learning. This study was carried out using a prototype of a 3D MMOL platform built around an interactive space called ''MadriPolis''. This space was used to recreate an adequate scenario for a collaborative experience about Learning Object evaluation using the mainstream Learning Object Review Instrument (LORI), which is based on a Convergent Participation Model (CPM). The same experience was carried out using a conventional LCMS (Learning Content Management System) platform with the aim of contrasting the outcomes and interaction patterns in the two settings. This study makes use of Social Network Analysis (SNA) measures to describe the interactions between tutors and learners. By dwelling on the advantages of immersive environments, SNA indexes revealed that these interactions were rather dense and that student participation was rather broad-based in the case of the MMOL. The results suggest that MMOL platforms could be used in collaborative evaluation tasks as a means to enhance both tutor interaction patterns and the strength of the group's relationship.

[1]  FreitasSara de,et al.  The use of 'exploratory learning' for supporting immersive learning in virtual environments , 2009 .

[2]  Christos Bouras,et al.  Educational virtual environments: design rationale and architecture , 2006, Multimedia Tools and Applications.

[3]  J. Bailenson,et al.  The Use of Immersive Virtual Reality in the Learning Sciences: Digital Transformations of Teachers, Students, and Social Context , 2008 .

[4]  Alexandra Poulovassilis,et al.  Learning as immersive experiences: Using the four-dimensional framework for designing and evaluating immersive learning experiences in a virtual world , 2010, Br. J. Educ. Technol..

[5]  David M. Antonacci,et al.  Virtual World Learning Spaces: Developing a Second Life Operating Room Simulation , 2009 .

[6]  Thierry Chanier,et al.  How Social Network Analysis can help to Measure Cohesion in Collaborative Distance-Learning , 2003, CSCL.

[7]  George Siemens.  Learning and knowing in networks: Changing roles for educators and designers , 2008 .

[8]  Daniel Livingstone,et al.  Putting a Second Life “metaverse” skin on learning management systems , 2006 .

[9]  Danielle Mirliss,et al.  Preparing Graduate Students for Virtual World Simulations: Exploring the Potential of an Emerging Technology , 2009 .

[10]  Barbara Wasson,et al.  Designing for Change in Networked Learning Environments, Proceedings of the International Conference on Computer Support for Collaborative Learning, CSCL 2003, Bergen, Norway, June 14-18, 2003 , 2003, CSCL.

[11]  Guy Merchant.  3D virtual worlds as environments for literacy learning , 2010 .

[12]  Senom T. Yalcin,et al.  Online Learning: Patterns of Engagement and Interaction among In-Service teachers , 2003 .

[13]  Ralph Schroeder,et al.  Defining Virtual Worlds and Virtual Environments , 2008 .

[14]  R. Stake.  The art of case study research , 1995 .

[15]  A. Morral,et al.  Aprendizaje basado en problemas , 2002 .

[16]  Sara de Freitas,et al.  The use of 'exploratory learning' for supporting immersive learning in virtual environments , 2009, Comput. Educ..

[17]  David A. Bray,et al.  Virtual worlds: multi-disciplinary research opportunities , 2007, DATB.

[18]  Zane L. Berge,et al.  Multi-User Virtual Environments for Education and Training? A Critical Review of Second Life , 2008 .

[19]  Maarten De Laat,et al.  Network and content analysis in an online community discourse , 2002, CSCL.

[20]  Eileen A. O'Connor,et al.  Instructional and Design Elements That Support Effective Use of Virtual Worlds: What Graduate Student Work Reveals about Second Life , 2009 .

[21]  Elizabeth F. Churchill,et al.  Collaborative Virtual Environments: Digital Spaces and Places for CSCW: An Introduction , 2001, Collaborative Virtual Environments.

[22]  Randolph L. Jackson,et al.  Collaboration and learning within immersive virtual reality , 2000, CVE '00.

[23]  Marina Umaschi Bers,et al.  The virtual campus of the future: stimulating and simulating civic actions in a virtual world , 2010, J. Comput. High. Educ..

[24]  Matthew J. Morris,et al.  WebTOP: A 3D interactive system for teaching and learning optics , 2007, Comput. Educ..

[25]  Chunyan Miao,et al.  Design Perspectives for Learning in Virtual Worlds , 2010 .

[26]  Mariano Alcañiz Raya,et al.  Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project , 2010, Comput. Educ..

[27]  Yesha Y. Sivan,et al.  3D3C Real Virtual Worlds Defined: The Immense Potential of Merging 3D, Community, Creation, and Commerce , 2008 .

[28]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[29]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[30]  Carlos-Miguel Lorenzo.  A review of interoperability and possibilities for data analysis from virtual world environments , 2011, Int. J. Metadata Semant. Ontologies.

[31]  Daniel Livingstone,et al.  From Multi-User Virtual Environment to 3D Virtual Learning Environment , 2008 .

[32]  Shailey Minocha,et al.  Design of learning spaces in 3D virtual worlds: an empirical investigation of Second Life , 2010 .

[33]  Carlos M. Lorenzo.  MMOL platforms: open 3D learning technologies in educational practices , 2011 .

[34]  John Scott.  Social Network Analysis , 1988 .

[35]  John C. Nesbit,et al.  Learning Object Evaluation: Computer-Mediated Collaboration And Inter-Rater Reliability , 2003 .

[36]  Hyo-Jeong So.  RUNNING HEAD : STUDENT PERCEPTIONS OF COOPERATIVE LEARNING Student Perceptions of Cooperative Learning in a Distance Learning Environment : Relationships with Social Presence and Satisfaction , 2006 .

[37]  Michele D. Dickey.  Three-dimensional virtual worlds and distance learning: two case studies of Active Worlds as a medium for distance education , 2005, Br. J. Educ. Technol..

[38]  Vic Lally,et al.  Online teaching in networked learning communities: A multi-method approach to studying the role of the teacher , 2007 .

[39]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[40]  Zane L. Berge,et al.  Changing Instructor's Roles in Virtual Worlds , 2008 .

[41]  Roger Smith,et al.  The Long History of Gaming in Military Training , 2010 .

[42]  Fernando Bello,et al.  Using multimedia and Web3D to enhance anatomy teaching , 2007, Comput. Educ..

[43]  Miguel Nussbaum,et al.  From MMORPG to a Classroom Multiplayer Presential Role Playing Game , 2010, J. Educ. Technol. Soc..

[44]  E. Wenger,et al.  Legitimate Peripheral Participation , 1991 .

[45]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[46]  Stephen C. Bronack,et al.  Presence Pedagogy: Teaching and Learning in a 3D Virtual Immersive World. , 2008 .

[47]  Ruzena Bajcsy,et al.  The Effects of Fully Immersive Virtual Reality on the Learning of Physical Tasks , 2006 .

[48]  Genny Tortora,et al.  Development and evaluation of a virtual campus on Second Life: The case of SecondDMI , 2009, Comput. Educ..

[49]  Steve Benford,et al.  Collaborative virtual environments : digital places and spaces for interaction , 2001 .

[50]  Daniel Livingstone,et al.  Massively Multi-Learner: Recent Advances in 3D Social Environments , 2006 .

[51]  Alejandra Martínez-Monés,et al.  Combining qualitative evaluation and social network analysis for the study of classroom social interactions , 2003, Comput. Educ..

[52]  Robert E. Stake,et al.  Multiple Case Study Analysis , 2005 .

[53]  Frank Kappe,et al.  Enhancements of the realXtend framework to build a Virtual Conference Room for Knowledge Transfer and Learning Purposes , 2009 .

[54]  Christopher Peter Clarke.  Second Life in the library: an empirical study of new users' experiences , 2012, Program.

[55]  Moez Limayem,et al.  3D Social Virtual Worlds: Research Issues and Challenges , 2008, IEEE Internet Computing.

[56]  Manolya Kavakli,et al.  Learning science in a virtual reality application: The impacts of animated-virtual actors' visual complexity , 2010, Comput. Educ..

[57]  E. A. Attree,et al.  Training in virtual environments: transfer to real world tasks and equivalence to real task training , 2000, Ergonomics.

[58]  Brian S. Butler,et al.  Selecting a Virtual World Platform for Learning , 2009, J. Inf. Syst. Educ..

[59]  Sten R. Ludvigsen,et al.  Designing for Change in Networked Learning Environments (Computer-Supported Collaborative Learning Series) , 2004 .

[60]  Alexandra Petrakou,et al.  Interacting through avatars: Virtual worlds as a context for online education , 2010, Comput. Educ..

[61]  Carina Girvan,et al.  Identifying an appropriate pedagogy for virtual worlds: A Communal Constructivism case study , 2010, Comput. Educ..

[62]  Krzysztof Walczak,et al.  Building Virtual and Augmented Reality museum exhibitions , 2004, Web3D '04.

[63]  Clay Wilson.  Avatars, Virtual Reality Technology, and the U.S. Military: Emerging Policy Issues , 2008 .