Measurement of Outcomes in Virtual Environments

Virtual human resource development (VHRD) creates a virtual environment (Bennett, 2009). As virtual environments become pervasive as instructional and learning spaces, evidence of their effectiveness is still in the early stages of development. As these learning spaces gain acceptance and adoption in HRD practice, more comprehensive and strategic approaches to evaluation are needed. Through a study of literature and qualitative case study, the authors investigate evaluation practices used in virtual worlds, and discuss how they are relevant to VHRD. Although many traditional forms of assessment are still being utilized, findings indicate that virtual worlds offer the opportunity to incorporate richer and more authentic forms of assessment, particularly, when evaluating learning artifacts.

[1]  R. Yin Case Study Research: Design and Methods , 1984 .

[2]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[3]  Dale C. Alverson,et al.  Knowledge-Driven Design of Virtual Patient Simulations. , 2009 .

[4]  Sean C. Duncan,et al.  Scientific Habits of Mind in Virtual Worlds , 2008 .

[5]  Michele D. Dickey Three-dimensional virtual worlds and distance learning: two case studies of Active Worlds as a medium for distance education , 2005, Br. J. Educ. Technol..

[6]  Sharan B. Merriam,et al.  Qualitative research and case study applications in education , 1998 .

[7]  John R. Slate,et al.  Teaching and learning in Second Life: Using the Community of Inquiry (CoI) model to support online instruction with graduate students in instructional technology , 2010, Internet High. Educ..

[8]  Wm. LeRoy Heinrichs,et al.  Exploring Virtual Worlds for Scenario-Based Repeated Team Training of Cardiopulmonary Resuscitation in Medical Students , 2010, Journal of medical Internet research.

[9]  Winston Tellis,et al.  Introduction to Case Study , 1997 .

[10]  David Chen,et al.  Using the Observer to analyze learning in virtual worlds , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[11]  Thomas C. Reeves,et al.  Designing authentic activities in web-based courses , 2004, J. Comput. High. Educ..

[12]  Elisabeth E. Bennett Virtual HRD: The Intersection of Knowledge Management, Culture, and Intranets , 2009 .

[13]  Mariano Alcañiz Raya,et al.  Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project , 2010, Comput. Educ..

[14]  Margarita Pérez-García,et al.  MUVEnation: A European peer-to-peer learning programme for teacher training in the use of MUVEs in education , 2009, Br. J. Educ. Technol..

[15]  Steven Warburton,et al.  3D Design and Collaboration in Massively Multi-User Virtual Environments (MUVEs) , 2010 .

[16]  Phillip M. Harter,et al.  Simulation for Team Training and Assessment: Case Studies of Online Training with Virtual Worlds , 2008, World Journal of Surgery.

[17]  M. B. Ligorio,et al.  Teacher guidelines for cross-national virtual communities in primary education , 2007, J. Comput. Assist. Learn..

[18]  Steven Warburton,et al.  Second Life in higher education: Assessing the potential for and the barriers to deploying virtual worlds in learning and teaching , 2009, Br. J. Educ. Technol..

[19]  Steve Wheeler,et al.  Second Life: an overview of the potential of 3-D virtual worlds in medical and health education. , 2007, Health information and libraries journal.

[20]  Elisabeth R. Hayes,et al.  Situated Learning in Virtual Worlds: The Learning Ecology of Second Life , 2006 .

[21]  Catherine C. Marshall,et al.  Designing Qualitative Research , 1996 .

[22]  Stacy Kluge,et al.  Teaching in Virtual Worlds: Opportunities and Challenges , 2008 .

[23]  Martin Oliver,et al.  Learning in virtual worlds: Using communities of practice to explain how people learn from play , 2009, Br. J. Educ. Technol..

[24]  Brian C. Nelson,et al.  A multi-user virtual environment for building and assessing higher order inquiry skills in science , 2010, Br. J. Educ. Technol..

[25]  John Carroll,et al.  Evaluating Coursework in Computer Games Degrees: Students and Assessors as Virtual Characters , 2009 .

[26]  Terry L Conway,et al.  Evaluation of an Internet virtual world chat room for adolescent smoking cessation. , 2007, Addictive behaviors.

[27]  Takenobu Inoue,et al.  Assessment of driving skills using Virtual Reality: Comparative survey on experts and unskilled users of electric wheelchairs , 2006 .

[28]  Tony M. O'Driscoll,et al.  Another life: virtual worlds as tools for learning , 2007, ELERN.

[29]  Petra Jansen,et al.  Empirical evaluation of virtual environment technology as an experimental tool in developmental spatial cognition research , 2009 .

[30]  Phillip L. Hunsaker,et al.  Using social simulations to assess and train potential leaders to make effective decisions in turbulent environments , 2007 .

[31]  J. Creswell Qualitative inquiry and research design: choosing among five traditions. , 1998 .

[32]  S. Baker,et al.  Using Virtual Worlds in Education: Second Life® as an Educational Tool , 2009 .

[33]  Rochell R. McWhorter,et al.  A Study of Adult Learning in a Virtual World , 2010 .

[34]  Leslie Jarmon,et al.  Virtual world teaching, experiential learning, and assessment: An interdisciplinary communication course in Second Life , 2009, Comput. Educ..

[35]  Genny Tortora,et al.  Development and evaluation of a virtual campus on Second Life: The case of SecondDMI , 2009, Comput. Educ..

[36]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .