Assessing Learning in VR: Towards Developing a Paradigm Virtual Reality in Roving Vehicles

Preliminary research on virtual reality (VR) suggests that this technology could be a powerful tool for education based on its immersive and dynamic attributes. The Virtual Reality Roving Vehicles (VRRV) Project at the University of Washington is exploring these possibilities by taking VR equipment into elementary and secondary schools for students and teachers to experience and use in building virtual worlds. The question of how to assess VR is particularly significant because of the theoretical conflict between traditional and constructivist learning approaches. This eport presents an example of how the VRRV Project iv using VR in schools and identifies significant factors for assessment. Junior high school stu,lents (n=120) integrated the building of virtual worlds into a curriculum on wetland ecology. With regard to this project and other VR uses, the issue of test reliability versus validity is addressed in terms of general education and using VR. The underlying psychological theories of information processing and constructivism are discussed in terms of developing a comprehensive paradigm to guide the application and research of VR. This discussion is followed by an overview of specific approaches for measuring learning in VR, along with hints and cautions about conducting educational assessment. (Contains 2 figures and 70 references.) (Author/SLD) Reproductions supplied by EDRS are the best that can be made from the original document. *************** ;:****ft******************************** Assessing Learning in VR: Towards Developing a Paradigm Virtual Reality Roving Vehicles (VRRV) Project* Howard Rose hroseehitl.washington.edu U.S. DEPARTMENT OF EDUCATION Office of EducafioneI Research and Improvement ED ONAL RESOURCES INFORMATION CENTER (ERIC) Thts dOcument has been reproduced as roctiowdocl from the person or orgsn.zafion ocigenattng a 0 Minor changes have been made to trnprore reproduchon quality Rooms of wow or opiruons stated sn !Ms document do .01 necessanly represent &kw OERI postfion or poficy -PERMISSION TO REPRODUCE THIS MATERIAL HAS BEEN GRANTED BY TO THE EDUCATIONAL RESOURCES INFORMATION CEN1ER IERIC)

[1]  B. Rosenshine,et al.  Reciprocal Teaching: A Review of the Research , 1994 .

[2]  Stanley D. Stephenson.  The Effect of Instructor-Student Interaction on Achievement in Computer- Based Training (CBT). , 1991 .

[3]  William Winn,et al.  Designing virtual worlds for use in mathematics education: the example of experimental algebra , 1992 .

[4]  H.G. Hoffman,et al.  Virtual-reality monitoring , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[5]  R. Glaser.  The Reemergence of Learning Theory within Instructional Research. , 1990 .

[6]  C A Nelson,et al.  Learning to Learn , 2017, Encyclopedia of Machine Learning and Data Mining.

[7]  J. Lachman,et al.  Cognitive Psychology and Information Processing: An Introduction , 1979 .

[8]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[9]  Thomas C. Reeves,et al.  Research and evaluation models for the study of interactive video , 1986 .

[10]  David W. Dalton,et al.  Effects of individual and cooperative computer-assisted instruction on student performance and attitudes , 1989 .

[11]  Catherine S. Taylor.  Assessment for Measurement or Standards: The Peril and Promise of Large-Scale Assessment Reform , 1994 .

[12]  R. Shavelson.  Performance Assessment in Science , 1991 .

[13]  Thomas C. Reeves,et al.  Pseudoscience in Computer-Based Instruction: The Case of Learner Control Research. , 1993 .

[14]  Edith Ackermann.  Direct and mediated Experience: Their Role in Learning , 1993, Lessons from Learning.

[15]  Annemarie Sullivan Palincsar,et al.  Reciprocal Teaching of Comprehension Strategies: A Natural History of One Program for Enhancing Learning. Technical Report No. 334. , 1985 .

[16]  Marilyn L. Kourilsky,et al.  Mini-Society: Experiencing Real-World Economics in the Elementary School Classroom@@@Understanding Economics: Overview for Teachers, Experiences for Students , 1983 .

[17]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[18]  David W. Dalton.  The effects of cooperative learning strategies on achievement and attitudes during interactive video , 1990 .

[19]  James M. Royer,et al.  Techniques and Procedures for Assessing Cognitive Skills , 1993 .

[20]  William Winn,et al.  The assumptions of constructivism and instructional design , 1991 .

[21]  Jon Ogborn.  The design of exploratory and expressive learning environments , 1993, Lessons from Learning.

[22]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[23]  John R. Anderson.  The Adaptive Character of Thought , 1990 .

[24]  Donald J. Cunningham.  In defense of extremism , 1991 .

[25]  V. Clarke.  Sex Differences in Computing Participation: Concerns, Extent, Reasons and Strategies , 1990 .

[26]  Lucy Suchman,et al.  Understanding practice: video as a medium for reflection and design (excerpt) , 1992 .

[27]  Robert M. Gagné,et al.  Instructional Technology: Foundations , 1988 .

[28]  William Winn,et al.  Instructional design and intelligent systems: shifts in the designer's decision-making role , 1987 .

[29]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[30]  David D. Kumar,et al.  Hypermedia: a tool for alternative assessment? , 1994 .

[31]  Bernard M. Frank,et al.  The Effect of Learners' Field Independence, Cognitive Strategy Instruction, and Inherent Word-List Organization on Free-Recall Memory and Strategy Use , 1993 .

[32]  R. B. Loftin,et al.  Applying virtual reality in education: A prototypical virtual physics laboratory , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[33]  Fran Blumberg.  A Pilot Study of Higher-Order Thinking Skills Assessment Techniques in Science and Mathematics--Part I and Pilot-Tested Tasks--Part II. Final Report. , 1986 .

[34]  David W. Johnson,et al.  Effects of cooperative, competitive, and individualistic goal structures on computer-assisted instruction. , 1985 .

[35]  Robert M. Gagné,et al.  Essentials of Learning for Instruction , 1988 .

[36]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .

[37]  Ann L. Brown,et al.  Guided, Cooperative Learning and Individual Knowledge Acquisition , 2018, Knowing, Learning, and Instruction.

[38]  Carl F. Berger,et al.  The Importance of Group Size in the Use of Problem-Solving Skills on a Microcomputer , 1985 .

[39]  P. Moss.  Shifting Conceptions of Validity in Educational Measurement: Implications for Performance Assessment , 1992 .

[40]  D. Goodenough.  The role of individual differences in field dependence as a factor in learning and memory. , 1975, Psychological bulletin.

[41]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[42]  David W. Johnson,et al.  Comparison Of Computer-Assisted Cooperative, Competitive, And Individualistic Learning , 1986 .

[43]  T. S. Hasselbring,et al.  Macro‐contexts for learning: Initial findings and issues , 1987 .

[44]  Woodrow Barfield,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[45]  Kathryn F. Cochran,et al.  An information processing view of field dependence‐independence∗ , 1989 .

[46]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[47]  Stuart O. Yager,et al.  Oral Discussion, Group-to-individual Transfer, and Achievement in Cooperative Learning Groups , 1985 .

[48]  E. Quellmalz.  Developing Criteria for performance Assessments: The Missing Link , 1991 .

[49]  Chris Pipho,et al.  The Impact of a National Test at the State Level. , 1992 .

[50]  Scott Lewis,et al.  Problem-Solving Strategies and Group Processes in Small Groups Learning Computer Programming , 1986 .

[51]  Wayne L. Shebilske,et al.  Virtual Reality: An Instructional Medium for Visual-Spatial Tasks. , 1992 .