A 3D Virtual Learning System for STEM Education

A recent boom has been seen in 3D virtual worlds for entertainment, and this in turn has led to a surge of interest in their educational applications. Although booming development has been seen, most of them only strengthen the traditional teaching methods using a new platform without changing the nature of how to teach and learn. Modern computer science technology should be applied in STEM education for the purpose of rising learning efficiency and interests. In this paper, we focus on the reasoning, design, and implementation of a 3D virtual learning system that merges STEM experiments into virtual laboratory and brings entertainment to knowledge learning. An advanced hand gesture interface was introduced to enable flexible manipulation on virtual objects with two hands. The recognition ability of single hand grasping-moving-rotating activity SH-GMR allows single hand to move and rotate a virtual object at the same time. We implemented several virtual experiments in the VR environment to demonstrate to the public that the proposed system is a powerful tool for STEM education. The benefits of this system are evaluated followed by two virtual experiments in STEM field.

[1]  Tao Ma,et al.  A Method for Single Hand Fist Gesture Input to Enhance Human Computer Interaction , 2013, HCI.

[2]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[3]  Light Greg,et al.  Learning and teaching in higher education , 2001 .

[4]  B. Mohan.  Language and Content , 1985 .

[5]  Atsusi Hirumi,et al.  Examining the pedagogical foundations of modern educational computer games , 2008, Comput. Educ..

[6]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[7]  Emanuele Trucco,et al.  A compact algorithm for rectification of stereo pairs , 2000, Machine Vision and Applications.

[8]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[9]  Veronica S. Pantelidis.  Virtual Reality in the Classroom , 1993 .

[10]  Tae-Kyun Kim,et al.  Tensor Canonical Correlation Analysis for Action Classification , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Joseph Psotka,et al.  Immersive training systems: Virtual reality and education and training , 1995 .

[12]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  G. Gibbs,et al.  Conditions Under Which Assessment Supports Students’ Learning , 2005 .

[14]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.