Extending the 'Serious Game' Boundary: Virtual Instructors in Mobile Mixed Reality Learning Games

Virtual Instructor enabled mobile augmented reality learning (MARL) games have the potential to provide a fun and educational experience. In these types of “serious games”, learners/game players may wear a mobile headsup display that provide a rich graphical interface over the real world allowing the real world to be augmented with digital annotations including animation, graphics, text, and video. Graphical annotations may highlight specific realworld objects that hint the player to manipulate an object in order to achieve a certain objective in the game. Additionally, a mobile headset may display resource stats including, but not limited to, team hit points and geographical location of individual team members participating in the game experience. Furthermore, a virtual instructor may assist in providing instruction on how to play the video game and assist students in solving challenges that require academic skills. Hence, in a MARL game, a virtual instructor may provide continuous and autonomous instruction or guidance to the game player/learners anytime, anyplace, and at any-pace. The virtual instructor may serve as a mission leader or guide for the player’s real-world quest.

[1]  Bruce H. Thomas,et al.  Usability and playability issues for arquake , 2002, IWEC.

[2]  Deborah A. Cronau Virtual Humans: A Build‐it Yourself Kit Complete with Software and Step‐by‐step Instructions , 2004 .

[3]  Jayfus T. Doswell Pedagogical embodied conversational agent , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[4]  James C. Lester,et al.  Deictic and emotive communication in animated pedagogical agents , 2001 .

[5]  Armin Hammand,et al.  Telegeoinformatics: Location-based Computing and Services , 2004 .

[6]  Norman I. Badler,et al.  Design of a Virtual Human Presenter , 2000, IEEE Computer Graphics and Applications.

[7]  Hassan Gomaa,et al.  Designing Software Product Lines with UML , 2005, 29th Annual IEEE/NASA Software Engineering Workshop - Tutorial Notes (SEW'05).

[8]  Hassan Gomaa Designing Software Product Lines with UML 2.0: From Use Cases to Pattern-Based Software Architectures , 2006, ICSR.

[9]  Bruce H. Thomas Challenges of Making Outdoor Augmented Reality Games Playable , 2003 .

[10]  Bastian Leibe,et al.  MIND-WARPING: towards creating a compelling collaborative augmented reality game , 2000, IUI '00.

[11]  W. Johnson,et al.  Task-oriented collaboration with embodied agents in virtual worlds , 2001 .

[12]  Bjorn Ekengren,et al.  Mobile Augmented Reality , 2010 .

[13]  Suya You,et al.  A video-based augmented reality golf simulator , 2000, MM 2000.

[14]  Jayfus T. Doswell,et al.  Robotics In Mixed-Reality Training Simulations: Augmenting STEM Learning , 2006 .

[15]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .