Intelligent Augmented Reality Training for Assembly Tasks

We investigate the combination of Augmented Reality (AR) with Intelligent Tutoring Systems (ITS) to assist with training for manual assembly tasks. Our approach combines AR graphics with adaptive guidance from the ITS to provide a more effective learning experience. We have developed a modular software framework for intelligent AR training systems, and a prototype based on this framework that teaches novice users how to assemble a computer motherboard. An evaluation found that our intelligent AR system improved test scores by 25% and that task performance was 30% faster compared to the same AR training system without intelligent support. We conclude that using intelligent AR tutor can significantly improve learning compared to traditional AR training.

[1]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[2]  Woodrow Barfield,et al.  Evaluating the effectiveness of augmented reality displays for a manual assembly task , 1999, Virtual Reality.

[3]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[4]  Magnus Haake,et al.  Design of animated pedagogical agents - A look at their look , 2006, Int. J. Hum. Comput. Stud..

[5]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[6]  Vincent Aleven,et al.  Intelligent Tutoring Goes To School in the Big City , 1997 .

[7]  Tao Sun,et al.  Design for the Cockpit Intelligent Tutoring System Based on Augmented Reality , 2008, 2008 International Symposium on Computational Intelligence and Design.

[8]  Carolyn Penstein Rosé,et al.  The Beginning of a Beautiful Friendship? Intelligent Tutoring Systems and MOOCs , 2015, AIED.

[9]  Antonija Mitrovic,et al.  Fifteen years of constraint-based tutors: what we have achieved and where we are going , 2011, User Modeling and User-Adapted Interaction.

[10]  Antonija Mitrovic,et al.  ASPIRE: An Authoring System and Deployment Environment for Constraint-Based Tutors , 2009, Int. J. Artif. Intell. Educ..

[11]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[12]  Anton Nijholt,et al.  Jacob - An Animated Instruction Agent in Virtual Reality , 2000, ICMI.

[13]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[14]  Tieniu Tan,et al.  Advances in Multimodal Interfaces — ICMI 2000 , 2001, Lecture Notes in Computer Science.

[15]  Mark Billinghurst,et al.  OSGART - A Pragmatic Approach to MR , 2006 .

[16]  Angélica de Antonio Jiménez,et al.  Intelligent Virtual Environments for Training in Nuclear Power Plants , 2004, ICEIS.

[17]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[18]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[19]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[20]  Zhen Liu,et al.  An Emotion Model of 3D Virtual Characters in Intelligent Virtual Environment , 2005, ACII.

[21]  Engelbert Mephu Nguifo,et al.  Exploiting Partial Problem Spaces Learned from Users' Interactions to Provide Key Tutoring Services in Procedural and Ill-Defined Domains , 2009, AIED.

[22]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).