A Comparison of Desktop and Augmented Reality Scenario Based Training Authoring Tools

This work presents a comparison of two applications (Augmented Reality (AR) and desktop) to author Scenario-Based Training (SBT) simulations. Through an iterative design process two interface conditions are developed and then evaluated qualitatively and quantitatively. A graph based authoring visualization help designers understand the scenario learning artifacts and relationships. No significant difference was found on time taken to complete tasks nor on the perceived usability of the systems. However, Desktop was perceived as more efficient, corroborated by the significantly higher number of mistakes made in AR. Findings are presented towards building better AR immersive authoring tools.

[1]  Charles E. Hughes,et al.  Mixed reality in education, entertainment, and training , 2005, IEEE Computer Graphics and Applications.

[2]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[3]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[4]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[5]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[6]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[7]  Veronica Teichrieb,et al.  [POSTER] Authoring Tools in Augmented Reality: An Analysis and Classification of Content Design Tools , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[8]  Eric Rosenbaum,et al.  On Location Learning: Authentic Applied Science with Networked Augmented Realities , 2007 .

[9]  Ritch Macefield,et al.  How to specify the participant group size for usability studies: a practitioner's guide , 2009 .

[10]  P. Grabarczyk,et al.  Perception of Affordances and Experience of Presence in Virtual Reality , 2016 .

[11]  Jay David Bolter,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, SIGGRAPH 2005.

[12]  Edward Errington,et al.  Mission Possible: Using Near-World Scenarios to Prepare Graduates for the Professions , 2011 .

[13]  Li Li,et al.  The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research , 2017, i-Perception.

[14]  Tovi Grossman,et al.  Ivy: Exploring Spatially Situated Visual Programming for Authoring and Understanding Intelligent Environments , 2017, Graphics Interface.

[15]  A. A. Bielskis,et al.  Macintosh human interface guidelines , 1992 .

[16]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[17]  Tobias Höllerer,et al.  The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation , 2013, IEEE Transactions on Visualization and Computer Graphics.

[18]  John B. Black,et al.  Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment , 2017, Comput. Educ..

[19]  Jihad El-Sana,et al.  In-Place Sketching for content authoring in Augmented Reality games , 2010, 2010 IEEE Virtual Reality Conference (VR).

[20]  Adam Tacy,et al.  GWT in Action: Easy Ajax with the Google Web Toolkit , 2007 .

[21]  Hyun Seung Yang,et al.  Smartphone as an augmented reality authoring tool via multi-touch based 3D interaction method , 2012, VRCAI '12.

[22]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[23]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[24]  L. Faulkner Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[25]  Randy Pausch,et al.  Alice: a 3-D tool for introductory programming concepts , 2000 .

[26]  Paul Holmes,et al.  Designing, developing and implementing a software tool for scenario based learning , 2012 .

[27]  Werner Hartmann,et al.  Authoring of a mixed reality assembly instructor for hierarchical structures , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[28]  Shuangjiu Xiao,et al.  MagicToon: A 2D-to-3D creative cartoon modeling system with mobile AR , 2017, 2017 IEEE Virtual Reality (VR).

[29]  Gerard Jounghyun Kim,et al.  Immersive authoring of tangible augmented reality applications , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[30]  Christian Sandor,et al.  Situated Game Level Editing in Augmented Reality , 2018, TEI.

[31]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[32]  Edwin H. Blake,et al.  Designing a VR interaction authoring tool using constructivist practices , 2004, AFRIGRAPH '04.

[33]  H. Chad Lane,et al.  Situated Pedagogical Authoring: Authoring Intelligent Tutors from a Student's Perspective , 2015, AIED.

[34]  Marcos Romero,et al.  Blueprints Visual Scripting for Unreal Engine , 2015 .

[35]  Samir Otmane,et al.  A 3D interaction technique for selection and manipulation distant objects in augmented reality , 2017, 2017 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B).

[36]  Juan M. Orduña,et al.  A new AR authoring tool using depth maps for industrial procedures , 2013, Comput. Ind..

[37]  T Vilis,et al.  “Active” and “passive” learning of three-dimensional object structure within an immersive virtual reality environment , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[38]  Bo Wang,et al.  BodyExplorerAR: enhancing a mannequin medical simulator with sensing and projective augmented reality for exploring dynamic anatomy and physiology , 2012, TEI.

[39]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[40]  Mark Billinghurst,et al.  ComposAR: An intuitive tool for authoring AR applications , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[41]  Roland Wagner,et al.  A combined immersive and desktop authoring tool for virtual environments , 2002, Proceedings IEEE Virtual Reality 2002.

[42]  Benjamin Cohen,et al.  Hybrid Remote Expert - an Emerging Pattern of Industrial Remote Support , 2017, CAiSE-Forum-DC.

[43]  Katelynn A. Kapalo,et al.  Exploring the Virtuality Continuum for Complex Rule-Set Education in the Context of Soccer Rule Comprehension , 2017 .

[44]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[45]  Halimah Badioze Zaman,et al.  Evaluation of User Acceptance of Mixed Reality Technology. , 2011 .

[46]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[47]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[48]  Michael Haller,et al.  Authoring of Mixed Reality Applications including Multi-Marker Calibration for Mobile Devices , 2004, EGVE.

[49]  K. M. Breakey,et al.  The Use of Scenario-Based-Learning Interactive Software to Create Custom Virtual Laboratory Scenarios for Teaching Genetics , 2008, Genetics.

[50]  Camille Ben Achour Guiding Scenario Authoring , 1998 .

[51]  Hirokazu Kato,et al.  Augmented Reality versus Virtual Reality for 3D Object Manipulation , 2018, IEEE Transactions on Visualization and Computer Graphics.

[52]  Vikram Kapila,et al.  Mixed-reality learning environments: Integrating mobile interfaces with laboratory test-beds , 2017, Comput. Educ..