A Comparison of Desktop and Augmented Reality Scenario Based Training Authoring Tools

This work presents a study that explores the differences between authoring Scenario-Based Training (SBT) simulation content using Augmented Reality (AR) and a Desktop interface. Through an iterative design process two interface conditions were developed and then evaluated qualitatively and quantitatively. Our conceptual model is a graph based visualization that is presented to help designers understand the scenario learning artifacts and relationships. Our major contribution relies on the comparison made between the two authoring tools (AR, Desktop) with the same capabilities. Results show that no significant difference was found in time taken to complete tasks nor on the perceived usability of the systems. However, as expected the Desktop interface was perceived as more efficient. Based on these findings, insights on future directions for building AR immersive authoring tools are provided.

[1]  Samir Otmane,et al.  A 3D interaction technique for selection and manipulation distant objects in augmented reality , 2017, 2017 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B).

[2]  Werner Hartmann,et al.  Authoring of a mixed reality assembly instructor for hierarchical structures , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[3]  Shuangjiu Xiao,et al.  MagicToon: A 2D-to-3D creative cartoon modeling system with mobile AR , 2017, 2017 IEEE Virtual Reality (VR).

[4]  Gerard Jounghyun Kim,et al.  Immersive authoring of tangible augmented reality applications , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[5]  Christian Sandor,et al.  Situated Game Level Editing in Augmented Reality , 2018, TEI.

[6]  Camille Ben Achour.  Guiding Scenario Authoring , 1998 .

[7]  Michael Haller,et al.  Authoring of Mixed Reality Applications including Multi-Marker Calibration for Mobile Devices , 2004, EGVE.

[8]  Hirokazu Kato,et al.  Augmented Reality versus Virtual Reality for 3D Object Manipulation , 2018, IEEE Transactions on Visualization and Computer Graphics.

[9]  K. M. Breakey,et al.  The Use of Scenario-Based-Learning Interactive Software to Create Custom Virtual Laboratory Scenarios for Teaching Genetics , 2008, Genetics.

[10]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[11]  John B. Black,et al.  Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment , 2017, Comput. Educ..

[12]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[13]  Vikram Kapila,et al.  Mixed-reality learning environments: Integrating mobile interfaces with laboratory test-beds , 2017, Comput. Educ..

[14]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[15]  Tovi Grossman,et al.  Ivy: Exploring Spatially Situated Visual Programming for Authoring and Understanding Intelligent Environments , 2017, Graphics Interface.

[16]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[17]  A. A. Bielskis,et al.  Macintosh human interface guidelines , 1992 .

[18]  Benjamin Cohen,et al.  Hybrid Remote Expert - an Emerging Pattern of Industrial Remote Support , 2017, CAiSE-Forum-DC.

[19]  Tobias Höllerer,et al.  The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation , 2013, IEEE Transactions on Visualization and Computer Graphics.

[20]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[21]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[22]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[23]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[24]  Jennifer M. Seddon,et al.  ICT-supported, scenario-based learning in preclinical veterinary science education: Quantifying learning outcomes and facilitating the novice-expert transition , 2012 .

[25]  L. Faulkner.  Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[26]  Veronica Teichrieb,et al.  [POSTER] Authoring Tools in Augmented Reality: An Analysis and Classification of Content Design Tools , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[27]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[28]  Juan M. Orduña,et al.  A new AR authoring tool using depth maps for industrial procedures , 2013, Comput. Ind..

[29]  T Vilis,et al.  “Active” and “passive” learning of three-dimensional object structure within an immersive virtual reality environment , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Katelynn A. Kapalo,et al.  Exploring the Virtuality Continuum for Complex Rule-Set Education in the Context of Soccer Rule Comprehension , 2017 .

[31]  Bo Wang,et al.  BodyExplorerAR: enhancing a mannequin medical simulator with sensing and projective augmented reality for exploring dynamic anatomy and physiology , 2012, TEI.

[32]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[33]  Mark Billinghurst,et al.  ComposAR: An intuitive tool for authoring AR applications , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[34]  Edwin H. Blake,et al.  Designing a VR interaction authoring tool using constructivist practices , 2004, AFRIGRAPH '04.

[35]  Roland Wagner,et al.  A combined immersive and desktop authoring tool for virtual environments , 2002, Proceedings IEEE Virtual Reality 2002.

[36]  Edward Errington,et al.  Mission Possible: Using Near-World Scenarios to Prepare Graduates for the Professions , 2011 .

[37]  Li Li,et al.  The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research , 2017, i-Perception.

[38]  Jihad El-Sana,et al.  In-Place Sketching for content authoring in Augmented Reality games , 2010, 2010 IEEE Virtual Reality Conference (VR).

[39]  Halimah Badioze Zaman,et al.  Evaluation of User Acceptance of Mixed Reality Technology. , 2011 .

[40]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[41]  Adam Tacy,et al.  GWT in Action: Easy Ajax with the Google Web Toolkit , 2007 .

[42]  Hyun Seung Yang,et al.  Smartphone as an augmented reality authoring tool via multi-touch based 3D interaction method , 2012, VRCAI '12.

[43]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[44]  Jay David Bolter,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, SIGGRAPH 2005.

[45]  Eric Rosenbaum,et al.  On Location Learning: Authentic Applied Science with Networked Augmented Realities , 2007 .

[46]  Ritch Macefield,et al.  How to specify the participant group size for usability studies: a practitioner's guide , 2009 .

[47]  P. Grabarczyk,et al.  Perception of Affordances and Experience of Presence in Virtual Reality , 2016 .

[48]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[49]  H. Chad Lane,et al.  Situated Pedagogical Authoring: Authoring Intelligent Tutors from a Student's Perspective , 2015, AIED.

[50]  Marcos Romero,et al.  Blueprints Visual Scripting for Unreal Engine , 2015 .

[51]  Charles E. Hughes,et al.  Mixed reality in education, entertainment, and training , 2005, IEEE Computer Graphics and Applications.

[52]  Randy Pausch,et al.  Alice: a 3-D tool for introductory programming concepts , 2000 .

[53]  Paul Holmes,et al.  Designing, developing and implementing a software tool for scenario based learning , 2012 .