Cognitive Cost of Using Augmented Reality Displays

This paper presents the results of two cognitive load studies comparing three augmented reality display technologies: spatial augmented reality, the optical see-through Microsoft HoloLens, and the video see-through Samsung Gear VR. In particular, the two experiments focused on isolating the cognitive load cost of receiving instructions for a button-pressing procedural task. The studies employed a self-assessment cognitive load methodology, as well as an additional dual-task cognitive load methodology. The results showed that spatial augmented reality led to increased performance and reduced cognitive load. Additionally, it was discovered that a limited field of view can introduce increased cognitive load requirements. The findings suggest that some of the inherent restrictions of head-mounted displays materialize as increased user cognitive load.

[1]  Gerard Jounghyun Kim,et al.  Eye Strain from Switching Focus in Optical See-Through Displays , 2015, INTERACT.

[2]  Liesbeth Kester,et al.  The management of cognitive load during complex cognitive skill acquisition by means of computer-simulated problem solving. , 2005, The British journal of educational psychology.

[3]  Giuseppe Monno,et al.  Text Readability in Head-Worn Displays: Color and Style Optimization in Video versus Optical See-Through Devices , 2014, IEEE Transactions on Visualization and Computer Graphics.

[4]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[5]  Anthony Jameson,et al.  Assessing Cognitive Load in Adaptive Hypermedia Systems: Physiological and Behavioral Methods , 2004, AH.

[6]  N.D. Macchiarella,et al.  A mobile application of augmented reality for aerospace maintenance training , 2005, 24th Digital Avionics Systems Conference.

[7]  D. Leutner,et al.  Direct Measurement of Cognitive Load in Multimedia Learning , 2003 .

[8]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[9]  Desney S. Tan,et al.  Developing a Generic Augmented-Reality Interface , 2002, Computer.

[10]  William S. Helton,et al.  Climbing With a Head-Mounted Display , 2016, Hum. Factors.

[11]  Chris Baber,et al.  User evaluation of augmented reality systems , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[12]  Ross T. Smith,et al.  Augmented Reality as a Countermeasure for Sleep Deprivation , 2016, IEEE Transactions on Visualization and Computer Graphics.

[13]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[14]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[15]  Markus Funk,et al.  Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions , 2016, UbiComp.

[16]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[17]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[18]  Gudrun Klinker,et al.  Supporting order picking with Augmented Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[19]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[20]  Kiyoshi Kiyokawa.  An Introduction to Head Mounted Displays for Augmented Reality , 2007 .

[21]  Sevda Küçük,et al.  Learning anatomy via mobile augmented reality: Effects on achievement and cognitive load , 2016, Anatomical sciences education.

[22]  Kiyoshi Kiyokawa,et al.  Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[23]  Andrea Albarelli,et al.  On the Interplay between Data Overlay and Real-World Context using See-through Displays , 2015, CHItaly.

[24]  Kenneth R. Moser,et al.  Spatial consistency perception in optical and video see-through head-mounted augmentations , 2016, 2016 IEEE Virtual Reality (VR).

[25]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[26]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[27]  Tobias Höllerer,et al.  Evaluating wide-field-of-view augmented reality with mixed reality simulation , 2016, 2016 IEEE Virtual Reality (VR).

[28]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[29]  Dieter Schmalstieg,et al.  [POSTER] Design Guidelines for Generating Augmented Reality Instructions , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[30]  I-Chen Lin,et al.  Augmented reality instruction for object assembly based on markerless tracking , 2016, I3D.

[31]  Jane H. Barrow,et al.  Basic Perception in Head-Worn Augmented Reality Displays , 2013 .

[32]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[33]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[34]  Ross T. Smith,et al.  Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing , 2016, The International Journal of Advanced Manufacturing Technology.

[35]  Steven K. Feiner,et al.  Augmented reality in the psychomotor phase of a procedural task , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[36]  Peter E.D. Love,et al.  Using Animated Augmented Reality to Cognitively Guide Assembly , 2013, J. Comput. Civ. Eng..

[37]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[38]  Bruce H. Thomas,et al.  Improving procedural task performance with Augmented Reality annotations , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[39]  Tobias Höllerer,et al.  Integrating the physical environment into mobile remote collaboration , 2012, Mobile HCI.