Attention guiding techniques using peripheral vision and eye tracking for feedback in augmented-reality-based assistance systems

A limiting factor of current smart glasses-based augmented reality (AR) systems is their small field of view. AR assistance systems designed for tasks such as order picking or manual assembly are supposed to guide the visual attention of the user towards the item that is relevant next. This is a challenging task, as the user may initially be in an arbitrary position and orientation relative to the target. As a result of the small field of view, in most cases the target will initially not be covered by the AR display, even if it is visible to the user. This raises the question of how to design attention guiding for such “off-screen gaze” conditions.

[1]  Patrick Baudisch,et al.  Halo: a technique for visualizing off-screen objects , 2003, CHI '03.

[2]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[3]  Steve Bourgeois,et al.  An interactive Augmented Reality system: A prototype for industrial maintenance training applications , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[4]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[5]  Emmanuel Dubois,et al.  Virtual Reality Simulation for Prototyping Augmented Reality , 2008, 2008 International Symposium on Ubiquitous Virtual Reality.

[6]  Thies Pfeiffer,et al.  Evaluation of Attention Guiding Techniques for Augmented Reality-based Assistance in Picking and Assembly Tasks , 2017, IUI Companion.

[7]  Willibald A. Günthner,et al.  Pick-by-vision: augmented reality supported order picking , 2009, The Visual Computer.

[8]  Angela L Sauer,et al.  Assistive technology effects on the employment outcomes for people with cognitive disabilities: A systematic review , 2010, Disability and rehabilitation. Assistive technology.

[9]  Ralph Stelzer,et al.  Requirements for Virtualization of AR Displays within VR Environments , 2014, HCI.

[10]  Kiyoshi Kiyokawa,et al.  Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[11]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[12]  Diego Borro,et al.  Providing guidance for maintenance operations using automatic markerless augmented reality system , 2011, ISMAR.

[13]  Albrecht Schmidt,et al.  Augmented manufacturing: a study with impaired persons on assistive systems using in-situ projection , 2013, PETRA '13.

[14]  Niels Henze,et al.  Visualization of off-screen objects in mobile augmented reality , 2010, Mobile HCI.

[15]  Gudrun Klinker,et al.  Supporting order picking with Augmented Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[16]  Daniel Kurz,et al.  [Poster] A Mobile Augmented reality system to assist auto mechanics , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[17]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[18]  Markus Funk,et al.  Comparing projected in-situ feedback at the manual assembly workplace with impaired workers , 2015, PETRA.

[19]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[20]  J. Rolland,et al.  Head-worn displays: a review , 2006, Journal of Display Technology.

[21]  Gudrun Klinker,et al.  Effective control of a car driver's attention for visual and acoustic guidance towards the direction of imminent dangers , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[22]  Michael J. Daly,et al.  Surgeons blinded by enhanced navigation: the effect of augmented reality on attention , 2013, Surgical Endoscopy.

[23]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[24]  Kiyoshi Kiyokawa,et al.  Poster: Investigation on the peripheral visual field for information display with real and virtual wide field-of-view see-through HMDs , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[25]  Kiyoshi Kiyokawa,et al.  The effectiveness of an AR-based context-aware assembly support system in object assembly , 2014, 2014 IEEE Virtual Reality (VR).

[26]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[27]  Didier Stricker,et al.  Real-time modeling and tracking manual workflows from first-person vision , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[28]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.