Opportunities for In-Home Augmented Reality Guidance

The use of Augmented Reality (AR) systems has been shown to be beneficial in guiding users through structured tasks when compared to traditional 2D instructions. In this work, we begin to examine the potential of such systems for home improvement tasks, which present some specific challenges (e.g., operating at both large and small scales, and coping with the diversity in home environments). Specifically, we investigate user performance of a common low-level task in this domain. We conducted a user study where participants mark points on a planar surface (as if to place a nail, or measure from) guided only by virtual cues. We observed that participants position themselves so as to minimize parallax by kneeling, leaning, or side-stepping, and when doing so, they are able to mark points with a high degree of accuracy. In cases where the targets fall above one's line of vision, participants are less able to compensate and make larger errors. We discuss initial insights from these observations and participant feedback, and present the first set of challenges that we believe designers and developers will face in this domain.

[1]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[2]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[3]  Antonija Mitrovic,et al.  Intelligent Augmented Reality Training for Motherboard Assembly , 2015, International Journal of Artificial Intelligence in Education.

[4]  Albrecht Schmidt,et al.  The potentials of in-situ-projection for augmented workplaces in production: a study with impaired persons , 2013, CHI Extended Abstracts.

[5]  Stephanie Rosenthal,et al.  Augmenting on-screen instructions with micro-projected guides: when it works, and when it fails , 2010, UbiComp.

[6]  Mark Billinghurst,et al.  Augmented assembly using a mobile phone , 2008, ISMAR.

[7]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[8]  Pierre Fite-Georgel,et al.  Is there a reality in Industrial Augmented Reality? , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[9]  Steven K. Feiner,et al.  Augmented reality in the psychomotor phase of a procedural task , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[10]  Diego Borro,et al.  Providing guidance for maintenance operations using automatic markerless Augmented Reality system , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[11]  Bruce H. Thomas,et al.  Improving procedural task performance with Augmented Reality annotations , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  Anthony Tang,et al.  Scale Impacts Elicited Gestures for Manipulating Holograms: Implications for AR Gesture Design , 2018, Conference on Designing Interactive Systems.

[13]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.