AR Cooking: Comparing Display Methods for the Instructions of Cookwares on AR Goggles

We explore effective display methods for instructions on complex tools on augmented reality (AR) goggles. We focused on three types of cookwares as complex tools in everyday life: avocado cutter, orange opener, and can opener. We implemented three AR applications for displaying the usage of three cookwares: images with text, videos, and three-dimensional (3D) animation. In this study, we investigated how each of these AR applications affects the understanding of complicated products and their applications. Using Microsoft HoloLens, we conducted user studies with the three aforementioned display methods. We measured the task completion time and investigated the psychological element. Based on the task completion time and whether the task could be completed, we found that the most efficient display method for the instruction of cookwares on AR goggles is 3D animation. We investigated how participants felt about cooking using AR goggles based on participant’s comments. We believe that our contribution can be useful for the design of AR-based application.

[1]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[2]  Hirotada Ueda,et al.  Cooking support with information projection onto ingredient , 2012, APCHI '12.

[3]  Leonardo Bonanni,et al.  Attention-based design of augmented reality interfaces , 2005, CHI Extended Abstracts.

[4]  Henry Lieberman,et al.  Augmenting kitchen appliances with a shared context using knowledge about daily events , 2006, IUI '06.

[5]  Markus Funk,et al.  SMARTKITCHEN Media Enhanced Cooking Environment , 2016, IOT.

[6]  Björn J. E. Johansson,et al.  Acceptance of augmented reality instructions in a real work setting , 2008, CHI Extended Abstracts.

[7]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[8]  Wendy Ju,et al.  CounterActive: an interactive cookbook for the kitchen counter , 2001, CHI Extended Abstracts.

[9]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[10]  Shin'ichi Satoh,et al.  Cooking navi: assistant for daily cooking in kitchen , 2005, ACM Multimedia.

[11]  Jun Rekimoto,et al.  Shadow Cooking: Situated Guidance for a Fluid Cooking Experience , 2014, HCI.

[12]  Thies Pfeiffer,et al.  Comparing Conventional and Augmented Reality Instructions for Manual Assembly Tasks , 2017, PETRA.

[13]  Andrew Tokmakoff,et al.  Designing socially acceptable multimodal interaction in cooking assistants , 2011, IUI '11.

[14]  Bernd Schwald,et al.  An Augmented Reality System for Training and Assistence to Maintenance in the Industrial Context , 2003, WSCG.

[15]  S. J. Steiner,et al.  Virtual reality and augmented reality as a training tool for assembly tasks , 1999, 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210).