Supporting daily living activities using behavior logs and Augmented Reality

In this paper, we propose a support system for daily living activities based on a user's behavior log in an indoor environment. Generally speaking, daily living activities hardly remain in our memory, so that, determining the order and priority of daily tasks can be difficult. There are studies supporting daily chores based on a behavior log and aiming to improve the work efficiency by using a memory aid. However, most of the existing studies require pre-installation of costly devices such as cameras and sensors, and are limited to supporting a particular task or purpose. There have been proposed many methods based on Augmented Reality (AR) which annotate captured images of the real world with texts, but text-based information may frustrate users. More intuitive user interfaces are required. In this paper, we first propose a user's behavior log management technique which associates each activity log with an object/location in the target indoor space. Then, we propose a method for reproducing AR-based visual effects on the object/location determined based on the log; the method naturally navigates the user to carrying out the intended task. We have implemented a prototype of the proposed method and have conducted subjective surveys to evaluate the effectiveness of the proposed visual effects. We thereby, confirmed that the proposed visual effects can make users more intuitively aware of the intended task than the text-based annotation method.

[1]  Koji Tsukada,et al.  BoxFinder: Finding items in boxes using images and visual markers , 2010 .

[2]  Atif Alamri,et al.  Evaluating the post-stroke patients progress using an Augmented Reality Rehabilitation system , 2009, 2009 IEEE International Workshop on Medical Measurements and Applications.

[3]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[4]  Koji Tsukada,et al.  DrawerFinder: finding items in storage boxes using pictures and visual markers , 2011, IUI '11.

[5]  Dieter Schmalstieg,et al.  ARToolKit on the PocketPC platform , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[6]  Cristina Urdiales,et al.  Augmented Reality Visualization Interface for Biometric Wireless Sensor Networks , 2007, IWANN.

[7]  Branislav Sobota,et al.  3D INTERFACE BASED ON AUGMENTED REALITY IN CLIENT-SERVER ENVIRONMENT , 2010 .

[8]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[9]  E. Rothblum,et al.  Affective, Cognitive, and Behavioral Differences Between High and Low Procrastinators. , 1986 .

[10]  Rosa María Baños,et al.  Using augmented reality to treat phobias , 2005, IEEE Computer Graphics and Applications.

[11]  Takeshi Kurata,et al.  Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[12]  Ann-Sofie Gunnarsson,et al.  A novel interface to sensor networks using handheld augmented reality , 2006, Mobile HCI.

[13]  Naokazu Yokoya,et al.  Localization system for large indoor environments using invisible markers , 2008, VRST '08.

[14]  Hideaki Kanai,et al.  A support system for finding lost objects using spotlight , 2005, Mobile HCI.

[15]  Naokazu Yokoya,et al.  A wearable augmented reality system for navigation using positioning infrastructures and a pedometer , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[16]  Naokazu Yokoya,et al.  View management of annotations for wearable augmented reality , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[17]  Jorma Laaksonen,et al.  An augmented reality interface to contextual information , 2011, Virtual Reality.

[18]  R. Schmidt.  Fundamentals of Sensory Physiology , 1986, Springer Study Edition.

[19]  Kiyoshi Kiyokawa,et al.  A study of depth visualization techniques for virtual annotations in augmented reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..