Wearable interfaces for a video diary: towards memory retrieval, exchange, and transportation

In this paper, we discuss wearable interfaces for a computational memory-aid useful in everyday life. The aim of this study is to develop a video diary system with vision interfaces to aid in memory retrieval. The video diary system provides users with "memory retrieval, exchange, and transportation" through four types of indexes: (1) through the user's location, (2) through real world object(s), (3) through keyword(s) and (4) through the use of a summary or "the story of the day." The authors have developed the following two systems to achieve the above indexes: (1) a residual memory system, (2) a ubiquitous memories system. residual memory can index a user's location automatically by analyzing a video recorded from a wearable camera for "memory retrieval." Ubiquitous memories provides users with the ability to associate augmented memories with real world objects for "memory exchange." We have integrated the above two systems for "memory transportation." We believe that the above interfaces can be integrated into the video diary system.

[1]  Yoshihiro Kawai,et al.  Recognition of 3D free-form objects using segment-based stereo vision , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[3]  Alex Pentland,et al.  Realtime personal positioning system for a wearable computer , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[4]  M. Lamming,et al.  "Forget-me-not" Intimate Computing in Support of Human Memory , 1994 .

[5]  Hideaki Takeda,et al.  Ubiquitous memories : wearable interface for computational augmentation of human memory based on real world objects , 2002 .

[6]  Robert W. Lindeman,et al.  Towards usable VR: an empirical study of user interfaces for immersive virtual environments , 1999, CHI '99.

[7]  M. Kidode,et al.  Wearable Vision Interfaces : towards Wearable Information Playing in Daily Life , 2002 .

[8]  Jonny Farringdon,et al.  Visual Augmented Memory (VAM) , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[9]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Alex Pentland,et al.  Unsupervised clustering of ambulatory audio and video , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[11]  Kiyoharu Aizawa,et al.  Summarizing wearable video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[12]  Bradley J. Rhodes,et al.  The wearable remembrance agent: A system for augmented memory , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[13]  Alex Pentland,et al.  DyPERS: Dynamic Personal Enhanced Reality System , 1998 .

[14]  Masatsugu Kidode,et al.  A Novel Video Retrieval Method to Support a User's Recollection of Past Events Aiming for Wearable Information Playing , 2001, IEEE Pacific Rim Conference on Multimedia.