Attentional Objects for Visual Context Understanding

This paper exploits wearable computers unique oppor tunity to record and index the visual environment of the user from the rst person perspective We propose to use a hat mounted wearable camera to record what the user sees during the day with a wearable computer This camera can be used to make the computer more contex tually aware of the user and their actions Furthermore the camera can be used to record analyze and index the visual environment of the user By keeping track of the actions of the user upon and within the environment the system can be more aware of the interactions of the user within the environment An important aspect of the system is to automatically extract objects of user interest and their motion within the environment and relative to the user

[1]  Ulrich Kressel,et al.  Tracking non-rigid, moving objects based on color cluster flow , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Alex Pentland,et al.  Visual contextual awareness in wearable computing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[3]  Alex Pentland,et al.  Unsupervised clustering of ambulatory audio and video , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[4]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[5]  Atreyi Kankanhalli,et al.  A Video Database System for Digital Libraries , 1994, DL.

[6]  Gerd Kortuem,et al.  A collaborative wearable system with remote sensing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[7]  Shih-Fu Chang,et al.  VideoQ: an automated content based video search system using visual cues , 1997, MULTIMEDIA '97.

[8]  Bernt Schiele,et al.  The Robustness of Object Recognition to View Point Changes Using Multidimensional Receptive Field Histograms , 1996 .

[9]  Steve Mann.  Personal Imaging and lookpainting as tools for personal documentary and investigative photojournalism , 1999, Mob. Networks Appl..

[10]  Alex Pentland,et al.  Recognizing Personal Location from Video , 1998 .

[11]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[12]  Alex Pentland,et al.  An Interactive Computer Vision System DyPERS: Dynamic Personal Enhanced Reality System , 1999, ICVS.

[13]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[14]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[15]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[16]  Gerd Kortuem,et al.  Context-aware, adaptive wearable computers as remote interfaces to 'intelligent' environments , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[17]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[18]  Alex Pentland,et al.  A Wearable Computer Based American Sign Language Recognizer , 1997, SEMWEB.

[19]  Gregory D. Abowd,et al.  Context-Awareness in Wearable and Ubiquitous Computing , 1997, SEMWEB.

[20]  M. Lamming,et al.  "Forget-me-not" Intimate Computing in Support of Human Memory , 1994 .

[21]  Jason Pascoe,et al.  Adding generic contextual capabilities to wearable computers , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[22]  Rosalind W. Picard.  A Society of Models for Video and Image Libraries , 1996, IBM Syst. J..

[23]  Richard Hull,et al.  Towards situated computing , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[24]  Thad Starner,et al.  Remembrance Agent: A Continuously Running Automated Information Retrieval System , 1996, PAAM.