Wearable Sensing to Annotate Meeting Recordings

We propose to use wearable computers and sensor systems to generate personal contextual annotations in audio visual recordings of meetings. In this paper we argue that such annotations are essential and effective to allow retrieval of relevant information from large audio-visual databases. The paper proposes several useful annotations that can be derived from cheap and unobtrusive sensors. It also describes a hardware platform designed to implement this concept and presents first experimental results.

[1]  Yoshiharu Yonezawa,et al.  A wearable posture, behavior and activity recording system , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[2]  Lynn Wilcox,et al.  Audio indexing using speaker identification , 1994, Optics & Photonics.

[3]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[4]  Bradley J. Rhodes,et al.  The wearable remembrance agent: A system for augmented memory , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[5]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[6]  Kristof Van Laerhoven,et al.  Real-time analysis of data from many sensors with neural networks , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[7]  Christian Wellekens,et al.  Detection of speaker changes in an audio document , 1999, EUROSPEECH.

[8]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[9]  T. Tamura,et al.  Classification of walking pattern using acceleration waveform in elderly people , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[10]  Dale G. Leathers.  Successful nonverbal communication : principles and applications , 1986 .

[11]  Gregory D. Abowd,et al.  The Conference Assistant: combining context-awareness with wearable computing , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[12]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[13]  Steve Young,et al.  The HTK book , 1995 .

[14]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[15]  Albrecht Schmidt,et al.  Advanced Interaction in Context , 1999, HUC.

[16]  M. Lamming,et al.  "Forget-me-not" Intimate Computing in Support of Human Memory , 1994 .

[17]  Don Kimber,et al.  Acoustic Segmentation for Audio Browsers , 1997 .