Wearable sensing to annotate meeting recordings

We propose to use wearable computers and sensor systems to generate personal contextual annotations in audio visual recordings of meetings. In this paper, we argue that such annotations are essential and effective to allow the retrieval of relevant information from large audio-visual databases. The paper proposes several useful annotations that can be derived from cheap and unobtrusive sensors. It also describes a hardware platform designed to implement accelerometric activity recognition, outlines approaches to extract annotations and presents first experimental results.

[1]  Lynn Wilcox,et al.  Audio indexing using speaker identification , 1994, Optics & Photonics.

[2]  Steve Young,et al.  The HTK book , 1995 .

[3]  Kristof Van Laerhoven,et al.  Real-time analysis of data from many sensors with neural networks , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[4]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[5]  T. Tamura,et al.  Classification of walking pattern using acceleration waveform in elderly people , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[6]  Tanzeem Choudhury,et al.  Multimodal person recognition using unconstrained audio and video , 1998 .

[7]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[8]  Albrecht Schmidt,et al.  Advanced Interaction in Context , 1999, HUC.

[9]  Christian Wellekens,et al.  Detection of speaker changes in an audio document , 1999, EUROSPEECH.

[10]  Gregory D. Abowd,et al.  The Conference Assistant: combining context-awareness with wearable computing , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[11]  Don Kimber,et al.  Acoustic Segmentation for Audio Browsers , 1997 .

[12]  Bradley J. Rhodes,et al.  The wearable remembrance agent: A system for augmented memory , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[13]  Dale G. Leathers.  Successful nonverbal communication : principles and applications , 1986 .

[14]  Yoshiharu Yonezawa,et al.  A wearable posture, behavior and activity recording system , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[15]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[16]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[17]  Kristofer S. J. Pister,et al.  Acceleration Sensing Glove , 1999 .

[18]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[19]  M. Lamming,et al.  "Forget-me-not" Intimate Computing in Support of Human Memory , 1994 .