Accessing Multimodal Meeting Data: Systems, Problems and Possibilities

As the amount of multimodal meetings data being recorded increases, so does the need for sophisticated mechanisms for accessing this data. This process is complicated by the different informational needs of users, as well as the range of data collected from meetings. This paper examines the current state of the art in meeting browsers. We examine both systems specifically designed for browsing multimodal meetings data and those designed to browse data collected from different environments, for example broadcast news and lectures. As a result of this analysis, we highlight potential directions for future research – semantic access, filtered presentation, limited display environments, browser evaluation and user requirements capture.

[1]  Anoop Gupta,et al.  Distributed meetings: a meeting capture and broadcasting system , 2002, MULTIMEDIA '02.

[2]  Rick Kazman,et al.  Four Paradigms for Indexing Video Conferences , 1996, IEEE Multim..

[3]  Gregory D. Abowd,et al.  Automated capture, integration, and visualization of multiple media streams , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[4]  Andreas Girgensohn,et al.  LiteMinutes: an Internet-based system for multimedia meeting minutes , 2001, WWW '01.

[5]  Julia Hirschberg,et al.  SCAN: designing and evaluating user interfaces to support retrieval from speech archives , 1999, SIGIR '99.

[6]  Berna Erol,et al.  Portable meeting recorder , 2002, MULTIMEDIA '02.

[7]  Steven E. Poltrock,et al.  A team collaboration space supporting capture and access of virtual meetings , 2001, GROUP.

[8]  Mary F. Flynn,et al.  In Search of a Good BET: A Proposal for a Browser Evaluation Test , 2004 .

[9]  Chris Schmandt,et al.  NewsComm: a hand-held interface for interactive access to structured audio , 1996, CHI.

[10]  Thomas P. Moran,et al.  Speaker segmentation for browsing recorded audio , 1995, CHI 95 Conference Companion.

[11]  Andreas Girgensohn,et al.  An intelligent media browser using automatic multimodal analysis , 1998, MULTIMEDIA '98.

[12]  Ralph Gross,et al.  Multimodal Meeting Tracker , 2000, RIAO.

[13]  Michael G. Christel,et al.  Evolving video skims into useful multimedia abstractions , 1998, CHI.

[14]  Aaron E. Rosenberg,et al.  SCANMail: a voicemail interface that makes speech browsable, readable and searchable , 2002, CHI.

[15]  Richard Mander,et al.  Working with audio: integrating personal tape recorders and desktop computers , 1992, CHI '92.

[16]  Andreas Girgensohn,et al.  Keyframe-Based User Interfaces for Digital Video , 2001, Computer.

[17]  Elizabeth Shriberg,et al.  Spotting "hot spots" in meetings: human judgments and prosodic cues , 2003, INTERSPEECH.

[18]  Barry Arons,et al.  SpeechSkimmer: a system for interactively skimming recorded speech , 1997, TCHI.

[19]  Amit Srivastava,et al.  Spoken documents: creating searchable archives from continuous audio , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[20]  Rick Kazman,et al.  Supporting the retrieval process in multimedia information systems , 1997, Proceedings of the Thirtieth Hawaii International Conference on System Sciences.

[21]  Brian Christopher Smith,et al.  Passive capture and structuring of lectures , 1999, MULTIMEDIA '99.

[22]  Leysia Palen,et al.  “I'll get that off the audio”: a case study of salvaging multimedia meeting records , 1997, CHI.

[23]  Denis Lalanne,et al.  A research agenda for assessing the utility of document annotations in multimedia databases of meeting recordings. , 2003 .

[24]  Debby Hindus,et al.  Ubiquitous audio: capturing spontaneous collaboration , 1992, CSCW '92.