A meeting browser evaluation test

We introduce a browser evaluation test (BET), and describe a trial run application of the test. BET is a method for assessing meeting browser performance using the number of observations of interest found in the minimum amount of time as the evaluation metric, where observations of interest are statements about a meeting collected by independent observers. The resulting speed and accuracy scores aim to be objective, comparable and repeatable.

[1]  Steven E. Poltrock,et al.  A team collaboration space supporting capture and access of virtual meetings , 2001, GROUP.

[2]  Andreas Girgensohn,et al.  An intelligent media browser using automatic multimodal analysis , 1998, MULTIMEDIA '98.

[3]  Michael R. Lyu,et al.  ADVISE: Advanced Digital Video Information Segmentation Engine , 2002 .

[4]  Mike Flynn,et al.  Browsing Recorded Meetings with Ferret , 2004, MLMI.

[5]  Leysia Palen,et al.  “I'll get that off the audio”: a case study of salvaging multimedia meeting records , 1997, CHI.

[6]  Martin Rajman,et al.  ARCHIVUS: A System for Accessing the Content of Recorded Multimodal Meetings , 2004, MLMI.

[7]  Anoop Gupta,et al.  Distributed meetings: a meeting capture and broadcasting system , 2002, MULTIMEDIA '02.

[8]  Ellen M. Voorhees,et al.  Overview of the Seventh Text REtrieval Conference , 1998 .

[9]  Berna Erol,et al.  Portable meeting recorder , 2002, MULTIMEDIA '02.

[10]  Andreas Girgensohn,et al.  Keyframe-Based User Interfaces for Digital Video , 2001, Computer.

[11]  Amit Srivastava,et al.  Spoken documents: creating searchable archives from continuous audio , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[12]  Ellen M. Voorhees,et al.  Overview of the seventh text retrieval conference (trec-7) [on-line] , 1999 .

[13]  Denis Lalanne,et al.  A research agenda for assessing the utility of document annotations in multimedia databases of meeting recordings. , 2003 .

[14]  Jean-Marc Odobez,et al.  A Hierarchical Keyframe User Interface for Browsing Video over the Internet , 2003, INTERACT.

[15]  John R. Smith,et al.  Video summarization and personalization for pervasive mobile devices , 2001, IS&T/SPIE Electronic Imaging.

[16]  Darren Moore,et al.  The IDIAP Smart Meeting Room , 2002 .

[17]  Mary F. Flynn,et al.  In Search of a Good BET: A Proposal for a Browser Evaluation Test , 2004 .

[18]  Samy Bengio,et al.  Modeling human interaction in meetings , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[19]  Ralph Gross,et al.  Multimodal Meeting Tracker , 2000, RIAO.

[20]  Steve Whittaker,et al.  Accessing Multimodal Meeting Data: Systems, Problems and Possibilities , 2004, MLMI.

[21]  Andreas Girgensohn,et al.  LiteMinutes: an Internet-based system for multimedia meeting minutes , 2001, WWW '01.

[22]  Rick Kazman,et al.  Four Paradigms for Indexing Video Conferences , 1996, IEEE Multim..

[23]  Andreas Stolcke,et al.  The ICSI Meeting Project: Resources and Research , 2004 .