User Interfaces for Speech-Based Retrieval of Lecture Recordings

Despite recent efforts in indexing and retrieving of audio data, common speech and audio search engines do return not only relevant results but also lots of documents that have no importance to the users. In addition, relevant information can be distributed over different parts of a file. Therefore, it is essential to represent the retrieval result in a way that enables users to easily filter relevant from irrelevant documents and to allow for comfortable and flexible skimming, selection, and access of interesting parts. In this paper we discuss a particular example for this problem, namely audio retrieval of lecture recordings. Six different interfaces are introduced, an evaluation of their usability is given, and a final interface design is presented.

[1]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[2]  Beth Logan,et al.  Speechbot: an experimental speech-based search engine for multimedia content on the web , 2002, IEEE Trans. Multim..

[3]  John Makhoul,et al.  Rough'n'Ready: a meeting recorder and browser , 1999, CSUR.

[4]  Tobias Lauer,et al.  Systems support for virtualizing traditional courses in science and engineering , 2003, Quality Education @ a Distance.

[5]  Wolfgang Hürst,et al.  Interface Issues for Accessing and Skimming Speech Documents in Context with Recorded Lectures and Presentations , 2003 .

[6]  Ellen M. Voorhees,et al.  The TREC Spoken Document Retrieval Track: A Success Story , 2000, TREC.

[7]  Marti A. Hearst TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.

[8]  Holger Horz,et al.  Lecture recording and its use in a traditional university course , 2002, ITiCSE '02.

[9]  Wolfgang Hürst,et al.  Presenting Results of a Search Engine for Recorded Lectures in order to Support Relevance Decisions by the User , 2003 .

[10]  Douglas W. Oard,et al.  A graphical interface for speech-based retrieval , 1998, DL '98.

[11]  Yiming Yang,et al.  Topic Detection and Tracking Pilot Study Final Report , 1998 .

[12]  Wolfgang Hürst,et al.  A Qualitative Study Towards Using Large Vocabulary Automatic Speech Recognition to Index Recorded Presentations for Search and Access over the Web , 2002, ICWI.