Mining Novice User Activity with TRECVID Interactive Retrieval Tasks

This paper investigates the applicability of Informedia shot-based interface features for video retrieval in the hands of novice users, noted in past work as being too reliant on text search. The Informedia interface was redesigned to better promote the availability of additional video access mechanisms, and tested with TRECVID 2005 interactive search tasks. A transaction log analysis from 24 novice users shows a dramatic increase in the use of color search and shot-browsing mechanisms beyond traditional text search. In addition, a within-subjects study examined the employment of user activity mining to suppress shots previously seen. This strategy did not have the expected positive effect on performance. User activity mining and shot suppression did produce a broader shot space to be explored and resulted in more unique answer shots being discovered. Implications for shot suppression in video retrieval information exploration interfaces are discussed.

[1]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[2]  Robin Ss Is there a difference , 1967 .

[3]  Alexander G. Hauptmann Lessons for the Future from a Decade of Informedia Video Analysis Research , 2005, CIVR.

[4]  Ben Shneiderman,et al.  Clarifying Search: A User-Interface Framework for Text Searches , 1997, D Lib Mag..

[5]  Gary Marchionini,et al.  The relative effectiveness of concept-based versus content-based video retrieval , 2004, MULTIMEDIA '04.

[6]  Michael G. Christel,et al.  Addressing the challenge of visual information access from digital image and video libraries , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[7]  Michael G. Christel,et al.  Finding the right shots: assessing usability and performance of a digital video library interface , 2004, MULTIMEDIA '04.

[8]  Tno Tpd TRECVID 2004 - An Introduction , 2004 .

[9]  Alexander G. Hauptmann,et al.  Successful approaches in the TREC video retrieval evaluations , 2004, MULTIMEDIA '04.

[10]  John Adcock,et al.  Interactive Video Search Using Multilevel Indexing , 2005, CIVR.

[11]  Wessel Kraaij,et al.  TRECVID 2005-An Introduction , 2005 .

[12]  Marcel Worring,et al.  MediaMill: exploring news video archives based on learned semantics , 2005, MULTIMEDIA '05.

[13]  Gene Golovchinsky,et al.  Queries? Links? Is there a difference? , 1997, CHI.

[14]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[15]  Paul Over,et al.  TRECVID: evaluating the effectiveness of information retrieval tasks on digital video , 2004, MULTIMEDIA '04.

[16]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.