Supporting video library exploratory search: when storyboards are not enough

Storyboards, a grid layout of thumbnail images as surrogates representing video, have received much attention in video retrieval interfaces and published studies through the years, and work quite well as navigation aids and as facilitators for shot-based information retrieval. When the information need is tied less to shots and requires inspection of stories and across stories, other interfaces into the video data have been demonstrated to be quite useful. These interfaces include scatterplots for timelines, choropleth maps, dynamic query preview histograms, and named entity relation diagrams representing sets of hundreds or thousands of video stories. One challenge for interactive video search is to move beyond support for fact-finding and also address broader, longer term search activities of learning, analysis, synthesis, and discovery. Examples are shown for broadcast news and life oral histories, drawing from empirically collected data showing how such interfaces can promote improved exploratory search. This paper surveys and reflects on a body of Informedia interface work dealing with news, folding in for the first time an examination of exploratory transactions with an oral history corpus.

[1]  Ben Shneiderman,et al.  Visual information seeking: tight coupling of dynamic query filters with starfield displays , 1994, CHI '94.

[2]  Rong Yan,et al.  Merging storyboard strategies and automatic retrieval for improving interactive video search , 2007, CIVR '07.

[3]  Michael G. Christel.  Establishing the utility of non-text search for news video retrieval with real world users , 2007, ACM Multimedia.

[4]  Michael G. Christel,et al.  Mining Novice User Activity with TRECVID Interactive Retrieval Tasks , 2006, CIVR.

[5]  Michael G. Christel.  Windowing time in digital libraries , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[6]  Marcel Worring,et al.  Mediamill: Advanced Browsing in News Video Archives , 2006, CIVR.

[7]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[8]  Gary Marchionini,et al.  Text or Pictures? An Eyetracking Study of How People View Digital Video Surrogates , 2003, CIVR.

[9]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[10]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[11]  Ryen W. White,et al.  Supporting exploratory search , 2006 .

[12]  Marcel Worring,et al.  A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval , 2007, IEEE Transactions on Multimedia.

[13]  Michael G. Christel,et al.  Finding the right shots: assessing usability and performance of a digital video library interface , 2004, MULTIMEDIA '04.

[14]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[15]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[16]  Christine D. Piatko,et al.  Supporting insight-based information exploration in intelligence analysis , 2006, CACM.

[17]  Alfred Kobsa,et al.  An empirical comparison of three commercial information visualization systems , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[18]  Marti A. Hearst.  Clustering versus faceted categories for information exploration , 2006, Commun. ACM.

[19]  Ben Shneiderman,et al.  Visual information seeking: tight coupling of dynamic query filters with starfield displays , 1994, CHI Conference Companion.

[20]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[21]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[22]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[23]  Gary Marchionini,et al.  The Open Video Digital Library , 2002, D Lib Mag..

[24]  Alexander G. Hauptmann,et al.  Successful approaches in the TREC video retrieval evaluations , 2004, MULTIMEDIA '04.

[25]  ChangShih-Fu,et al.  Large-Scale Concept Ontology for Multimedia , 2006 .

[26]  Marti A. Hearst,et al.  Finding the flow in web site search , 2002, CACM.

[27]  Robert R. Korfhage,et al.  Visualization of a Document Collection: The VIBE System , 1993, Inf. Process. Manag..