Multimodal surrogates for video browsing

Three types of video surrogates visual (keyframes), verbal (keywords/phrases), and visual and verbal were designed and studied in a qualitative investigation of user cognitive processes. The results favor the combined surrogates in which verbal information and images reinforce each other, lead to better comprehension, and may actually require less processing time. The results also highlight image features users found most helpful. These findings will inform the interface design and video representation for video retrieval and browsing

[1]  Michael G. Christel,et al.  Improving Access to a Digital Video Library , 1997, INTERACT.

[2]  Dragutin Petkovic,et al.  Key to effective video retrieval: effective cataloging and browsing , 1998, MULTIMEDIA '98.

[3]  Walter Bender,et al.  Salient Stills: Process and Practice , 1996, IBM Syst. J..

[4]  Brian C. O'Connor,et al.  Selecting Key Frames of Moving Image Documents: A Digital Environment for Analysis and Navigation. , 1991 .

[5]  Peter G. B. Enser.  Pictorial information retrieval , 1995 .

[6]  M. Patton.  Qualitative evaluation and research methods, 2nd ed. , 1990 .

[7]  Akiba A. Cohen,et al.  Decision Making in VCR Rental Libraries , 1987 .

[8]  Gary Marchionini,et al.  Dynamic key frame presentation techniques for augmenting video browsing , 1998, AVI '98.

[9]  Peiling Wang,et al.  A cognitive model of document use during a research project. Study I. document selection , 1998 .

[10]  Harold Borko,et al.  Abstracting Concepts and Methods , 1975 .

[11]  Joseph A. Maxwell,et al.  Qualitative Research Design: An Interactive Approach , 1996 .

[12]  Rainer Lienhart,et al.  Automatic text recognition for video indexing , 1997, MULTIMEDIA '96.

[13]  Brian C. O'Connor,et al.  Access to Moving Image Documents: Background Concepts and Proposals for Surrogates for film and video Works , 1985, J. Documentation.

[14]  James M. Turner,et al.  Determining the subject content of still and moving image documents for storage and retrieval : an experimental investigation , 1994 .

[15]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[16]  Peiling Wang,et al.  A Cognitive Model of Document Use During a Research Project. Study I. Document Selection , 1998, J. Am. Soc. Inf. Sci..

[17]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[18]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[19]  Abby Goodrum.  A Guide to Image Processing and Picture Management , 1996, Inf. Process. Manag..

[20]  Gary Marchionini,et al.  Content + connectivity => community: digital resources for a learning community , 1997, DL '97.

[21]  John Morgan,et al.  See What I Mean: An Introduction to Visual Communication , 1986 .