Rapid serial visual presentation techniques for consumer digital video devices

In this paper we propose a new model for a class of rapid serial visual presentation (RSVP) interfaces [16] in the context of consumer video devices. The basic spatial layout "explodes" a sequence of image frames into a 3D trail in order to provide more context for a spatial/temporal presentation. As the user plays forward or back, the trail advances or recedes while the image in the foreground focus position is replaced. The design is able to incorporate a variety of methods for analyzing or highlighting images in the trail. Our hypotheses are that users can navigate more quickly and precisely to points of interest when compared to conventional consumer-based browsing, channel flipping, or fast-forwarding techniques. We report on an experiment testing our hypotheses in which we found that subjects were more accurate but not faster in browsing to a target of interest in recorded television content with a TV remote.

[1]  Steven M. Drucker,et al.  SmartSkip: consumer level browsing and skipping of digital video content , 2002, CHI.

[2]  Osamu Hori,et al.  A shot classification method of selecting effective key-frames for video browsing , 1997, MULTIMEDIA '96.

[3]  Anoop Gupta,et al.  Browsing digital video , 2000, CHI.

[4]  James T. Enns,et al.  High-speed visual estimation using preattentive processing , 1996, TCHI.

[5]  Oscar de Bruijn,et al.  Rapid serial visual presentation: a space-time trade-off in information presentation , 2000, AVI '00.

[6]  David Gelernter,et al.  Lifestreams: a storage model for personal data , 1996, SGMD.

[7]  Tom Lanning,et al.  Browsing through rapid-fire imaging: requirements and industry initiatives , 1999, Electronic Imaging.

[8]  Oscar de Bruijn,et al.  Patterns of eye gaze during rapid serial visual presentation , 2002, AVI '02.

[9]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[10]  S BoothKellogg,et al.  High-speed visual estimation using preattentive processing , 1996 .

[11]  Gary Marchionini,et al.  Dynamic key frame presentation techniques for augmenting video browsing , 1998, AVI '98.

[12]  Christopher Martin,et al.  Browsing with dynamic key frame collages in Web-based entertainment video services , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[13]  Tom Lanning,et al.  Rapid-fire image previews for information navigation , 1998, AVI '98.

[14]  Alan F. Smeaton,et al.  Implementation and Analysis of Several Keyframe-Based Browsing Interfaces to Digital Video , 2000, ECDL.

[15]  Michael G. Christel,et al.  Multimedia abstractions for a digital video library , 1997, DL '97.

[16]  Edward Lee Elliott.  Watch-grab-arrange-see : thinking with motion images via streams and collages , 1993 .

[17]  V. Coltheart.  Fleeting memories : cognition of brief visual stimuli , 1999 .

[18]  Robert Spence,et al.  Rapid, Serial and Visual: A Presentation Technique with Potential , 2002, Inf. Vis..

[19]  Shingo Uchihashi,et al.  An interactive comic book presentation for exploring video , 2000, CHI.

[20]  Ganesh S. Oak.  Information Visualization Introduction , 2022 .

[21]  Gary Marchionini,et al.  Multimodal surrogates for video browsing , 1999, DL '99.

[22]  Alan Esenther,et al.  Rapid Serial Visual Presentation Techniques for Visualizing a 3rd Data Dimension , 2003 .

[23]  Regunathan Radhakrishnan,et al.  Generation of sports highlights using motion activity in combination with a common audio feature extraction framework , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[24]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.