Content-based browsing and editing of unstructured video

The focus of this paper is on building a set of tools that analyze, characterize and prepare footage shots with a camera for unanticipated uses. The idea is to take this ensemble of raw stuff and use it in interesting ways that are not just making a sequence out of them. Some of the possible uses of such unstructured video are: making a time slice of a person or a series of events, selecting a group of shots and making a postcard out of them, making a collage of shots, making a SalientStill/sup TM/ storyboard, etc. We employ novel distribution clustering algorithms to enable the browsing of unstructured video. The browser permits navigation of content and extraction of stills, collages and summaries from unstructured video.

[1]  Giridharan Iyengar,et al.  Characterization of unstructured video , 1999 .

[2]  Robert Silvers,et al.  Photomosaics : putting pictures in their place , 1996 .

[3]  Giridharan Iyengar,et al.  Video and image clustering using relative entropy , 1998, Electronic Imaging.

[4]  Giridharan Iyengar,et al.  Evolving discriminators for querying video sequences , 1997, Electronic Imaging.

[5]  Nuno Vasconcelos,et al.  A Bayesian framework for semantic content characterization , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[9]  Geoffrey C. Fox,et al.  Vector quantization by deterministic annealing , 1992, IEEE Trans. Inf. Theory.

[10]  Ullas Gargi,et al.  Performance characterization and comparison of video indexing algorithms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[11]  M. Smith,et al.  Video Skimming for Quick Browsing based on Audio and Image Characterization , 1995 .

[12]  R. Kumar,et al.  Video abstraction: summarizing video content for retrieval and visualization , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[13]  Thomas P. Minka,et al.  An image database browser that learns from user interaction , 1996 .