Video Collage: A Novel Presentation of Video Sequence

This paper presents an automatic procedure for constructing a compact synthesized collage from a video sequence. The synthesized image called video collage, is a kind of static video summary - to select most representative images from video, to extract salient regions of interest (ROI) from these images and resize them according to their saliency, and to seamlessly arrange ROI on a given canvas with the temporal structure of video content preserved. We formulate the generation of video collage as an energy minimization problem in which each of above desirability is represented by an energy term. Unlike most existing video presentation schemes, video collage is more compact and visually appealing. We have applied video collage on several home videos and report superior performance in a user study compared with key existing approaches to video presentation.

[1]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[2]  Xian-Sheng Hua,et al.  Video booklet , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[3]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[4]  HongJiang Zhang,et al.  Video Snapshot: A Bird View of Video Sequence , 2005, 11th International Multimedia Modelling Conference.

[5]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[6]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[7]  Harry Shum,et al.  Picture Collage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Andreas Girgensohn,et al.  Stained-glass visualization for highly condensed video summaries , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).