Free-Shaped Video Collage

With the explosive growth of multimedia data, video presentation has become an important technology for fast browsing of video content. In this paper, we present a novel video presentation technique called "Free-Shaped Video Collage" (FS-Collage), which is motivated from and built upon our previous work on Video Collage [3]. Video Collage is a kind of static summary which selects the most representative regions-of-interest (ROI) from video and seamlessly arranges them on a synthesized image. Unlike Video Collage in which both the shapes of ROI and final collage are fixed as rectangle, we support arbitrary shapes of ROI and a set of collage templates in FS-Collage. Furthermore, we design three ROI arrangement schemes (i.e., book, diagonal, and spiral ) for satisfying different video genres. We formulate the generation of FS-Collage as an energy minimization problem and solve the problem by designing a random sampling process. The experiment results show that our FS-Collage achieves satisfying performance.

[1]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[2]  Andreas Girgensohn,et al.  Stained Glass Photo Collages , 2004 .

[3]  HongJiang Zhang,et al.  Video Snapshot: A Bird View of Video Sequence , 2005, 11th International Multimedia Modelling Conference.

[4]  Tao Mei,et al.  Video Collage: A Novel Presentation of Video Sequence , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[5]  Nobuyuki Yagi,et al.  Automated production of TV program trailer using electronic program guide , 2007, CIVR '07.

[6]  Irfan A. Essa,et al.  Mediating photo collage authoring , 2005, UIST.

[7]  Tao Mei,et al.  Home Video Visual Quality Assessment With Spatiotemporal Factors , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Berna Erol,et al.  The video paper multimedia playback system , 2003, MULTIMEDIA '03.

[9]  Tao Mei,et al.  Video collage , 2007, ACM Multimedia.

[10]  Michael A. Smith,et al.  Video skimming and characterization through the combination of image and language understanding techniques , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Jun-Cheng Chen,et al.  Tiling slideshow , 2006, MM '06.

[12]  Yasuyuki Matsushita,et al.  Space-Time Video Montage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).