An improved belief propagation method for dynamic collage

This paper presents a new photo browsing technique, dynamic collage. Although previous photo collage techniques have innate advantages for viewing several photos collectively, they only focus on a static two-dimensional arrangement of photos so that the scalability is limited. In dynamic collage, new photos are incrementally inserted into the collage one by one while the old photos are removed accordingly, the positions of photos in the canvas are updated with a local and incremental manner to form a new layout so as to maximize visibility of all the important information embedded in the current collage meanwhile maintaining the visual continuity of two successive collages. To achieve this goal, a carefully designed optimization method based on belief propagation is employed. Unlike most traditional applications of belief propagation on pairwise MRF, we apply belief propagation on factor graph to optimize terms which cannot be represented by pairwise restricted belief propagation. We propose a novel approximate method to reduce the computation complexity, and this approximate method suggests a direction for using belief propagation on factor graph to optimize high order potential functions similar to ours.

[1]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Tao Mei,et al.  Spatio-temporal quality assessment for home videos , 2005, MULTIMEDIA '05.

[3]  Brian Potetz,et al.  Efficient Belief Propagation for Vision Using Linear Constraint Nodes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Tien-Tsin Wong,et al.  Dense photometric stereo using tensorial belief propagation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Alexander C. Loui,et al.  Using Genetic Algorithms for Album Page Layouts , 2003, IEEE Multim..

[6]  Jun-Cheng Chen,et al.  Tiling slideshow , 2006, MM '06.

[7]  Harry Shum,et al.  Picture Collage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[9]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[10]  Yasuyuki Matsushita,et al.  Space-Time Video Montage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[12]  Irfan A. Essa,et al.  Mediating photo collage authoring , 2005, UIST.

[13]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[14]  Andrew Blake,et al.  Digital tapestry [automatic image synthesis] , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Tao Mei,et al.  Video Collage: A Novel Presentation of Video Sequence , 2007, 2007 IEEE International Conference on Multimedia and Expo.