Automated video looping with progressive dynamism

Given a short video we create a representation that captures a spectrum of looping videos with varying levels of dynamism, ranging from a static image to a highly animated loop. In such a progressively dynamic video, scene liveliness can be adjusted interactively using a slider control. Applications include background images and slideshows, where the desired level of activity may depend on personal taste or mood. The representation also provides a segmentation of the scene into independently looping regions, enabling interactive local adjustment over dynamism. For a landscape scene, this control might correspond to selective animation and deanimation of grass motion, water ripples, and swaying trees. Converting arbitrary video to looping content is a challenging research problem. Unlike prior work, we explore an optimization in which each pixel automatically determines its own looping period. The resulting nested segmentation of static and dynamic scene regions forms an extremely compact representation.

[1]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[2]  Richard Szeliski,et al.  A content-aware image prior , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Jan Kautz,et al.  Towards Moment Imagery: Automatic Cinemagraphs , 2011, 2011 Conference for Visual Media Production.

[4]  P. Belhumeur,et al.  Moving gradients: a path-based method for plausible image interpolation , 2009, SIGGRAPH 2009.

[5]  David Salesin,et al.  Animating pictures with stochastic motion textures , 2005, SIGGRAPH 2005.

[6]  Aseem Agarwala Efficient gradient-domain compositing using quadtrees , 2007, SIGGRAPH 2007.

[7]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[8]  Wojciech Matusik,et al.  Factored time-lapse video , 2007, ACM Trans. Graph..

[9]  Richard Szeliski,et al.  The Moment Camera , 2006, Computer.

[10]  Dani Lischinski,et al.  Dynamosaicing: Mosaicing of Dynamic Scenes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[12]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, SIGGRAPH 2005.

[13]  Edward H. Adelson,et al.  Motion without movement , 1991, SIGGRAPH.

[14]  Ning Xu,et al.  Videoshop: A new framework for spatio-temporal video editing in gradient domain , 2007, Graph. Model..

[15]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[16]  N. Ahuja,et al.  Seamless video editing , 2004, ICPR 2004.

[17]  Steven M. Drucker,et al.  Cliplets: juxtaposing still and dynamic imagery , 2012, UIST.

[18]  JoshiNeel,et al.  Automated video looping with progressive dynamism , 2013 .

[19]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[20]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[22]  Maneesh Agrawala,et al.  Selectively de-animating video , 2012, ACM Trans. Graph..

[23]  Michael F. Cohen,et al.  Fourier Analysis of the 2D Screened Poisson Equation for Gradient Domain Problems , 2008, ECCV.

[24]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  David Salesin,et al.  Panoramic video textures , 2005, ACM Trans. Graph..

[26]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .

[27]  Leonard McMillan,et al.  Computational time-lapse video , 2007, SIGGRAPH 2007.

[28]  Qunsheng Peng,et al.  Mesh-Guided Optimized Retexturing for Image and Video , 2008, IEEE Transactions on Visualization and Computer Graphics.

[29]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[30]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[31]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[32]  Michael S. Langer,et al.  Panoramic stereo video textures , 2011, 2011 International Conference on Computer Vision.

[33]  Jian Sun,et al.  Parallel graph-cuts by adaptive bottom-up merging , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Mei-Chen Yeh,et al.  An approach to automatic creation of cinemagraphs , 2012, ACM Multimedia.

[35]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.