论文信息 - Synthesising Dynamic Textures using Convolutional Neural Networks

Synthesising Dynamic Textures using Convolutional Neural Networks

Here we present a parametric model for dynamic textures. The model is based on spatiotemporal summary statistics computed from the feature representations of a Convolutional Neural Network (CNN) trained on object recognition. We demonstrate how the model can be used to synthesise new samples of dynamic textures and to predict motion in simple movies.

Leon A. Gatys | Alexander S. Ecker | Matthias Bethge | Christina M. Funke | M. Bethge

[1] Song-Chun Zhu,et al. Synthesizing Dynamic Textures and Sounds by Spatial-Temporal Generative ConvNet , 2016, ArXiv.

[2] Martin Szummer,et al. Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[3] Andrew Zisserman,et al. Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4] Song-Chun Zhu,et al. A Generative Method for Textured Motion: Analysis and Synthesis , 2002, ECCV.

[5] Thomas Brox,et al. Artistic Style Transfer for Videos , 2016, GCPR.

[6] Marc Levoy,et al. Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[7] Mark J. Huiskes,et al. DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[8] Xinge You,et al. Dynamic texture modeling and synthesis using multi-kernel Gaussian process dynamic model , 2016, Signal Process..

[9] Richard Szeliski,et al. Video textures , 2000, SIGGRAPH.

[10] Jorge Nocedal,et al. Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[11] Irfan A. Essa,et al. Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[12] Stefano Soatto,et al. Dynamic Textures , 2003, International Journal of Computer Vision.

[13] Leon A. Gatys,et al. Texture Synthesis Using Convolutional Neural Networks , 2015, NIPS.