Shape Context Based Video Texture Synthesis from Still Images

A video texture provides a continuous varying stream of images. In this paper, we introduce a new algorithm that allows the user to easily produce a visually plausible video texture from a small collection of still images. In order to approximate the original temporal order of the scene, we apply a shape context based order recovery algorithm to the still images. The frame sequence is subsequently generated using a second order Markov Chain model. The final video texture is generated by frame interpolation which utilizes thin-plate spline warping and inverse distance weighting interpolation techniques. In conclusion, we show that significant improvements are obtained by using TPS warping technique instead of traditional optical flow method.

[1]  Song-Chun Zhu,et al.  Modeling textured motion : particle, wave and sketch , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[3]  Adrien Treuille,et al.  Keyframe control of smoke simulations , 2003, ACM Trans. Graph..

[4]  David Salesin,et al.  Animating pictures with stochastic motion textures , 2005, ACM Trans. Graph..

[5]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[6]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[8]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Tian Fang,et al.  High Resolution Animated Scenes from Stills , 2007, IEEE Trans. Vis. Comput. Graph..

[10]  Robert Pless,et al.  Image spaces and video trajectories: using Isomap to explore video sequences , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Lance Williams,et al.  Animating images with drawings , 1994, SIGGRAPH.

[12]  Marc Alexa,et al.  As-rigid-as-possible shape interpolation , 2000, SIGGRAPH.

[13]  Andrew Chi-Sing Leung,et al.  Animating animal motion from still , 2008, SIGGRAPH Asia '08.

[14]  Irfan A. Essa,et al.  Controlled animation of video sprites , 2002, SCA '02.

[15]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[16]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..

[17]  David Salesin,et al.  Panoramic video textures , 2005, ACM Trans. Graph..