EXAMPLE-BASED MOTION MANIPULATION Pin-Ching Su, Hwann-Tzong chen

This paper introduces an idea of imitating camera movements and shooting styles from an example video and reproducing the effects on another carelessly shot video. Our goal is to compute a series of transformations so that we can warp the input video and make the flow of the output video resemble the example flow. We formulate and solve an optimization problem to find the required transformation for each video frame. By enforcing the resemblance between flow fields, our method can recreate different shooting styles and camera movements, from simple effect of video stabilization, to more complicated ones like anti-blur panning, smooth zoom, tracking shot, and dolly zoom.

[1]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, ICCV.

[2]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[6]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[7]  A. Torralba,et al.  Motion magnification , 2005, SIGGRAPH 2005.

[8]  Yasuyuki Matsushita,et al.  Video Completion by Motion Field Transfer , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Hailin Jin,et al.  Light field video stabilization , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Feng Liu,et al.  Spatially and Temporally Optimized Video Stabilization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[11]  Michael Gleicher,et al.  Re-cinematography: Improving the camerawork of casual video , 2008, TOMCCAP.

[12]  F. Mosteller,et al.  Understanding robust and exploratory data analysis , 1985 .

[13]  Michael Gleicher,et al.  Subspace video stabilization , 2011, TOGS.