Video stabilization with L1–L2 optimization

Digital videos often suffer from undesirable camera jitters because of unstable camera motions. In this paper we present a novel video stabilization algorithm by mixed L1-L2 optimization, aiming at removing unwanted camera movements as well as keeping the original video information to the greatest extent. In the proposed algorithm, we compute smoothed camera paths that are composed of constant, linear and parabolic segments by L1 constraints, meanwhile using the L2 norm of the difference between smoothed and original camera paths to retain the video information. Different from other existing methods, there is only one parameter to control effects of two terms, which is both flexible and easy to meet different requirements in practice. We further design an efficient moving window scheme to support online processing or unlimited length video. Experimental results demonstrate the good performance of our proposed algorithm.

[1]  Sebastiano Battiato,et al.  SIFT Features Tracking for Video Stabilization , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[2]  Michael Elad,et al.  L1-L2 Optimization in Signal and Image Processing , 2010, IEEE Signal Processing Magazine.

[3]  Michael Gleicher,et al.  Subspace video stabilization , 2011, TOGS.

[4]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[5]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[9]  Sebastiano Battiato,et al.  A robust video stabilization system by adaptive motion vectors filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.