Geodesic Video Stabilization in Transformation Space

We present a novel formulation of video stabilization in the space of geometric transformations. With the setting of the Riemannian metric, the optimized smooth path is cast as the geodesics on the Lie group embedded in transformation space. While solving the geodesics has a closed-form expression in a certain space, path smoothing can be easily implemented by using geometric interpolation, rather than optimizing any space-time energy function. Specially, by using the geodesic solution in the space of rigid transformations, our approach even gains speedup $10\times $ faster than state-of-the-art methods for path smoothing and motion compensation, and guarantees no extra distortion drawn into the stabilized frames. The experiments demonstrate the efficiency and effectiveness of our algorithm on stabilizing a variety of shaky videos.

[1]  Hua Huang,et al.  Multiplane Video Stabilization , 2013, Comput. Graph. Forum.

[2]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yun Zhang,et al.  Efficient Video Cutout by Paint Selection , 2015, Journal of Computer Science and Technology.

[4]  S. Helgason LIE GROUPS AND SYMMETRIC SPACES. , 1968 .

[5]  Sebastiano Battiato,et al.  A Robust Image Alignment Algorithm for Video Stabilization Purposes , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Jian Sun,et al.  Bundled camera paths for video stabilization , 2013, ACM Trans. Graph..

[7]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[8]  Steven M. Seitz,et al.  View-Invariant Analysis of Cyclic Motion , 1997, International Journal of Computer Vision.

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[11]  Raanan Fattal,et al.  Video stabilization using epipolar geometry , 2012, TOGS.

[12]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Feng Liu,et al.  Spatially and Temporally Optimized Video Stabilization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[14]  Chao Jia,et al.  Ieee Transactions on Signal Processing 1 Constrained 3d Rotation Smoothing via Global Manifold Regression for Video Stabilization , 2022 .

[15]  Michael Gleicher,et al.  Subspace video stabilization , 2011, TOGS.

[16]  Michael F. Cohen,et al.  Real-time hyperlapse creation via optimal frame selection , 2015, ACM Trans. Graph..

[17]  Bing-Yu Chen,et al.  Capturing Intention‐based Full‐Frame Video Stabilization , 2008, Comput. Graph. Forum.

[18]  Zhe Zhu,et al.  3D modeling and motion parallax for improved videoconferencing , 2016, Computational Visual Media.

[19]  Jiajun Bu,et al.  Video stabilization with a depth camera , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Irfan A. Essa,et al.  Calibration-free rolling shutter removal , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[21]  Kazuki Nishi,et al.  Evaluation system for camera shake and image stabilizers , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[22]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[23]  Jian Sun,et al.  SteadyFlow: Spatially Smooth Optical Flow for Video Stabilization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  S. Helgason Differential Geometry, Lie Groups, and Symmetric Spaces , 1978 .

[25]  Ernesto Zacur,et al.  Left-Invariant Riemannian Geodesics on Spatial Transformation Groups , 2014, SIAM J. Imaging Sci..

[26]  Zihan Zhou,et al.  Plane-Based Content Preserving Warps for Video Stabilization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Han Zhao,et al.  Simultaneous Camera Path Optimization and Distraction Removal for Improving Amateur Video , 2015, IEEE Transactions on Image Processing.

[28]  Spyridon Leonardos,et al.  The exponential map for the group of similarity transformations and applications to motion interpolation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Hujun Bao,et al.  Video stabilization based on a 3D perspective camera model , 2009, The Visual Computer.

[31]  Hua Huang,et al.  A Global Approach to Fast Video Stabilization , 2017, IEEE Transactions on Circuits and Systems for Video Technology.