A 2D-3D Hybrid Approach to Video Stabilization

In this paper, we introduce a novel 2D-3D hybrid video stabilization method which combines virtues of 2D and 3D video stabilization methods in one routine. It attempts to achieve high-quality camera motions and to retain full frame coherence in each frame, at while, ensure that local regions undergo a similarity transformation. We solve the stabilization problem by integrating 3D and 2D video stabilization methods into one routine. It smooths camera motions and explicitly employs local motion information which constraints video frames to be temporal coherent, and achieves high-quality video stabilization. Experiments s how t hat our method not only can achieve high-quality camera motion on good 3D reconstructed scene, but also can deal with complicated videos containing near, large moving objects.

[1]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[2]  Maneesh Agrawala,et al.  Using Photographs to Enhance Videos of a Static Scene , 2007, Rendering Techniques.

[3]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[4]  Samuel Audet,et al.  Image-Based Rendering Using Image-Based Priors , 2006 .

[5]  Hujun Bao,et al.  Video stabilization based on a 3D perspective camera model , 2009, The Visual Computer.

[6]  Daniel Cremers,et al.  Anisotropic Huber-L1 Optical Flow , 2009, BMVC.

[7]  Marc Alexa,et al.  As-rigid-as-possible shape interpolation , 2000, SIGGRAPH.

[8]  Guillaume Caumon,et al.  Concurrent number cruncher: a GPU implementation of a general sparse linear solver , 2009, Int. J. Parallel Emergent Distributed Syst..

[9]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michael Gleicher,et al.  Subspace video stabilization , 2011, TOGS.

[11]  Tong-Yee Lee,et al.  Motion-based video retargeting with optimized crop-and-warp , 2010, SIGGRAPH 2010.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Michael Gleicher,et al.  Re-cinematography: Improving the camerawork of casual video , 2008, TOMCCAP.

[14]  Maurizio Pilu,et al.  Video stabilization as a variational problem and numerical solution with the Viterbi method , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Michael Bosse,et al.  Non-metric image-based rendering for video stabilization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Scott Schaefer,et al.  Image deformation using moving least squares , 2006, ACM Trans. Graph..

[17]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[18]  Paul S. Heckbert,et al.  Fundamentals of Texture Mapping and Image Warping , 1989 .

[19]  Rama Chellappa,et al.  Evaluation of image stabilization algorithms , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).