A fast and stable seam selection algorithm for video stitching based on seam temporal propagation constraint

A fast and stable seam selection method applicable to time-synchronized video streams is proposed in this paper. The method exhibits low computational time and good performance using frame to frame correction. The main contribution of this paper is the proposed seam temporal propagation constraint that exploits spatial contextual information to avoid artifacts caused by large seam shifts between successive video frames. Furthermore, an enhanced dynamic programming algorithm is introduced to obtain optimal seams with a comparably low execution time. A video stitching platform is employed to provide a detailed experimental comparison of the proposed method with existing methodologies. Our results clearly indicate that employing contextual information in video stitching can achieve a significant reduction in artifacts.

[1]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[2]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[4]  Valerio Pascucci,et al.  Panorama weaving , 2012, ACM Trans. Graph..

[5]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[7]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Y. Takishima,et al.  A fast video stitching method for motion-compensated frames in compressed video streams , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[9]  Ayman Kaheel,et al.  Stitching videos streamed by mobile phones in real-time , 2009, ACM Multimedia.

[10]  Ayman Kaheel,et al.  Mobicast: a system for collaborative event casting using mobile phones , 2009, MUM.

[11]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[12]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[13]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yue Yu,et al.  A new optimal seam selection method for airborne image stitching , 2009, 2009 IEEE International Workshop on Imaging Systems and Techniques.

[15]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[17]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ayman Kaheel,et al.  Fast stitching of videos captured from freely moving devices by exploiting temporal redundancy , 2010, 2010 IEEE International Conference on Image Processing.