Motion Guided Video Sequence Synchronization

We present an algorithm that synchronizes two short video sequences where an object undergoes ballistic motion against stationary scene points. The object’s motion and epipolar geometry are exploited to guide the algorithm to the correct synchronization in an iterative manner. Our algorithm accurately synchronizes videos recorded at different frame rates, and takes few iterations to converge to sub-frame accuracy. We use synthetic data to analyze our algorithm’s accuracy under the influence of noise. We demonstrate that it accurately synchronizes real video sequences, and evaluate its performance against manual synchronization.

[1]  Tinne Tuytelaars,et al.  Synchronizing video sequences , 2004, CVPR 2004.

[2]  M. Irani,et al.  Spatio-Temporal Alignment of Sequences , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Ian D. Reid,et al.  Goal-directed Video Metrology , 1996, ECCV.

[6]  Kiriakos N. Kutulakos,et al.  Linear sequence-to-sequence alignment , 2004, CVPR 2004.

[7]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[8]  Peter Kovesi,et al.  Tracking Footballs Through Clutter in Broadcast Digital Videos , 2004 .

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Hideo Saito,et al.  Large-scale Virtualized Reality , 2001 .

[11]  Tanveer F. Syeda-Mahmood,et al.  View-invariant alignment and matching of video sequences , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Lior Wolf,et al.  Correspondence-free Synchronization and Reconstruction in a Non-rigid Scene , 2004 .

[13]  Wojciech Chojnacki,et al.  A voting scheme for estimating the synchrony of moving-camera videos , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Ian D. Reid,et al.  Synchronizing Image Sequences of Non-Rigid Objects , 2003, BMVC.

[15]  Gideon P. Stein,et al.  Tracking from multiple view points: Self-calibration of space and time , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  T. Poggio,et al.  Synthesis and recognition of biological motion patterns based on linear superposition of prototypical motion sequences , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[17]  Marc Pollefeys,et al.  Synchronization and calibration of camera networks from silhouettes , 2004, ICPR 2004.