Spatiotemporal alignment of multi-sensor aerial video sequences

This paper presents a method for spatiotemporal alignment of two video sequences recorded by aerial sensors using different modularity. It recovers the inter-video temporal synchronization and spatial transformation from two sequences of intra-video transformations between successive frames within each video. Since it needs no directly comparison of images across two videos, and the intra-video transformation is easy to obtain, the alignment is possible even when the two videos have very different appearances. We make best use of the geometry between rigidly connected aerial video sensors and the ground scene, treat the intra-video and inter-video spatial transformations as similar ones, and develop a simple alignment method. Both theoretical analysis and experimental results demonstrate the stability and efficiency advantages over previous methods.

[1]  Yaron Caspi,et al.  Alignment of non-overlapping sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Denis Simakov,et al.  Feature-Based Sequence-to-Sequence Matching , 2006, International Journal of Computer Vision.

[3]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[4]  Karl C. Walli.  Automated multisensor image registration , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[5]  Yaron Caspi,et al.  A step towards sequence-to-sequence alignment , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Gideon P. Stein,et al.  Tracking from multiple view points: Self-calibration of space and time , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).