Mosaic-based 3D scene representation and rendering of circular aerial video

Circular aerial video provides a persistent view over a scene and generates a large amount of imagery, much of which is redundant. The interesting features of the scene are the 3D structural data, moving objects, and scenery changes. Mosaic-based scene representations work well in detecting and modeling these features while greatly reducing the amount of storage required to store a scene. In the past, mosaic-based methods have worked well for video sequences with straight camera paths in a dominant motion direction11. Here we expand on this method to handle circular camera motion. By using a polar transformation about the center of the scene, we are able to transform circular motion into an approximate linear motion. This allows us to employ proven 3D reconstruction and moving object detection methods that we have previously developed. Once features are found, they only need to be transformed back to the Cartesian space from the polar coordinate system.

[1]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Narendra Ahuja,et al.  High dynamic range panoramic imaging , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Yaron Caspi,et al.  Alignment of non-overlapping sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Allen R. Hanson,et al.  Parallel-perspective stereo mosaics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Kevin L. Priddy,et al.  Evolutionary and Bio-inspired Computation: Theory and Applications III , 2009 .

[6]  Olga Mendoza-Schrock,et al.  Exploring image registration techniques for layered sensing , 2009, Defense + Commercial Sensing.

[7]  Richard Szeliski,et al.  Stereo reconstruction from multiperspective panoramas , 2004 .

[8]  Harpreet S. Sawhney,et al.  Registration of video to geo-referenced imagery , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[9]  Allen R. Hanson,et al.  Generalized parallel-perspective stereo mosaics from airborne video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Y. Caspi,et al.  1 Alignment of Non-Overlapping Sequences , 2005 .

[11]  Yi-Ping Hung,et al.  Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming , 1998, Graph. Model. Image Process..

[12]  Shmuel Peleg,et al.  Super-Resolution from Multiple Images Having Arbitrary Mutual Motion , 2002 .

[13]  Harry Shum,et al.  Parallel projections for stereo reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).