Stereo mosaics with slanting parallel projections from many cameras or a moving camera

This paper presents an approach of fusing images from many video cameras or a moving video camera with external orientation data (e.g. GPS and INS data) into a few mosaicked images that preserve 3D information. In both cases, a virtual 2D array of cameras with FOV overlaps is formed to generate the whole coverage of a scene (or an object). We propose a representation that can re-organize the original perspective images into a set of parallel projections with different slanting viewing angles. In addition to providing a wide field of view, there are two more benefits of such a representation. First, mosaics with different slanting views represent occlusions encountered in a usual nadir view. Second, stereo pair can be formed from a pair of slanting parallel mosaics thus image-based 3D viewing can be achieved. This representation can be used as both an advanced video interface for surveillance or a pre-processing for 3D reconstruction.

[1]  Howard Schultz,et al.  Terrain reconstruction from widely separated images , 1995, Defense, Security, and Sensing.

[2]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Allen R. Hanson,et al.  Parallel-Perspective Stereo Mosaics , 2001, ICCV.

[4]  Allen R. Hanson,et al.  Generation and Error Characterization of Pararell-Perspective Stereo Mosaics from Real Video , 2003 .

[5]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[8]  Richard Szeliski,et al.  Stereo reconstruction from multiperspective panoramas , 2004 .

[9]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[10]  Allen R. Hanson,et al.  Parallel-perspective stereo mosaics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Daphna Weinshall,et al.  Mosaicing New Views: The Crossed-Slits Projection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Richard Szeliski,et al.  A layered approach to stereo reconstruction , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[13]  Allen R. Hanson,et al.  3D LAMP: a new layered panoramic representation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Harry Shum,et al.  Parallel projections for stereo reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Allen R. Hanson,et al.  Mosaic generation for under vehicle inspection , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..