Generation and Error Characterization of Pararell-Perspective Stereo Mosaics from Real Video

There have been attempts in a variety of applications to add 3D information into an image-based mosaic representation. Creating stereo mosaics from two rotating cameras was proposed by [Huang & Hung, 1998], and from a single off-center rotating camera by [Ishiguro, et al, 1990], [Peleg & Ben-Ezra, 1999], and by [Shum & Szeliski, 1999]. In these kinds of stereo mosaics, however, viewpoints — therefore the parallax — are limited to images taken from a very small area. Recently our work at UMass ([Zhu, et al, 1999, Zhu, et al, 2001a, Zhu, et al, 2001b]) has been focused on parallel-perspective stereo mosaics from a dominantly translating camera, which is the typical prevalent sensor motion during aerial surveys. A rotating camera can be easily controlled to achieve the desired motion. On the contrary, the translation of a camera over a large distance is much harder to achieve in real vision applications such as robot navigation ([Zheng & Tsuji, 1992]) and environmental monitoring ([Kumar, et al, 1995, Schultz, et al, 2000, Zhu, et al, 2001a]). In an applications to environmental monitoring, we have previously shown ([Zhu, et al, 1999, Zhu, et aI, 2001a, Zhu, et al, 2001b]) that image mosaicing from a translating camera raises a set of different problems from that of circular projections of a rotating camera.

[1]  Shmuel Peleg,et al.  Stereo panorama with a single camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  Richard Szeliski,et al.  Direct methods for visual scene reconstruction , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[3]  Howard Schultz,et al.  Terrain reconstruction from widely separated images , 1995, Defense, Security, and Sensing.

[4]  Harry Shum,et al.  Parallel projections for stereo reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Allen R. Hanson,et al.  Parallel-perspective stereo mosaics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Allen R. Hanson,et al.  A System for Real-time Generation of Geo-referenced Terrain Models , 2000 .

[7]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Shmuel Peleg,et al.  Universal mosaicing using pipe projection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Yi-Ping Hung,et al.  Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming , 1998, Graph. Model. Image Process..

[10]  Hiroshi Ishiguro,et al.  Omni-directional stereo for making global map , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[11]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Rajiv Gupta,et al.  Linear pushbroom cameras , 1997 .

[13]  Harpreet S. Sawhney Simplifying motion and structure analysis using planar parallax and image warping , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[14]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[16]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[17]  A. R. Hanson,et al.  Theory and Practice in Making Seamless Stereo Mosaics from Airborne Video TITLE2 , 2001 .

[18]  Allen R. Hanson,et al.  STEREO MOSAICS FROM A MOVING VIDEO CAMERA FOR ENVIRONMENTAL MONITORING , 1999 .

[19]  Michal Irani,et al.  Representation of scenes from collections of images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).