A Layered Approach for Fast Multi-view Stereo Panorama Generation

In this paper we propose a fast method for constructing multi-view stereo panoramas using a layering approach. Constructing panoramas requires accurate camera pose estimation and will often require an image blending or interpolation method to generate seamless results. We use a registration error correction method that provides globally corrected and fast results for paths that create cycles such as circular paths, back and forth straight sweeps, and even a single sweep. Then we apply our layering approach to generate multi-view stereo panoramas quickly for time sensitive applications that require immediate results and 3D perception.

[1]  Olga Mendoza-Schrock,et al.  Exploring image registration techniques for layered sensing , 2009, Defense + Commercial Sensing.

[2]  Allen R. Hanson,et al.  Fast construction of dynamic and multi-resolution 360 degrees panoramas from video sequences , 2006, Image Vis. Comput..

[3]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[4]  Supun Samarasekera,et al.  Visual Odometry System Using Multiple Stereo Cameras and Inertial Measurement Unit , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Allen R. Hanson,et al.  An efficient method for geo-referenced video mosaicing for environmental monitoring , 2005, Machine Vision and Applications.

[6]  Supun Samarasekera,et al.  Stable vision-aided navigation for large-area augmented reality , 2011, 2011 IEEE Virtual Reality Conference.

[7]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Harry Shum,et al.  Construction and refinement of panoramic mosaics with global and local alignment , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Allen R. Hanson,et al.  Generalized parallel-perspective stereo mosaics from airborne video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Clark N. Taylor,et al.  Creation of geo-referenced mosaics from MAV video and telemetry using constrained optimization bundle adjustment , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[12]  Andrew J. Davison,et al.  Real-Time Spherical Mosaicing Using Whole Image Alignment , 2010, ECCV.

[13]  Jiang Yu Zheng.  Digital Route Panoramas , 2003, IEEE Multim..

[14]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, SIGGRAPH 2006.

[15]  Sang Wook Lee,et al.  Multiview registration of 3D scenes by minimizing error between coordinate frames , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Chi-Keung Tang,et al.  Image Stitching Using Structure Deformation , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Supun Samarasekera,et al.  Real-time global localization with a pre-built visual landmark database , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Michael S. Brown,et al.  Constructing image panoramas using dual-homography warping , 2011, CVPR 2011.

[19]  Harpreet S. Sawhney,et al.  Automated Mosaics via Topology Inference , 2002, IEEE Computer Graphics and Applications.