Photographing long scenes with multi-viewpoint panoramas

We present a system for producing multi-viewpoint panoramas of long, roughly planar scenes, such as the facades of buildings along a city street, from a relatively sparse set of photographs captured with a handheld still camera that is moved along the scene. Our work is a significant departure from previous methods for creating multi-viewpoint panoramas, which composite thin vertical strips from a video sequence captured by a translating video camera, in that the resulting panoramas are composed of relatively large regions of ordinary perspective. In our system, the only user input required beyond capturing the photographs themselves is to identify the dominant plane of the photographed scene; our system then computes a panorama automatically using Markov Random Field optimization. Users may exert additional control over the appearance of the result by drawing rough strokes that indicate various high-level goals. We demonstrate the results of our system on several scenes, including urban streets, a river bank, and a grocery store aisle.

[1]  Marc Levoy,et al.  Synthetic aperture confocal imaging , 2004, ACM Trans. Graph..

[2]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[3]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Maneesh Agrawala,et al.  Artistic Multiprojection Rendering , 2000, Rendering Techniques.

[5]  M. Holly The psychology of perspective and renaissance art , 1989 .

[6]  Shmuel Peleg,et al.  Mosaicing with Parallax using Time Warping , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  Denis Simakov,et al.  Space-time scene manifolds , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Richard Szeliski,et al.  Handling occlusions in dense multi-view stereo , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[14]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[15]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[16]  G. Eichmann,et al.  Vector median filters , 1987 .

[17]  方华 google,我,萨娜 , 2006 .

[18]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[19]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[20]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[21]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[22]  David Salesin,et al.  Panoramic video textures , 2005, ACM Trans. Graph..

[23]  Leonard McMillan,et al.  General Linear Cameras , 2004, ECCV.

[24]  Jiaya Jia,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[25]  Marc Levoy,et al.  Interactive design of multi-perspective images for visualizing urban landscapes , 2004, IEEE Visualization 2004.

[26]  Leonard McMillan,et al.  A Framework for Multiperspective Rendering , 2004, Rendering Techniques.

[27]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[28]  Steven M. Seitz,et al.  Multiperspective Imaging , 2003, IEEE Computer Graphics and Applications.

[29]  Matthew A. Brown,et al.  Unsupervised 3D object recognition and reconstruction in unordered datasets , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[30]  Jiang Yu Zheng Digital Route Panoramas , 2003, IEEE Multim..

[31]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[32]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[33]  Daphna Weinshall,et al.  Mosaicing New Views: The Crossed-Slits Projection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Wilfried Linder,et al.  Digital Photogrammetry , 2003 .