Interactive Multi-View Facade Image Editing

We propose a system for generating high-quality approximated façade ortho-textures based on a set of perspective source photographs taken by a consumer hand-held camera. Our approach is to sample a combined orthographic approximation over the façade-plane from the input photos. In order to avoid kinks and seams which may occur on transitions between different source images, we introduce color adjustment and gradient domain stitching by solving a Poisson equation in real-time. In order to add maximum control on the one hand and easy interaction on the other, we provide several editing interactions allowing for user-guided post-processing.

[1]  Peter Wonka,et al.  A GPU Laplacian solver for diffusion curves and Poisson image editing , 2009, ACM Transactions on Graphics.

[2]  Daniel Cohen-Or,et al.  Seamless Montage for Texturing Models , 2010, Comput. Graph. Forum.

[3]  Werner Purgathofer,et al.  Tiling of ortho-rectified facade images , 2010, SCCG.

[4]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[5]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[6]  Anita Sellent,et al.  Floating Textures , 2008, Comput. Graph. Forum.

[7]  Marc Pollefeys,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH 2008.

[8]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, ACM Trans. Graph..

[9]  Leif Kobbelt,et al.  Interactive image completion with perspective correction , 2006, The Visual Computer.

[10]  Steven M. Seitz,et al.  Finding paths through the world's photos , 2008, SIGGRAPH 2008.

[11]  Seth J. Teller,et al.  Extracting textured vertical facades from controlled close-range imagery , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, ACM Trans. Graph..

[13]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[14]  Horst Bischof,et al.  Towards Wiki-based Dense City Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Werner Purgathofer,et al.  Symmetry-Based Façade Repair , 2009, VMV.

[16]  Konrad Klein,et al.  Texturing 3D Models of Real World Objects from Multiple Unregistered Photographic Views , 1999, Comput. Graph. Forum.

[17]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[18]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, ACM Trans. Graph..

[19]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[20]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[21]  Marc Levoy,et al.  Interactive design of multi-perspective images for visualizing urban landscapes , 2004, IEEE Visualization 2004.

[22]  Sylvain Lefebvre,et al.  Texture Synthesis From Photographs , 2008, Comput. Graph. Forum.

[23]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[24]  Daphna Weinshall,et al.  Mosaicing New Views: The Crossed-Slits Projection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Jiang Yu Zheng.  Digital Route Panoramas , 2003, IEEE Multim..

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[28]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[29]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[30]  Philip H. S. Torr,et al.  VideoTrace: rapid interactive scene modelling from video , 2007, SIGGRAPH 2007.

[31]  Hans-Peter Seidel,et al.  3D-modeling by ortho-image generation from image sequences , 2008, ACM Trans. Graph..

[32]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[33]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[34]  Steven M. Seitz,et al.  Multiperspective Imaging , 2003, IEEE Computer Graphics and Applications.

[35]  Jianxiong Xiao,et al.  Image-based façade modeling , 2008, ACM Trans. Graph..

[36]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.