Interactive Coherence‐Based Façade Modeling

We propose a novel interactive framework for modeling building façades from images. Our method is based on the notion of coherence‐based editing which allows exploiting partial symmetries across the façade at any level of detail. The proposed workflow mixes manual interaction with automatic splitting and grouping operations based on unsupervised cluster analysis. In contrast to previous work, our approach leads to detailed 3d geometric models with up to several thousand regions per façade. We compare our modeling scheme to others and evaluate our approach in a user study with an experienced user and several novice users.

[1]  Christopher Rasmussen,et al.  2D Lattice Extraction from Structured Environments , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Iasonas Kokkinos,et al.  Shape grammar parsing via Reinforcement Learning , 2011, CVPR 2011.

[3]  Werner Purgathofer,et al.  Tiling of ortho-rectified facade images , 2010, SCCG.

[4]  Luiz Velho,et al.  Mathematical Optimization in Computer Graphics and Vision , 2008 .

[5]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Daniel G. Aliaga,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Style Grammars for Interactive Visualization of Architecture , 2022 .

[7]  Georgios Tziritas,et al.  Single view reconstruction using shape grammars for urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Richard Szeliski,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, ACM Trans. Graph..

[9]  Frank Dellaert,et al.  A Probabilistic Approach to the Semantic Interpretation of Building Facades , 2004 .

[10]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[11]  D. Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Trans. Graph..

[12]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[13]  Marc Pollefeys,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH 2008.

[14]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[15]  Jan-Michael Frahm,et al.  Detecting Large Repetitive Structures with Salient Boundaries , 2010, ECCV.

[16]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[17]  Shi-Min Hu,et al.  Adaptive partitioning of urban facades , 2011, SA '11.

[18]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[19]  Luiz Velho,et al.  Image Processing for Computer Graphics and Vision, Second Edition , 2009, Texts in Computer Science.

[20]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[21]  Jianxiong Xiao,et al.  Image-based façade modeling , 2008, ACM Trans. Graph..

[22]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[23]  Daniel G. Aliaga,et al.  Modelling the Appearance and Behaviour of Urban Spaces , 2010, Comput. Graph. Forum.

[24]  Michael Wimmer,et al.  Interactive visual editing of grammars for procedural architecture , 2008, SIGGRAPH 2008.

[25]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, CVPR 2004.

[26]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[27]  N. Mitra,et al.  Non-local scan consolidation for 3D urban scenes , 2010, ACM Trans. Graph..

[28]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[29]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[30]  Werner Purgathofer,et al.  Interactive Multi-View Facade Image Editing , 2010, VMV.

[31]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, ACM Trans. Graph..

[32]  Shimin Hu,et al.  Adaptive Partitioning of Urban Facades , 2011 .

[33]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[34]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[35]  Hans-Peter Seidel,et al.  Real-time lens blur effects and focus control , 2010, SIGGRAPH 2010.

[36]  Vladimir Kolmogorov,et al.  Spatially coherent clustering using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[37]  Loong Fah Cheong,et al.  Symmetric architecture modeling with a single image , 2009, ACM Trans. Graph..

[38]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[39]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.