A Survey of Urban Reconstruction

This paper provides a comprehensive overview of urban reconstruction. While there exists a considerable body of literature, this topic is still under active research. The work reviewed in this survey stems from the following three research communities: computer graphics, computer vision and photogrammetry and remote sensing. Our goal is to provide a survey that will help researchers to better position their own work in the context of existing solutions, and to help newcomers and practitioners in computer graphics to quickly gain an overview of this vast field. Further, we would like to bring the mentioned research communities to even more interdisciplinary work, since the reconstruction problem itself is by far not solved.

[1]  Jie Chen,et al.  Architectural Modeling from Sparsely Scanned Range Data , 2008, International Journal of Computer Vision.

[2]  Harry Shum,et al.  Digital papercutting , 2005, SIGGRAPH '05.

[3]  Horst Bischof,et al.  Efficient Sparse 3D Reconstruction by Space Sweeping , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[4]  H. Hirschmüller Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, ACM Trans. Graph..

[6]  Richard Szeliski,et al.  Finding paths through the world's photos , 2008, ACM Trans. Graph..

[7]  Qinping Zhao,et al.  Rectilinear parsing of architecture in urban environment , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[9]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[10]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[11]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Bernhard Hohmann,et al.  Cityfit - High-Quality Urban Reconstruction by Fitting Shape Grammars to Image and derived Textured Point Clouds , 2008 .

[13]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Chao Yang,et al.  Parsing façade with rank-one approximation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Susanne Becker,et al.  Generation and application of rules for quality dependent façade reconstruction , 2009 .

[16]  Zhonghua Liu,et al.  Face Recognition Based on Wavelet Transform, Singular Value Decomposition and Kernel Principal Component Analysis , 2008, 2008 Chinese Conference on Pattern Recognition.

[17]  Nora Ripperda DETERMINATION OF FACADE ATTRIBUTES FOR FACADE RECONSTRUCTION , 2007 .

[18]  M. Brunner,et al.  Opportunities, Requirements and Challenges for Storing Network Management Information in a Decentralized Way , 2008, 2008 IEEE Globecom Workshops.

[19]  Michael Goesele,et al.  Scene Reconstruction and Visualization From Community Photo Collections , 2010, Proceedings of the IEEE.

[20]  S. Teller Automated urban model acquisition : Project rationale and status , 1999 .

[21]  Georgios Tziritas,et al.  Single view reconstruction using shape grammars for urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  F. Durand,et al.  Image-based modeling and photo editing , 2001, SIGGRAPH.

[23]  J. Campbell Introduction to remote sensing , 1987 .

[24]  Sylvain Lefebvre,et al.  Texture Synthesis From Photographs , 2008, Comput. Graph. Forum.

[25]  Jan-Michael Frahm,et al.  Piecewise planar and non-planar stereo for urban scene reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[27]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[28]  Roberto Cipolla,et al.  Automatic 3D Modelling of Architecture , 2000, BMVC.

[29]  Hans-Peter Seidel,et al.  Symmetry Detection Using Feature Lines , 2009, Comput. Graph. Forum.

[30]  Philip H. S. Torr,et al.  Interactive 3D Model Completion , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[31]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR.

[32]  Horst Bischof,et al.  Towards Wiki-based Dense City Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[33]  Philip H. S. Torr,et al.  VideoTrace: rapid interactive scene modelling from video , 2007, ACM Trans. Graph..

[34]  Hans-Peter Seidel,et al.  Shape Analysis with Subspace Symmetries , 2011, Comput. Graph. Forum.

[35]  Charalampos Georgiadis,et al.  IMAGE ORIENTATION FOR INTERACTIVE TOURS OF VIRTUALLY-MODELED SITES , 2005 .

[36]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[37]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[38]  H. Seidel,et al.  Pattern-aware Deformation Using Sliding Dockers , 2011, SIGGRAPH 2011.

[39]  Lorenzo Gonzo,et al.  MODELLING WITH REUSABLE AND INTEGRATED BUILDING BLOCKS , 2005 .

[40]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Helmut Mayer,et al.  MCMC LINKED WITH IMPLICIT SHAPE MODELS AND PLANE SWEEPING FOR 3D BUILDING FACADE INTERPRETATION IN IMAGE SEQUENCES , 2006 .

[42]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[43]  Luc Van Gool,et al.  3D Urban Scene Modeling Integrating Recognition and Reconstruction , 2008, International Journal of Computer Vision.

[44]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Swarup Medasani,et al.  Strip Histogram Grid for efficient LIDAR segmentation from urban environments , 2011, CVPR 2011 WORKSHOPS.

[46]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[48]  Ulrich Neumann,et al.  A streaming framework for seamless building reconstruction from large-scale aerial LiDAR data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[50]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[51]  Ramakant Nevatia,et al.  Interactive 3D building modeling using a hierarchical representation , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[52]  Allen R. Hanson,et al.  Surface Texture and Microstructure Extraction from Multiple Aerial Images , 2001, Comput. Vis. Image Underst..

[53]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[54]  Ramakant Nevatia,et al.  Automatic Integration of Facade Textures into 3D Building Models with a Projective Geometry Based Line Clustering , 2002, Comput. Graph. Forum.

[55]  N. Mitra,et al.  Non-local scan consolidation for 3D urban scenes , 2010, ACM Trans. Graph..

[56]  Seth J. Teller,et al.  Extracting textured vertical facades from controlled close-range imagery , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[57]  Florent Lafarge,et al.  A Hybrid Multiview Stereo Algorithm for Modeling Urban Scenes , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[59]  Daniel G. Aliaga,et al.  Modelling the Appearance and Behaviour of Urban Spaces , 2010, Comput. Graph. Forum.

[60]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..

[61]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Werner Purgathofer,et al.  Interactive Multi-View Facade Image Editing , 2010, VMV.

[63]  Norbert Haala,et al.  GRAMMAR SUPPORTED FACADE RECONSTRUCTION FROM MOBILE LIDAR MAPPING , 2009 .

[64]  Feng Han,et al.  Bottom-up/top-down image parsing by attribute graph grammar , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[65]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[66]  Luc Van Gool,et al.  Towards mass-produced building models , 2007 .

[67]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[68]  Claus Brenner,et al.  Application of a Formal Grammar to Facade Reconstruction in Semiautomatic and Automatic Environments , 2009 .

[69]  Daniel G. Aliaga,et al.  Automatic Extraction of Manhattan-World Building Masses from 3D Laser Range Scans , 2012, IEEE Transactions on Visualization and Computer Graphics.

[70]  Andrew Zisserman,et al.  Geometric Grouping of Repeated Elements within Images , 1998, BMVC.

[71]  Helmut Mayer,et al.  IMPLICIT SHAPE MODELS, MODEL SELECTION, AND PLANE SWEEPING FOR 3D FACADE INTERPRETATION , 2007 .

[72]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[73]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[74]  Niloy J. Mitra,et al.  Variation-Factored Encoding of Facade Images , 2012, Eurographics.

[75]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[76]  Ramakant Nevatia,et al.  Automatic and interactive modeling of buildings in urban environments from aerial images , 2002, Proceedings. International Conference on Image Processing.

[77]  Loong Fah Cheong,et al.  Symmetric architecture modeling with a single image , 2009, ACM Trans. Graph..

[78]  Christian Früh,et al.  Constructing 3D City Models by Merging Aerial and Ground Views , 2003, IEEE Computer Graphics and Applications.

[79]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[80]  Jan Mayer,et al.  A numerical evaluation of preprocessing and ILU-type preconditioners for the solution of unsymmetric sparse linear systems using iterative methods , 2009, TOMS.

[81]  Roberto Cipolla,et al.  3D models of architectural scenes from uncalibrated images and vanishing points , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[82]  Jan-Michael Frahm,et al.  3D Reconstruction Using an n-Layer Heightmap , 2010, DAGM-Symposium.

[83]  Fuan Tsai,et al.  Semiautomatic texture generation and transformation for cyber city building models , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[84]  Jan Boehm Multi-image fusion for occlusion-free faÇade texturing , 2004 .

[85]  S. Teller,et al.  RECOVERING FACADE TEXTURE AND MICROSTRUCTURE FROM REAL-WORLD IMAGES , 2002 .

[86]  Philip H. S. Torr,et al.  A shape hierarchy for 3D modelling from video , 2007, GRAPHITE '07.

[87]  T. Funkhouser,et al.  A planar-reflective symmetry transform for 3D shapes , 2006, ACM Trans. Graph..

[88]  Thomas B. Moeslund,et al.  3D Reconstruction of Buildings with Automatic Facade Refinement , 2011, ISVC.

[89]  Luc Van Gool,et al.  Parameter-free/Pareto-driven procedural 3D reconstruction of buildings from ground-level sequences , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[90]  Radomír Mech,et al.  Guided Procedural Modeling , 2011, Comput. Graph. Forum.

[91]  Suya You,et al.  Automatic Creation of Massive Virtual Cities , 2009, 2009 IEEE Virtual Reality Conference.

[92]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  F. Tsai,et al.  Polygon‐based texture mapping for cyber city 3D building models , 2007, Int. J. Geogr. Inf. Sci..

[94]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, SIGGRAPH 2009.

[95]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[96]  Markus Gerke,et al.  The ISPRS benchmark on urban object classification and 3D building reconstruction , 2012 .

[97]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[98]  Michael Wimmer,et al.  O-snap , 2013, ACM Trans. Graph..

[99]  Hans-Peter Seidel,et al.  A Graph-Based Approach to Symmetry Detection , 2008, VG/PBG@SIGGRAPH.

[100]  Nassir Navab,et al.  Maximum Detector Response Markers for SIFT and SURF , 2009, VMV.

[101]  Radim Sára,et al.  A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images , 2010, ACCV.

[102]  Frank Dellaert,et al.  Line-Based Structure from Motion for Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[103]  Ioannis Stamos,et al.  Integration of range and image sensing for photo-realistic 3D modeling , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[104]  Dinh Van Huynh,et al.  Algebra and Its Applications , 2006 .

[105]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[106]  Jean-Philippe Pons,et al.  Hierarchical shape-based surface reconstruction for dense multi-view stereo , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[107]  Yanxi Liu,et al.  A computational model for periodic pattern perception based on frieze and wallpaper groups , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[109]  Yong-Liang Yang,et al.  Interactive Facades Analysis and Synthesis of Semi‐Regular Facades , 2013, Comput. Graph. Forum.

[110]  Iasonas Kokkinos,et al.  Shape grammar parsing via Reinforcement Learning , 2011, CVPR 2011.

[111]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[112]  Nora Ripperda EXTRACTION OF FAÇADES USING RJMCMC AND CONSTRAINT EQUATIONS , 2006 .

[113]  Philip H. S. Torr,et al.  Building Models of Regular Scenes from Structure and Motion , 2006, BMVC.

[114]  Lu Wang,et al.  Semiautomatic registration between ground-level panoramas and an orthorectified aerial image for building modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[115]  Lei Yang,et al.  Per-pixel translational symmetry detection, optimization, and segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[116]  Fuan Tsai,et al.  Texture Generation and Mapping Using Video Sequences for 3D Building Models , 2006, 3D-GIS.

[117]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[118]  Lucas Paletta,et al.  Window Detection in Facades , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[119]  Werner Purgathofer,et al.  Symmetry-Based Façade Repair , 2009, VMV.

[120]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[121]  Nikos Paragios,et al.  Large-Scale Building Reconstruction Through Information Fusion and 3-D Priors , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[122]  D. Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Trans. Graph..

[123]  Suya You,et al.  3D Reconstruction of Urban Areas , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[124]  Maarten Vergauwen,et al.  Web-based 3D Reconstruction Service , 2006, Machine Vision and Applications.

[125]  Richard Szeliski,et al.  Reconstructing Rome , 2010, Computer.

[126]  Qian-Yi Zhou,et al.  Fast and extensible building modeling from airborne LiDAR data , 2008, GIS '08.

[127]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[128]  Hans-Peter Seidel,et al.  Learning Line Features in 3D Geometry , 2011, Comput. Graph. Forum.

[129]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR 2011.

[130]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[131]  Frank Dellaert,et al.  A Probabilistic Approach to the Semantic Interpretation of Building Facades , 2004 .

[132]  Suya You,et al.  Automatic reconstruction of cities from remote sensor data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[133]  Richard Szeliski,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH Asia '08.

[134]  Ioannis Stamos,et al.  Detection of windows in point clouds of urban scenes , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[135]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[136]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[137]  Niloy J. Mitra,et al.  Factored Facade Acquisition using Symmetric Line Arrangements , 2012, Comput. Graph. Forum.

[138]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[139]  S. H. Ong,et al.  LARGE SCALE TEXTURE MAPPING OF BUILDING FACADES , 2008 .

[140]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[141]  Florent Lafarge,et al.  Surface Reconstruction through Point Set Structuring , 2013, Comput. Graph. Forum.

[142]  Daniel G. Aliaga,et al.  Building reconstruction using manhattan-world grammars , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[143]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[144]  Ramakant Nevatia,et al.  Automatic pose estimation of complex 3D building models , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[145]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, ACM Trans. Graph..

[146]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[147]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[148]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[149]  H. Mayer,et al.  Building facade interprétation from uncalibrated wide-baseline image sequences , 2007 .

[150]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[151]  Shu-Kun Lin,et al.  Introduction to Remote Sensing. Fifth Edition.By James B. Campbell and Randolph H. Wynne, The GuilfordPress, 2011; 662 pages. Price: £80.75, ISBN 978-1-60918-176-5 , 2013, Remote. Sens..

[152]  Andrei Sharf,et al.  Grammar-based 3D facade segmentation and reconstruction , 2012, Comput. Graph..

[153]  Alexei A. Efros,et al.  Discovering Texture Regularity as a Higher-Order Correspondence Problem , 2006, ECCV.

[154]  Ramakant Nevatia,et al.  Integrating ground and aerial views for urban site modeling , 2002, Object recognition supported by user interaction for service robots.

[155]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[156]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[157]  Jan-Michael Frahm,et al.  Detecting Large Repetitive Structures with Salient Boundaries , 2010, ECCV.

[158]  Jana Kosecka,et al.  Creating compact architectural models by geo-registering image collections , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[159]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[160]  Ulrich Neumann,et al.  2.5D building modeling with topology control , 2011, CVPR 2011.

[161]  Allen R. Hanson,et al.  Recognition and reconstruction of buildings from multiple aerial images , 2003, Comput. Vis. Image Underst..

[162]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[163]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[164]  Christopher Rasmussen,et al.  Spatiotemporal Inpainting for Recovering Texture Maps of Occluded Building Facades , 2007, IEEE Transactions on Image Processing.

[165]  Feng Han,et al.  Bottom-Up/Top-Down Image Parsing with Attribute Grammar , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[166]  Loong Fah Cheong,et al.  Multi-view repetitive structure detection , 2011, 2011 International Conference on Computer Vision.

[167]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[168]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[169]  Jean-Philippe Pons,et al.  Robust piecewise-planar 3D reconstruction and completion from large-scale unstructured point data , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[170]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[171]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[172]  Florent Lafarge,et al.  Building large urban environments from unstructured point data , 2011, 2011 International Conference on Computer Vision.

[173]  Luc Van Gool,et al.  Automatic 3D model building from video sequences , 1997, Eur. Trans. Telecommun..

[174]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[175]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[176]  Michael Wimmer,et al.  Interactive Coherence‐Based Façade Modeling , 2012, Comput. Graph. Forum.

[177]  Ben Taskar,et al.  Detecting and parsing architecture at city scale from range data , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[178]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[179]  Ioannis Stamos,et al.  A systematic approach for 2D-image to 3D-range registration in urban environments , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[180]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[181]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[182]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[183]  Radim Sára,et al.  Windowpane Detection Based on Maximum Aposteriori Probability Labeling , 2008, IWCIA Special Track on Applications.

[184]  Helmut Mayer,et al.  BUILDING FACADE INTERPRETATION FROM IMAGE SEQUENCES , 2005 .

[185]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[186]  George Vosselman,et al.  Building Facade Reconstruction by Fusing Terrestrial Laser Points and Images , 2009, Sensors.

[187]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[188]  Hans-Peter Seidel,et al.  An efficient construction of reduced deformable objects , 2013, ACM Trans. Graph..

[189]  W. Förstner,et al.  Detection of repeated structures in facade images , 2008, Pattern Recognition and Image Analysis.

[190]  Jan Boehm,et al.  Facade detail from incomplete range data , 2008 .

[191]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[192]  Suya You,et al.  Approaches to Large-Scale Urban Modeling , 2003, IEEE Computer Graphics and Applications.

[193]  Luc Van Gool,et al.  Procedural 3D Building Reconstruction Using Shape Grammars and Detectors , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[194]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[195]  Ramakant Nevatia,et al.  Detection and Modeling of Buildings from Multiple Aerial Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[196]  Luc Van Gool,et al.  Learning Domain Knowledge for Façade Labelling , 2012, ECCV.

[197]  Werner Purgathofer,et al.  Tiling of ortho-rectified facade images , 2010, SCCG.

[198]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[199]  Luc Van Gool,et al.  Grouping via the Matching of Repeated Patterns , 2001, ICAPR.

[200]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[201]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[202]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[203]  T. H. Kolbe,et al.  OpenGIS City Geography Markup Language (CityGML) Encoding Standard, Version 1.0.0 , 2008 .

[204]  Daniel G. Aliaga,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Style Grammars for Interactive Visualization of Architecture , 2022 .

[205]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, ACM Trans. Graph..

[206]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, ACM Trans. Graph..

[207]  Jana Kosecka,et al.  Multi-view Superpixel Stereo in Urban Environments , 2010, International Journal of Computer Vision.

[208]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, ACM Trans. Graph..

[209]  Daniel G. Aliaga,et al.  Inverse Procedural Modeling by Automatic Generation of L‐systems , 2010, Comput. Graph. Forum.

[210]  Gabriele Bitelli F. Remondino, S. El-Hakim, S. Girardi, A. Rizzi, S. Benedetti, L. Gonzo: "3D Virtual reconstruction and visualization of complex architectures" , 2013 .

[211]  Hayko Riemenschneider,et al.  Irregular lattices for complex shape grammar facade parsing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[212]  Niloy J. Mitra,et al.  Intrinsic Regularity Detection in 3D Geometry , 2010, ECCV.

[213]  Shree K. Nayar,et al.  What Is a Good Nearest Neighbors Algorithm for Finding Similar Patches in Images? , 2008, ECCV.

[214]  Horst Bischof,et al.  Fusion of Feature- and Area-Based Information for Urban Buildings Modeling from Aerial Imagery , 2008, ECCV.

[215]  Marc Levoy,et al.  Interactive design of multi-perspective images for visualizing urban landscapes , 2004, IEEE Visualization 2004.

[216]  Daniel Cohen-Or,et al.  Structure-preserving retargeting of irregular 3D architecture , 2011, ACM Trans. Graph..

[217]  Long Quan,et al.  Translation symmetry detection in a fronto-parallel view , 2011, CVPR 2011.

[218]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, International Journal of Computer Vision.

[219]  Daniel G. Aliaga,et al.  Inverse design of urban procedural models , 2012, ACM Trans. Graph..

[220]  J. Hyyppä,et al.  International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol.XXXVI, Part 3 / W52 , 2007 .

[221]  George Vosselman,et al.  Refining building facade models with images , 2009 .

[222]  Sylvie Philipp-Foliguet,et al.  Windows and facades retrieval using similarity on graph of contours , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[223]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[224]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[225]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[226]  Yanxi Liu,et al.  Translation-Symmetry-Based Perceptual Grouping with Applications to Urban Scenes , 2010, ACCV.

[227]  John W. Fisher,et al.  Automatic registration of LIDAR and optical images of urban scenes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[228]  Michael Goesele,et al.  Multi-View Stereo for Community Photo Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[229]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[230]  Ioannis Stamos,et al.  3-D model construction using range and image data , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[231]  Michael Goesele,et al.  Multi-View Stereo Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[232]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[233]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[234]  Horst Bischof,et al.  Large-scale, dense city reconstruction from user-contributed photos , 2012, Comput. Vis. Image Underst..

[235]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery Using a Reference Plane , 2002, International Journal of Computer Vision.

[236]  Jianxiong Xiao,et al.  Image-based façade modeling , 2008, ACM Trans. Graph..

[237]  Jana Kosecka,et al.  Piecewise planar city 3D modeling from street view panoramic sequences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[238]  Leif Kobbelt,et al.  Interactive image completion with perspective correction , 2006, The Visual Computer.

[239]  J. Ponce,et al.  Accurate, Dense, and Robust Multi-View Stereopsis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[240]  Ulrich Neumann,et al.  2.5D building modeling by discovering global regularities , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[241]  Iasonas Kokkinos,et al.  Parsing Facades with Shape Grammars and Reinforcement Learning , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[242]  K. Schindler,et al.  Segmentation of building models from dense 3 D point-clouds , 2003 .

[243]  Roberto Cipolla,et al.  PhotoBuilder-3D models of architectural scenes from uncalibrated images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[244]  Shimin Hu,et al.  Adaptive partitioning of urban facades , 2011, ACM Trans. Graph..

[245]  Long Quan,et al.  Resampling Structure from Motion , 2010, ECCV.

[246]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[247]  Ken-ichi Anjyo Tour into the picture , 1997, SIGGRAPH '97.

[248]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[249]  Richard Szeliski,et al.  Piecewise planar stereo for image-based rendering , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[250]  Sven Havemann,et al.  Generative mesh modeling , 2005 .

[251]  Jan-Michael Frahm,et al.  Evaluation of Large Scale Scene Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[252]  Norbert Haala,et al.  An update on automatic 3D building reconstruction , 2010 .

[253]  Dieter W. Fellner,et al.  Generative Object Definition and Semantic Recognition , 2011, 3DOR@Eurographics.

[254]  R. Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[255]  Jean Ponce,et al.  Carved Visual Hulls for Image-Based Modeling , 2006, International Journal of Computer Vision.

[256]  Christopher Rasmussen,et al.  2D Lattice Extraction from Structured Environments , 2007, 2007 IEEE International Conference on Image Processing.

[257]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[258]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[259]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[260]  Franz Rottensteiner,et al.  ISPRS Test Project on Urban Classification and 3D Building Reconstruction: Evaluation of Object Detection Results , 2009 .

[261]  Gérard G. Medioni,et al.  Aerial 3D reconstruction with line-constrained dynamic programming , 2011, 2011 International Conference on Computer Vision.

[262]  Ioannis Stamos,et al.  Automatic registration of 2-D with 3-D imagery in urban environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[263]  S. El-Hakim,et al.  3-D RECONSTRUCTION OF COMPLEX ARCHITECTURES FROM MULTIPLE DATA , 2005 .

[264]  Ramakant Nevatia,et al.  Modeling 3-D complex buildings with user assistance , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[265]  Christian Früh,et al.  An Automated Method for Large-Scale, Ground-Based City Model Acquisition , 2004, International Journal of Computer Vision.

[266]  Daniel G. Aliaga,et al.  Automatic Modeling of Planar-Hinged Buildings , 2013, Eurographics.

[267]  Jan-Michael Frahm,et al.  Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[268]  Sven Havemann,et al.  A GML shape grammar for semantically enriched 3D building models , 2010, Comput. Graph..

[269]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[270]  Steven M. Seitz,et al.  Multiperspective Imaging , 2003, IEEE Computer Graphics and Applications.

[271]  Harry Shum,et al.  Correction to Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001, International Journal of Computer Vision.

[272]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[273]  Michael F. Cohen,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, ACM Trans. Graph..

[274]  Luc Van Gool,et al.  Efficient grouping under perspective skew , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[275]  S. El-Hakim,et al.  3 D MODELLING WITH REUSABLE AND INTEGRATED BUILDING BLOCKS , 2005 .

[276]  Luc Van Gool,et al.  A Public System for Image Based 3D Model Generation , 2011, MIRAGE.

[277]  Jieping Ye,et al.  Compressed Facade Displacement Maps , 2009, IEEE Transactions on Visualization and Computer Graphics.

[278]  Horst Bischof,et al.  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[279]  Luc Van Gool,et al.  A Three-Layered Approach to Facade Parsing , 2012, ECCV.

[280]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[281]  Yanxi Liu,et al.  Image de-fencing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[282]  Ulrich Neumann,et al.  2.5D Dual Contouring: A Robust Approach to Creating Building Models from Aerial LiDAR Point Clouds , 2010, ECCV.

[283]  Jiang Yu Zheng Digital Route Panoramas , 2003, IEEE Multim..

[284]  Wei Zhang,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[285]  Leonidas J. Guibas,et al.  Partial and approximate symmetry detection for 3D geometry , 2006, ACM Trans. Graph..

[286]  KeeChang Lee,et al.  Fast Automatic Single-View 3-d Reconstruction of Urban Scenes , 2008, ECCV.

[287]  Sisi Zlatanova,et al.  An automatic mosaicking method for building facade texture mapping using a monocular close-range image sequence , 2010 .

[288]  Sikun Li,et al.  Automatic facades segmentation using detected lines and vanishing points , 2011, 2011 4th International Congress on Image and Signal Processing.

[289]  Nora Ripperda,et al.  DATA DRIVEN RULE PROPOSAL FOR GRAMMAR BASED FACADE RECONSTRUCTION , 2007 .

[290]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[291]  D. Fritsch,et al.  COMBINED KNOWLEDGE PROPAGATION FOR FACADE RECONSTRUCTION , 2008 .

[292]  W. Förstner,et al.  SELECTING APPROPRIATE FEATURES FOR DETECTING BUILDINGS AND BUILDING PARTS , 2008 .

[293]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[294]  Maarten Vergauwen,et al.  3D Reconstruction from Multiple Images: Part 1 - Principles , 2009, Found. Trends Comput. Graph. Vis..

[295]  Suya You,et al.  Photorealistic Large-Scale Urban City Model Reconstruction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[296]  Daphna Weinshall,et al.  Mosaicing New Views: The Crossed-Slits Projection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[297]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[298]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.