A Survey of Urban Reconstruction

This paper provides a comprehensive overview of urban reconstruction. While there exists a considerable body of literature, this topic is still under active research. The work reviewed in this survey stems from the following three research communities: computer graphics, computer vision and photogrammetry and remote sensing. Our goal is to provide a survey that will help researchers to better position their own work in the context of existing solutions, and to help newcomers and practitioners in computer graphics to quickly gain an overview of this vast field. Further, we would like to bring the mentioned research communities to even more interdisciplinary work, since the reconstruction problem itself is by far not solved.

[1]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, SIGGRAPH 2009.

[2]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[3]  Michael Wimmer,et al.  O-snap , 2013, ACM Trans. Graph..

[4]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[5]  Jana Kosecka,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 2003, HLK.

[6]  Philip H. S. Torr,et al.  Building Models of Regular Scenes from Structure and Motion , 2006, BMVC.

[7]  Andrew Zisserman,et al.  Geometric Grouping of Repeated Elements within Images , 1998, BMVC.

[8]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Philip H. S. Torr,et al.  VideoTrace: rapid interactive scene modelling from video , 2007, ACM Trans. Graph..

[10]  Werner Purgathofer,et al.  Interactive Multi-View Facade Image Editing , 2010, VMV.

[11]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[12]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[13]  Feng Han,et al.  Bottom-Up/Top-Down Image Parsing with Attribute Grammar , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[15]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[16]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[17]  Loong Fah Cheong,et al.  Multi-view repetitive structure detection , 2011, 2011 International Conference on Computer Vision.

[18]  Allen R. Hanson,et al.  Recognition and reconstruction of buildings from multiple aerial images , 2003, Comput. Vis. Image Underst..

[19]  Luc Van Gool,et al.  A Public System for Image Based 3D Model Generation , 2011, MIRAGE.

[20]  Norbert Haala,et al.  An update on automatic 3D building reconstruction , 2010 .

[21]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Jan-Michael Frahm,et al.  Detecting Large Repetitive Structures with Salient Boundaries , 2010, ECCV.

[23]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[24]  Luc Van Gool,et al.  Automatic 3D model building from video sequences , 1997, Eur. Trans. Telecommun..

[25]  Shi-Min Hu,et al.  Adaptive partitioning of urban facades , 2011, SA '11.

[26]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[27]  Hans-Peter Seidel,et al.  Symmetry Detection Using Feature Lines , 2009, Comput. Graph. Forum.

[28]  S. El-Hakim,et al.  3 D MODELLING WITH REUSABLE AND INTEGRATED BUILDING BLOCKS , 2005 .

[29]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[30]  John W. Fisher,et al.  Automatic registration of LIDAR and optical images of urban scenes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[32]  Dinh Van Huynh,et al.  Algebra and Its Applications , 2006 .

[33]  Jianxiong Xiao,et al.  Image-based street-side city modeling , 2009, ACM Trans. Graph..

[34]  Fuan Tsai,et al.  Semiautomatic texture generation and transformation for cyber city building models , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[35]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.

[36]  Leif Kobbelt,et al.  Interactive image completion with perspective correction , 2006, The Visual Computer.

[37]  Suya You,et al.  Photorealistic Large-Scale Urban City Model Reconstruction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[38]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[39]  Helmut Mayer,et al.  MCMC LINKED WITH IMPLICIT SHAPE MODELS AND PLANE SWEEPING FOR 3D BUILDING FACADE INTERPRETATION IN IMAGE SEQUENCES , 2006 .

[40]  Luc Van Gool,et al.  Efficient grouping under perspective skew , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  Leonidas J. Guibas,et al.  Partial and approximate symmetry detection for 3D geometry , 2006, ACM Trans. Graph..

[42]  Ben Taskar,et al.  Detecting and parsing architecture at city scale from range data , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Roberto Cipolla,et al.  3D models of architectural scenes from uncalibrated images and vanishing points , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[44]  Chao Yang,et al.  Parsing façade with rank-one approximation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[46]  Ulrich Neumann,et al.  A streaming framework for seamless building reconstruction from large-scale aerial LiDAR data , 2009, CVPR.

[47]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[48]  Radim Sára,et al.  A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images , 2010, ACCV.

[49]  Helmut Mayer,et al.  IMPLICIT SHAPE MODELS, MODEL SELECTION, AND PLANE SWEEPING FOR 3D FACADE INTERPRETATION , 2007 .

[50]  Ramakant Nevatia,et al.  Modeling 3-D complex buildings with user assistance , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[52]  S. El-Hakim,et al.  3-D RECONSTRUCTION OF COMPLEX ARCHITECTURES FROM MULTIPLE DATA , 2005 .

[53]  Gérard G. Medioni,et al.  Aerial 3D reconstruction with line-constrained dynamic programming , 2011, 2011 International Conference on Computer Vision.

[54]  Charalampos Georgiadis,et al.  IMAGE ORIENTATION FOR INTERACTIVE TOURS OF VIRTUALLY-MODELED SITES , 2005 .

[55]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Ioannis Stamos,et al.  A systematic approach for 2D-image to 3D-range registration in urban environments , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[57]  S. Teller,et al.  RECOVERING FACADE TEXTURE AND MICROSTRUCTURE FROM REAL-WORLD IMAGES , 2002 .

[58]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[59]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[60]  T. H. Kolbe,et al.  OpenGIS City Geography Markup Language (CityGML) Encoding Standard, Version 1.0.0 , 2008 .

[61]  Philip H. S. Torr,et al.  A shape hierarchy for 3D modelling from video , 2007, GRAPHITE '07.

[62]  ZhuSong-Chun,et al.  Bottom-Up/Top-Down Image Parsing with Attribute Grammar , 2009 .

[63]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[64]  M. Brunner,et al.  Opportunities, Requirements and Challenges for Storing Network Management Information in a Decentralized Way , 2008, 2008 IEEE Globecom Workshops.

[65]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[66]  Christopher Rasmussen,et al.  2D Lattice Extraction from Structured Environments , 2007, 2007 IEEE International Conference on Image Processing.

[67]  Ulrich Neumann,et al.  A streaming framework for seamless building reconstruction from large-scale aerial LiDAR data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[68]  Ramakant Nevatia,et al.  Detection and Modeling of Buildings from Multiple Aerial Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[70]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[71]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[72]  Richard Szeliski,et al.  Reconstructing Rome , 2010, Computer.

[73]  Radomír Mech,et al.  Guided Procedural Modeling , 2011, Comput. Graph. Forum.

[74]  Luc Van Gool,et al.  Learning Domain Knowledge for Façade Labelling , 2012, ECCV.

[75]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[76]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[77]  Shimin Hu,et al.  Adaptive Partitioning of Urban Facades , 2011 .

[78]  Helmut Mayer,et al.  BUILDING FACADE INTERPRETATION FROM IMAGE SEQUENCES , 2005 .

[79]  Nora Ripperda EXTRACTION OF FAÇADES USING RJMCMC AND CONSTRAINT EQUATIONS , 2006 .

[80]  Maarten Vergauwen,et al.  3D Reconstruction from Multiple Images: Part 1 - Principles , 2009, Found. Trends Comput. Graph. Vis..

[81]  Luc Van Gool,et al.  Procedural 3D Building Reconstruction Using Shape Grammars and Detectors , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[82]  Qinping Zhao,et al.  Rectilinear parsing of architecture in urban environment , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[83]  Qian-Yi Zhou,et al.  Fast and extensible building modeling from airborne LiDAR data , 2008, GIS '08.

[84]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[85]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[86]  Yong-Liang Yang,et al.  Interactive Facades Analysis and Synthesis of Semi‐Regular Facades , 2013, Comput. Graph. Forum.

[87]  Zhonghua Liu,et al.  Face Recognition Based on Wavelet Transform, Singular Value Decomposition and Kernel Principal Component Analysis , 2008, 2008 Chinese Conference on Pattern Recognition.

[88]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[89]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[90]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[91]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[92]  Fuan Tsai,et al.  Texture Generation and Mapping Using Video Sequences for 3D Building Models , 2006, 3D-GIS.

[93]  Steven M. Seitz,et al.  Multiperspective Imaging , 2003, IEEE Computer Graphics and Applications.

[94]  Feng Han,et al.  Bottom-up/top-down image parsing by attribute graph grammar , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[95]  Ulrich Neumann,et al.  2.5D Dual Contouring: A Robust Approach to Creating Building Models from Aerial LiDAR Point Clouds , 2010, ECCV.

[96]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[97]  Niloy J. Mitra,et al.  Factored Facade Acquisition using Symmetric Line Arrangements , 2012, Comput. Graph. Forum.

[98]  Sylvie Philipp-Foliguet,et al.  Windows and facades retrieval using similarity on graph of contours , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[99]  Claus Brenner,et al.  Application of a Formal Grammar to Facade Reconstruction in Semiautomatic and Automatic Environments , 2009 .

[100]  Jieping Ye,et al.  Compressed Facade Displacement Maps , 2009, IEEE Transactions on Visualization and Computer Graphics.

[101]  Suya You,et al.  Approaches to Large-Scale Urban Modeling , 2003, IEEE Computer Graphics and Applications.

[102]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[103]  Horst Bischof,et al.  Fusion of Feature- and Area-Based Information for Urban Buildings Modeling from Aerial Imagery , 2008, ECCV.

[104]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[105]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[106]  Horst Bischof,et al.  Towards Wiki-based Dense City Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[107]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  Iasonas Kokkinos,et al.  Parsing Facades with Shape Grammars and Reinforcement Learning , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[109]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[110]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[111]  Yanxi Liu,et al.  A computational model for periodic pattern perception based on frieze and wallpaper groups , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[112]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[113]  Thomas B. Moeslund,et al.  3D Reconstruction of Buildings with Automatic Facade Refinement , 2011, ISVC.

[114]  Horst Bischof,et al.  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[115]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[116]  Susanne Becker,et al.  Generation and application of rules for quality dependent façade reconstruction , 2009 .

[117]  Wei Zhang,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 1989, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[118]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[119]  Daniel G. Aliaga,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Style Grammars for Interactive Visualization of Architecture , 2022 .

[120]  Daniel Cohen-Or,et al.  Structure-preserving retargeting of irregular 3D architecture , 2011, ACM Trans. Graph..

[121]  Markus Gerke,et al.  The ISPRS benchmark on urban object classification and 3D building reconstruction , 2012 .

[122]  Georgios Tziritas,et al.  Single view reconstruction using shape grammars for urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[123]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery Using a Reference Plane , 2002, International Journal of Computer Vision.

[124]  Allen R. Hanson,et al.  Surface Texture and Microstructure Extraction from Multiple Aerial Images , 2001, Comput. Vis. Image Underst..

[125]  Jan-Michael Frahm,et al.  Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[126]  Richard Szeliski,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH Asia '08.

[127]  Daniel G. Aliaga,et al.  Automatic Extraction of Manhattan-World Building Masses from 3D Laser Range Scans , 2012, IEEE Transactions on Visualization and Computer Graphics.

[128]  Jan Boehm Multi-image fusion for occlusion-free faÇade texturing , 2004 .

[129]  Shree K. Nayar,et al.  What Is a Good Nearest Neighbors Algorithm for Finding Similar Patches in Images? , 2008, ECCV.

[130]  Radim Sára,et al.  Windowpane Detection Based on Maximum Aposteriori Probability Labeling , 2008, IWCIA Special Track on Applications.

[131]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[132]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[133]  W. Förstner,et al.  Detection of repeated structures in facade images , 2008, Pattern Recognition and Image Analysis.

[134]  Ramakant Nevatia,et al.  Interactive 3D building modeling using a hierarchical representation , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[135]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[136]  Florent Lafarge,et al.  Surface Reconstruction through Point Set Structuring , 2013, Comput. Graph. Forum.

[137]  Sylvain Lefebvre,et al.  Texture Synthesis From Photographs , 2008, Comput. Graph. Forum.

[138]  Philip H. S. Torr,et al.  Interactive 3D Model Completion , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[139]  Sven Havemann,et al.  Generative mesh modeling , 2005 .

[140]  Hans-Peter Seidel,et al.  A Graph-Based Approach to Symmetry Detection , 2008, VG/PBG@SIGGRAPH.

[141]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[142]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[143]  Suya You,et al.  Automatic Creation of Massive Virtual Cities , 2009, 2009 IEEE Virtual Reality Conference.

[144]  Horst Bischof,et al.  Large-scale, dense city reconstruction from user-contributed photos , 2012, Comput. Vis. Image Underst..

[145]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[146]  Ioannis Stamos,et al.  Automatic registration of 2-D with 3-D imagery in urban environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[147]  Jan Mayer,et al.  A numerical evaluation of preprocessing and ILU-type preconditioners for the solution of unsymmetric sparse linear systems using iterative methods , 2009, TOMS.

[148]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[149]  Nikos Paragios,et al.  Large-Scale Building Reconstruction Through Information Fusion and 3-D Priors , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[150]  Seth J. Teller,et al.  Extracting textured vertical facades from controlled close-range imagery , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[151]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[152]  Nora Ripperda,et al.  DATA DRIVEN RULE PROPOSAL FOR GRAMMAR BASED FACADE RECONSTRUCTION , 2007 .

[153]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, CVPR 2004.

[154]  Jana Ko,et al.  Piecewise Planar City 3D Modeling from Street View Panoramic Sequences , 2009 .

[155]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[156]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[157]  Long Quan,et al.  Translation symmetry detection in a fronto-parallel view , 2011, CVPR 2011.

[158]  Christian Früh,et al.  An Automated Method for Large-Scale, Ground-Based City Model Acquisition , 2004, International Journal of Computer Vision.

[159]  N. Mitra,et al.  Non-local scan consolidation for 3D urban scenes , 2010, ACM Trans. Graph..

[160]  Hayko Riemenschneider,et al.  Irregular lattices for complex shape grammar facade parsing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[161]  Roberto Cipolla,et al.  Automatic 3D Modelling of Architecture , 2000, BMVC.

[162]  Daphna Weinshall,et al.  Mosaicing New Views: The Crossed-Slits Projection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[163]  Jan Boehm,et al.  Facade detail from incomplete range data , 2008 .

[164]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[165]  Jean-Philippe Pons,et al.  Hierarchical shape-based surface reconstruction for dense multi-view stereo , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[166]  Jiang Yu Zheng Digital Route Panoramas , 2003, IEEE Multim..

[167]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[168]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[169]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, International Journal of Computer Vision.

[170]  Ramakant Nevatia,et al.  Automatic Integration of Facade Textures into 3D Building Models with a Projective Geometry Based Line Clustering , 2002, Comput. Graph. Forum.

[171]  Christopher Rasmussen,et al.  Spatiotemporal Inpainting for Recovering Texture Maps of Occluded Building Facades , 2007, IEEE Transactions on Image Processing.

[172]  Ramakant Nevatia,et al.  Integrating ground and aerial views for urban site modeling , 2002, Object recognition supported by user interaction for service robots.

[173]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[174]  Florent Lafarge,et al.  A Hybrid Multiview Stereo Algorithm for Modeling Urban Scenes , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[175]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[176]  H. Seidel,et al.  Pattern-aware Deformation Using Sliding Dockers , 2011, SIGGRAPH 2011.

[177]  Richard Szeliski,et al.  Finding paths through the world's photos , 2008, ACM Trans. Graph..

[178]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[179]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[180]  Norbert Haala,et al.  GRAMMAR SUPPORTED FACADE RECONSTRUCTION FROM MOBILE LIDAR MAPPING , 2009 .

[181]  Lei Yang,et al.  Per-pixel translational symmetry detection, optimization, and segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[182]  Lorenzo Gonzo,et al.  MODELLING WITH REUSABLE AND INTEGRATED BUILDING BLOCKS , 2005 .

[183]  Iasonas Kokkinos,et al.  Shape grammar parsing via Reinforcement Learning , 2011, CVPR 2011.

[184]  Luc Van Gool,et al.  Towards mass-produced building models , 2007 .

[185]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[186]  Frank Dellaert,et al.  Line-Based Structure from Motion for Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[187]  Long Quan,et al.  Resampling Structure from Motion , 2010, ECCV.

[188]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[189]  Hans-Peter Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, ACM Trans. Graph..

[190]  Ken-ichi Anjyo Tour into the picture , 1997, SIGGRAPH '97.

[191]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[192]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[193]  H. Mayer,et al.  Building facade interprétation from uncalibrated wide-baseline image sequences , 2007 .

[194]  Ioannis Stamos,et al.  Integration of range and image sensing for photo-realistic 3D modeling , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[195]  Sven Havemann,et al.  A GML shape grammar for semantically enriched 3D building models , 2010, Comput. Graph..

[196]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[197]  J. Hyyppä,et al.  International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol.XXXVI, Part 3 / W52 , 2007 .

[198]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[199]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[200]  S. Teller Automated urban model acquisition : Project rationale and status , 1999 .

[201]  Werner Purgathofer,et al.  Tiling of ortho-rectified facade images , 2010, SCCG.

[202]  Suya You,et al.  Automatic reconstruction of cities from remote sensor data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[203]  Florent Lafarge,et al.  Building large urban environments from unstructured point data , 2011, 2011 International Conference on Computer Vision.

[204]  Dieter W. Fellner,et al.  Generative Object Definition and Semantic Recognition , 2011, 3DOR@Eurographics.

[205]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, ACM Trans. Graph..

[206]  Michael Goesele,et al.  Multi-View Stereo Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[207]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[208]  Hans-Peter Seidel,et al.  Learning Line Features in 3D Geometry , 2011, Comput. Graph. Forum.

[209]  Daniel G. Aliaga,et al.  Modelling the Appearance and Behaviour of Urban Spaces , 2010, Comput. Graph. Forum.

[210]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[211]  Niloy J. Mitra,et al.  Variation-Factored Encoding of Facade Images , 2012, Eurographics.

[212]  Niloy J. Mitra,et al.  Non-local scan consolidation for 3D urban scenes , 2010, SIGGRAPH 2010.

[213]  Werner Purgathofer,et al.  Symmetry-Based Façade Repair , 2009, VMV.

[214]  Michael Wimmer,et al.  Interactive Coherence‐Based Façade Modeling , 2012, Comput. Graph. Forum.

[215]  S. H. Ong,et al.  LARGE SCALE TEXTURE MAPPING OF BUILDING FACADES , 2008 .

[216]  Ulrich Neumann,et al.  2.5D building modeling by discovering global regularities , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[217]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[218]  F. Tsai,et al.  Polygon‐based texture mapping for cyber city 3D building models , 2007, Int. J. Geogr. Inf. Sci..

[219]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[220]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR 2011.

[221]  Harry Shum,et al.  Correction to Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001, International Journal of Computer Vision.

[222]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, ECCV.

[223]  Michael Goesele,et al.  Multi-View Stereo for Community Photo Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[224]  Harry Shum,et al.  Digital papercutting , 2005, SIGGRAPH '05.

[225]  Nassir Navab,et al.  Maximum Detector Response Markers for SIFT and SURF , 2009, VMV.

[226]  Jean Ponce,et al.  Carved Visual Hulls for Image-Based Modeling , 2006, International Journal of Computer Vision.

[227]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..

[228]  Jan-Michael Frahm,et al.  Piecewise planar and non-planar stereo for urban scene reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[229]  T. Funkhouser,et al.  A planar-reflective symmetry transform for 3D shapes , 2006, SIGGRAPH '06.

[230]  Daniel G. Aliaga,et al.  Automatic Modeling of Planar-Hinged Buildings , 2013, Eurographics.

[231]  Niloy J. Mitra,et al.  Intrinsic Regularity Detection in 3D Geometry , 2010, ECCV.

[232]  Andrei Sharf,et al.  Grammar-based 3D facade segmentation and reconstruction , 2012, Comput. Graph..

[233]  Frank Dellaert,et al.  A Probabilistic Approach to the Semantic Interpretation of Building Facades , 2004 .

[234]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[235]  Ramakant Nevatia,et al.  Automatic pose estimation of complex 3D building models , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[236]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[237]  W. Förstner,et al.  SELECTING APPROPRIATE FEATURES FOR DETECTING BUILDINGS AND BUILDING PARTS , 2008 .

[238]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[239]  Hans-Peter Seidel,et al.  An efficient construction of reduced deformable objects , 2013, ACM Trans. Graph..

[240]  Loong Fah Cheong,et al.  Symmetric architecture modeling with a single image , 2009, ACM Trans. Graph..

[241]  Jana Kosecka,et al.  Multi-view Superpixel Stereo in Urban Environments , 2010, International Journal of Computer Vision.

[242]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[243]  Bernhard Hohmann,et al.  Cityfit - High-Quality Urban Reconstruction by Fitting Shape Grammars to Image and derived Textured Point Clouds , 2008 .

[244]  KeeChang Lee,et al.  Fast Automatic Single-View 3-d Reconstruction of Urban Scenes , 2008, ECCV.

[245]  D. Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Trans. Graph..

[246]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[247]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[248]  Roberto Cipolla,et al.  PhotoBuilder-3D models of architectural scenes from uncalibrated images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[249]  George Vosselman,et al.  Building Facade Reconstruction by Fusing Terrestrial Laser Points and Images , 2009, Sensors.

[250]  Marc Pollefeys,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH 2008.

[251]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[252]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[253]  Nora Ripperda DETERMINATION OF FACADE ATTRIBUTES FOR FACADE RECONSTRUCTION , 2007 .

[254]  Luc Van Gool,et al.  A Three-Layered Approach to Facade Parsing , 2012, ECCV.

[255]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[256]  Jean-Philippe Pons,et al.  Robust piecewise-planar 3D reconstruction and completion from large-scale unstructured point data , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[257]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[258]  Sikun Li,et al.  Automatic facades segmentation using detected lines and vanishing points , 2011, 2011 4th International Congress on Image and Signal Processing.

[259]  Lu Wang,et al.  Semiautomatic registration between ground-level panoramas and an orthorectified aerial image for building modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[260]  Suya You,et al.  3D Reconstruction of Urban Areas , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[261]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[262]  Jianxiong Xiao,et al.  Image-based façade modeling , 2008, ACM Trans. Graph..

[263]  Daniel G. Aliaga,et al.  Inverse Procedural Modeling by Automatic Generation of L‐systems , 2010, Comput. Graph. Forum.

[264]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[265]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, ACM Trans. Graph..

[266]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[267]  Ioannis Stamos,et al.  3-D model construction using range and image data , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[268]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[269]  Luc Van Gool,et al.  Parameter-free/Pareto-driven procedural 3D reconstruction of buildings from ground-level sequences , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[270]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, ACM Trans. Graph..

[271]  Ramakant Nevatia,et al.  Automatic and interactive modeling of buildings in urban environments from aerial images , 2002, Proceedings. International Conference on Image Processing.

[272]  Hans-Peter Seidel,et al.  Shape Analysis with Subspace Symmetries , 2011, Comput. Graph. Forum.

[273]  Luc Van Gool,et al.  Grouping via the Matching of Repeated Patterns , 2001, ICAPR.

[274]  Michael Goesele,et al.  Scene Reconstruction and Visualization From Community Photo Collections , 2010, Proceedings of the IEEE.

[275]  Shu-Kun Lin,et al.  Introduction to Remote Sensing. Fifth Edition.By James B. Campbell and Randolph H. Wynne, The GuilfordPress, 2011; 662 pages. Price: £80.75, ISBN 978-1-60918-176-5 , 2013, Remote. Sens..

[276]  Daniel G. Aliaga,et al.  Building reconstruction using manhattan-world grammars , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[277]  Marc Levoy,et al.  Interactive design of multi-perspective images for visualizing urban landscapes , 2004, IEEE Visualization 2004.

[278]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[279]  K. Schindler,et al.  Segmentation of building models from dense 3 D point-clouds , 2003 .

[280]  Jan-Michael Frahm,et al.  3D Reconstruction Using an n-Layer Heightmap , 2010, DAGM-Symposium.

[281]  Yanxi Liu,et al.  Image de-fencing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[282]  Swarup Medasani,et al.  Strip Histogram Grid for efficient LIDAR segmentation from urban environments , 2011, CVPR 2011 WORKSHOPS.

[283]  J. Campbell Introduction to remote sensing , 1987 .

[284]  Jana Kosecka,et al.  Creating compact architectural models by geo-registering image collections , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[285]  Christian Früh,et al.  Constructing 3D City Models by Merging Aerial and Ground Views , 2003, IEEE Computer Graphics and Applications.

[286]  Sisi Zlatanova,et al.  An automatic mosaicking method for building facade texture mapping using a monocular close-range image sequence , 2010 .

[287]  Jan-Michael Frahm,et al.  Evaluation of Large Scale Scene Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[288]  Jana Kosecka,et al.  Piecewise planar city 3D modeling from street view panoramic sequences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[289]  Lucas Paletta,et al.  Window Detection in Facades , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[290]  Ulrich Neumann,et al.  2.5D building modeling with topology control , 2011, CVPR 2011.

[291]  Ioannis Stamos,et al.  Detection of windows in point clouds of urban scenes , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[292]  Jie Chen,et al.  Architectural Modeling from Sparsely Scanned Range Data , 2008, International Journal of Computer Vision.

[293]  Horst Bischof,et al.  Efficient Sparse 3D Reconstruction by Space Sweeping , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[294]  Alexei A. Efros,et al.  Discovering Texture Regularity as a Higher-Order Correspondence Problem , 2006, ECCV.

[295]  George Vosselman,et al.  Refining building facade models with images , 2009 .

[296]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[297]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[298]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[299]  Maarten Vergauwen,et al.  Web-based 3D Reconstruction Service , 2006, Machine Vision and Applications.

[300]  Daniel G. Aliaga,et al.  Inverse design of urban procedural models , 2012, ACM Trans. Graph..

[301]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[302]  Franz Rottensteiner,et al.  ISPRS Test Project on Urban Classification and 3D Building Reconstruction: Evaluation of Object Detection Results , 2009 .

[303]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[304]  Yanxi Liu,et al.  Translation-Symmetry-Based Perceptual Grouping with Applications to Urban Scenes , 2010, ACCV.

[305]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[306]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[307]  Nancy S. Pollard,et al.  Real-time gradient-domain painting , 2008, ACM Trans. Graph..

[308]  Luc Van Gool,et al.  3D Urban Scene Modeling Integrating Recognition and Reconstruction , 2008, International Journal of Computer Vision.

[309]  Richard Szeliski,et al.  Piecewise planar stereo for image-based rendering , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[310]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.