A Method for Detecting Windows from Mobile Lidar Data

This article describes how mobile lidar (light detection and ranging) data collection is a rapidly emerging technology where multiple georeferenced sensors (e.g., laser scanners, cameras) are mounted on a moving vehicle to collect real world data. The photorealistic modeling of large-scale real world scenes such as urban environments has become increasingly interesting to the vision, graphics, and photogrammetry communities. The article presents an automatic approach to window and facade detection from mobile lidar data. The proposed method combines bottom-up with top-down strategies to extract facade planes from noise lidar point clouds. The window detection is achieved through a two-step approach: potential window point detection and window localization. The facade pattern is automatically inferred to enhance the robustness of the window detection. The application potential presented in this article includes the generation of building facade models with street-level details and texture synthesis for producing realistic occlusion-free facade texture.

[1]  Richard Szeliski,et al.  Piecewise planar stereo for image-based rendering , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Ulrich Neumann,et al.  A streaming framework for seamless building reconstruction from large-scale aerial LiDAR data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Suya You,et al.  Automatic reconstruction of cities from remote sensor data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[5]  Le Wang,et al.  MORPHOLOGY-BASED BUILDING DETECTION FROM AIRBORNE LIDAR DATA , 2009 .

[6]  R. Brunelli.  Template Matching Techniques in Computer Vision , 2009 .

[7]  Sagi Filin,et al.  Reconstruction of Complex Shape Buildings from Lidar Data Using Free Form Surfaces , 2009 .

[8]  Qian-Yi Zhou,et al.  Fast and extensible building modeling from airborne LiDAR data , 2008, GIS '08.

[9]  G. Sohn,et al.  Using a Binary Space Partitioning Tree for Reconstructing Polyhedral Building Models from Airborne Lidar Data , 2008 .

[10]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[11]  Dima Damen,et al.  Detecting Carried Objects in Short Video Sequences , 2008, ECCV.

[12]  Gerhard Paar,et al.  Robust Window Detection from 3D Laser Scanner Data , 2008, 2008 Congress on Image and Signal Processing.

[13]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[14]  Lucas Paletta,et al.  Window Detection in Facades , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[15]  Ioannis Stamos,et al.  Range Image Segmentation for Modeling and Object Detection in Urban Scenes , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[16]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, ACM Trans. Graph..

[17]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[18]  Lukas Zebedin,et al.  Towards 3D map generation from digital aerial images , 2006 .

[19]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Ruijin Ma.  DEM Generation and Building Detection from Lidar Data , 2005 .

[21]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[22]  R. Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[23]  Carlo Tomasi,et al.  Image Similarity Using Mutual Information of Regions , 2004, ECCV.

[24]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[25]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..

[26]  O.R.P. Bellon,et al.  New improvements to range image segmentation by edge detection , 2002, IEEE Signal Processing Letters.

[27]  Alan L. Yuille,et al.  Manhattan World: compass direction from a single image by Bayesian inference , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Ioannis Stamos,et al.  3-D modeling from range imagery: an incremental method with a planning component , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[29]  Horst Bunke,et al.  Fast range image segmentation using high-level segmentation primitives , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[30]  B. Curless,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[31]  C. J. Taylor,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[32]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1995, Proceedings of IEEE International Conference on Computer Vision.

[34]  W. Stuetzle,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[35]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[37]  Norbert Haala,et al.  GRAMMAR SUPPORTED FACADE RECONSTRUCTION FROM MOBILE LIDAR MAPPING , 2009 .

[38]  Bernhard Hohmann,et al.  Cityfit - High-Quality Urban Reconstruction by Fitting Shape Grammars to Image and derived Textured Point Clouds , 2008 .

[39]  George Vosselman,et al.  EXTRACTING WINDOWS FROM TERRESTRIAL LASER SCANNING , 2007 .

[40]  Luc Van Gool,et al.  Towards mass-produced building models , 2007 .

[41]  Christian Heipke,et al.  EVALUATION OF AUTOMATIC ROAD EXTRACTION , 2007 .

[42]  N. Haala,et al.  CELL DECOMPOSITION FOR THE GENERATION OF BUILDING MODELS AT MULTIPLE SCALES , 2006 .

[43]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[44]  H. Mayer,et al.  BUILDING FACADE INTERPRETATION FROM IMAGE SEQUENCES , 2005 .

[45]  S. Filin.  SURFACE CLUSTERING FROM AIRBORNE LASER SCANNING DATA , 2002 .

[46]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[47]  Le Wang,et al.  Isprs Journal of Photogrammetry and Remote Sensing a Multi-directional Ground Filtering Algorithm for Airborne Lidar , 2022 .