Online Detection of Repeated Structures in Point Clouds of Urban Scenes for Compression and Registration

Laser range scans of urban areas have a distinctive geometry dominated by facade and ground planes and repetitive regular fenestration. Detection of these ubiquitous features provides profound insights into the scene. We present a novel method for detecting major planes and repetitive architectural features. Armed with this knowledge we illustrate its application in compression and registration of range scans. What is more our algorithm operates online, processing the scan as it is retrieved by the scanner. This realtime approach opens up new possibilities in range data segmentation, compression and registration.

[1]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, SIGGRAPH 2008.

[2]  Du Q. Huynh,et al.  Metrics for 3D Rotations: Comparison and Analysis , 2009, Journal of Mathematical Imaging and Vision.

[3]  Hans-Peter Seidel,et al.  Symmetry Detection Using Line Features , 2009 .

[4]  O.R.P. Bellon,et al.  New improvements to range image segmentation by edge detection , 2002, IEEE Signal Processing Letters.

[5]  Real Time Detection of Repeated Structures in Point Clouds of Urban Scenes , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[6]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[7]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[8]  Yanxi Liu,et al.  Deformed Lattice Detection in Real-World Images Using Mean-Shift Belief Propagation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Bruce G. Batchelor,et al.  Edge-Region-Based Segmentation of Range Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Michael Werman,et al.  The Quadratic-Chi Histogram Distance Family , 2010, ECCV.

[11]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[12]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[13]  Wolfram Burgard,et al.  Robust 3D scan point classification using associative Markov networks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Thomas B. Moeslund,et al.  Long-Term Occupancy Analysis Using Graph-Based Optimisation in Thermal Imagery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Marc Pouget,et al.  Estimating differential quantities using polynomial fitting of osculating jets , 2003, Comput. Aided Geom. Des..

[16]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[17]  Ioannis Stamos,et al.  Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes , 2008, International Journal of Computer Vision.

[18]  M. Pietikäinen,et al.  Range Image Segmentation Based on Decomposition of Surface Normals , 2004 .

[19]  François X. Sillion,et al.  Accurate detection of symmetries in 3D shapes , 2006, TOGS.

[20]  Jitendra Malik,et al.  Extracting Objects from Range and Radiance Images , 2001, IEEE Trans. Vis. Comput. Graph..

[21]  H. Mayer,et al.  Building facade interprétation from uncalibrated wide-baseline image sequences , 2007 .

[22]  Daniel Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Transactions on Graphics.

[23]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[24]  Ioannis Stamos,et al.  3D Modeling Using Planar Segments and Mesh Elements , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[25]  Ioannis Stamos,et al.  Range Image Segmentation for Modeling and Object Detection in Urban Scenes , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[26]  Jan-Michael Frahm,et al.  Detecting Large Repetitive Structures with Salient Boundaries , 2010, ECCV.

[27]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[28]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Shi-Min Hu,et al.  Adaptive partitioning of urban facades , 2011, SA '11.

[30]  Ioannis Stamos,et al.  New Methods for Digital Modeling of Historic Sites , 2003, IEEE Computer Graphics and Applications.

[31]  Hans-Peter Seidel,et al.  Symmetry Detection Using Feature Lines , 2009, Comput. Graph. Forum.

[32]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Hans-Peter Seidel,et al.  A Graph-Based Approach to Symmetry Detection , 2008, VG/PBG@SIGGRAPH.

[34]  George Stiny,et al.  Spatial Relations and Grammars , 1982 .

[35]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[36]  Ralph R. Martin,et al.  Robust Segmentation of Primitives from Range Data in the Presence of Geometric Degeneracy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Daniel Cohen-Or,et al.  2D-3D fusion for layer decomposition of urban facades , 2011, 2011 International Conference on Computer Vision.

[38]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Iasonas Kokkinos,et al.  Shape grammar parsing via Reinforcement Learning , 2011, CVPR 2011.

[40]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[41]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[42]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[43]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[44]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[45]  Svenska Sällskapet för Automatiserad Bildanalys.  Proceedings of the ... Scandinavian Conference on Image Analysis , 1980 .

[46]  Ryosuke Shibasaki,et al.  Reconstructing a textured CAD model of an urban environment using vehicle-borne laser range scanners and line cameras , 2003, Machine Vision and Applications.

[47]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..