Processing and interactive editing of huge point clouds from 3D scanners

This paper describes a new out-of-core multi-resolution data structure for real-time visualization, interactive editing and externally efficient processing of large point clouds. We describe an editing system that makes use of the novel data structure to provide interactive editing and preprocessing tools for large scanner data sets. Using the new data structure, we provide a complete tool chain for 3D scanner data processing, from data preprocessing and filtering to manual touch-up and real-time visualization. In particular, we describe an out-of-core outlier removal and bilateral geometry filtering algorithm, a toolset for interactive selection, painting, transformation, and filtering of huge out-of-core point-cloud data sets and a real-time rendering algorithm, which all use the same data structure as storage backend. The interactive tools work in real-time for small model modifications. For large scale editing operations, we employ a two-resolution approach where editing is planned in real-time and executed in an externally efficient offline computation afterwards. We evaluate our implementation on example data sets of sizes up to 63GB, demonstrating that the proposed technique can be used effectively in real-world applications.

[1]  Michael Garland,et al.  Efficient adaptive simplification of massive meshes , 2001, Proceedings Visualization, 2001. VIS '01..

[2]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[3]  Tim Weyrich,et al.  Post-processing of Scanned 3D Surface Data , 2004, PBG.

[4]  Michael Garland,et al.  Interactive Multiresolution Editing and Display of Large Terrains , 2006, Comput. Graph. Forum.

[5]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[6]  Renato Pajarola,et al.  Stream-processing points , 2005, VIS 05. IEEE Visualization, 2005..

[7]  Frédo Durand,et al.  Normal improvement for point rendering , 2004, IEEE Computer Graphics and Applications.

[8]  Matthew Brand,et al.  Charting a Manifold , 2002, NIPS.

[9]  Paolo Cignoni,et al.  Adaptive TetraPuzzles - Efficient Out-of-core Construction and Visualization of Gigantic Polygonal Models , 2004 .

[10]  Tamy Boubekeur,et al.  Interactive Out-Of-Core Texturing with Point-Sampled Textures , 2006, PBG@SIGGRAPH.

[11]  Ming Jiang,et al.  A Surface Reconstruction Method for Highly Noisy Point Clouds , 2005, VLSM.

[12]  Peter Lindstrom,et al.  Out-of-core construction and visualization of multiresolution surfaces , 2003, I3D '03.

[13]  Frédo Durand,et al.  Non-iterative, feature-preserving mesh smoothing , 2003, ACM Trans. Graph..

[14]  Matthias Zwicker,et al.  Pointshop 3D: an interactive system for point-based surface editing , 2002, SIGGRAPH.

[15]  Michael Wand.  Point-based multi-resolution rendering , 2004 .

[16]  Mi-Suen Lee,et al.  A Computational Framework for Segmentation and Grouping , 2000 .

[17]  Marc Levoy,et al.  Streaming QSplat: a viewer for networked visualization of large, dense models , 2001, I3D '01.

[18]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[19]  Markus H. Gross,et al.  Shape modeling with point-sampled geometry , 2003, ACM Trans. Graph..

[20]  Michael Wimmer,et al.  Eurographics Symposium on Point-based Graphics (2006) Instant Points: Fast Rendering of Unprocessed Point Clouds , 2022 .

[21]  A. Fischer,et al.  Reconstruction with 3D geometric bilateral filter , 2004, SM '04.

[22]  Hugues Hoppe.  Smooth view-dependent level-of-detail control and its application to terrain rendering , 1998 .

[23]  Markus H. Gross,et al.  Point-based multiscale surface representation , 2006, TOGS.

[24]  Francois Blais,et al.  GoLD: Interactive Display of Huge Colored and Textured Models Louis Borgeat Guy Godin Franc ‚ois Blais Philippe Massicotte National Research Council of Canada , 2005, SIGGRAPH 2005.

[25]  Enrico Gobbetti,et al.  Far voxels: a multiresolution framework for interactive rendering of huge complex 3D models on commodity graphics platforms , 2005, ACM Trans. Graph..

[26]  Paolo Cignoni,et al.  Adaptive TetraPuzzles: Ecient Out-of-Core Construction and Visualization of Gigantic Multiresolution Polygonal Models , 2004, SIGGRAPH 2004.

[27]  Peter Schröder,et al.  Interactive multiresolution mesh editing , 1997, SIGGRAPH.

[28]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[29]  David Salesin,et al.  Multiresolution painting and compositing , 1994, SIGGRAPH.

[30]  Reinhard Klein,et al.  Real-time out-of-core trimmed NURBS rendering and editing , 2004, VMV.

[31]  Paolo Cignoni,et al.  External Memory Management and Simplification of Huge Meshes , 2003, IEEE Trans. Vis. Comput. Graph..

[32]  Friedhelm Meyer auf der Heide,et al.  The randomized z-buffer algorithm: interactive rendering of highly complex scenes , 2001, SIGGRAPH.

[33]  Reinhard Klein,et al.  Real-time appearance preserving out-of-core rendering with shadows , 2004, Rendering Techniques.

[34]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[35]  Michael Wand,et al.  Interactive Editing of Large Point Clouds , 2007, PBG@Eurographics.

[36]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[37]  Brad A. Myers.  Scripting graphical applications by demonstration , 1998, CHI.

[38]  Martin Isenburg,et al.  Streaming meshes , 2005, VIS 05. IEEE Visualization, 2005..

[39]  Dinesh Manocha,et al.  Quick-VDR: interactive view-dependent rendering of massive models , 2004, IEEE Visualization 2004.

[40]  Martin Isenburg,et al.  Out-of-core compression for gigantic polygon meshes , 2003, ACM Trans. Graph..

[41]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[42]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[43]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[44]  Jarek Rossignac,et al.  Multi-resolution 3D approximations for rendering complex scenes , 1993, Modeling in Computer Graphics.

[45]  Enrico Gobbetti,et al.  Layered Point Clouds , 2004, PBG.

[46]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[47]  Michael Garland,et al.  A multiresolution representation for massive meshes , 2005, IEEE Transactions on Visualization and Computer Graphics.

[48]  Peter Lindstrom,et al.  Out-of-core simplification of large polygonal models , 2000, SIGGRAPH.

[49]  Friedhelm Meyer auf der Heide,et al.  The randomized sample tree: a data structure for interactive walkthroughs in externally stored virtual environments , 2002, VRST '02.