A scalable webGL-based approach for visualizing massive 3D point clouds using semantics-dependent rendering techniques

3D point cloud technology facilitates the automated and highly detailed digital acquisition of real-world environments such as assets, sites, cities, and countries; the acquired 3D point clouds represent an essential category of geodata used in a variety of geoinformation applications and systems. In this paper, we present a web-based system for the interactive and collaborative exploration and inspection of arbitrary large 3D point clouds. Our approach is based on standard WebGL on the client side and is able to render 3D point clouds with billions of points. It uses spatial data structures and level-of-detail representations to manage the 3D point cloud data and to deploy out-of-core and web-based rendering concepts. By providing functionality for both, thin-client and thick-client applications, the system scales for client devices that are vastly different in computing capabilities. Different 3D point-based rendering techniques and post-processing effects are provided to enable task-specific and data-specific filtering and highlighting, e.g., based on per-point surface categories or temporal information. A set of interaction techniques allows users to collaboratively work with the data, e.g., by measuring distances and areas, by annotating, or by selecting and extracting data subsets. Additional value is provided by the system's ability to display additional, context-providing geodata alongside 3D point clouds and to integrate task-specific processing and analysis operations. We have evaluated the presented techniques and the prototype system with different data sets from aerial, mobile, and terrestrial acquisition campaigns with up to 120 billion points to show their practicality and feasibility.

[1]  G. Jóźków,et al.  Analysis of Point Cloud Generation from UAS Images , 2014 .

[2]  Michael Wimmer,et al.  Auto Splats: Dynamic Point Cloud Visualization on the GPU , 2012, EGPGV@Eurographics.

[3]  S. Nebiker,et al.  VISUALISATION OF COMPLEX 3D CITY MODELS ON MOBILE WEBBROWSERS USING CLOUD-BASED IMAGE PROVISIONING , 2015 .

[4]  Markus Gross,et al.  Point-Based Graphics , 2007 .

[5]  Roland Billen,et al.  SMART POINT CLOUD: DEFINITION AND REMAINING CHALLENGES , 2016 .

[6]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[7]  Pierre Alliez,et al.  State of the Art in Surface Reconstruction from Point Clouds , 2014, Eurographics.

[8]  Takafumi Saito,et al.  Comprehensible rendering of 3-D shapes , 1990, SIGGRAPH.

[9]  Jing Huang,et al.  Point cloud labeling using 3D Convolutional Neural Network , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[10]  Peter van Oosterom,et al.  Realistic Benchmarks for Point Cloud Data Management Systems , 2017 .

[11]  Alexandre Boulch,et al.  Unstructured Point Cloud Semantic Labeling Using Deep Segmentation Networks , 2017, 3DOR@Eurographics.

[12]  Michael Wimmer,et al.  High-quality point-based rendering using fast single-pass interpolation , 2015, 2015 Digital Heritage.

[13]  Stefan Verhoeven,et al.  Taming the beast: Free and open-source massive point cloud web visualization , 2015 .

[14]  Daniel Seifert,et al.  Traffic awareness driver assistance based on stereovision, eye-tracking, and head-up display , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  M. Wimmer Rendering Large Point Clouds in Web Browsers , 2015 .

[17]  Guojun Lu,et al.  BUILDING CHANGE DETECTION FROM LIDAR POINT CLOUD DATA BASED ON CONNECTED COMPONENT ANALYSIS , 2015 .

[18]  Susanne Bleisch,et al.  Rich point clouds in virtual globes - A new paradigm in city modeling? , 2010, Comput. Environ. Urban Syst..

[19]  Julien Perret,et al.  A scalable and multi-purpose point cloud server (PCS) for easier and faster point cloud data management and processing , 2017 .

[20]  Tee-Ann Teo,et al.  Pole-Like Road Object Detection From Mobile Lidar System Using a Coarse-to-Fine Approach , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Maren Lindstaedt,et al.  COMPARATIVE GEOMETRICAL INVESTIGATIONS OF HAND-HELD SCANNING SYSTEMS , 2016 .

[22]  Erica Nocerino,et al.  Dense image matching: Comparisons and analyses , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[23]  Martin Mittring,et al.  Finding next gen: CryEngine 2 , 2007, SIGGRAPH Courses.

[24]  Ruggero Pintus,et al.  Real-time Rendering of Massive Unstructured Raw Point Clouds using Screen-space Operators , 2011, VAST.

[25]  Renato Pajarola,et al.  An efficient multi-resolution framework for high quality interactive rendering of massive point clouds using multi-way kd-trees , 2012, The Visual Computer.

[26]  Stewart He,et al.  Point-Based Rendering of Forest LiDAR , 2014, EnvirVis@EuroVis.

[27]  Michael Wimmer,et al.  Out-of-core selection and editing of huge point clouds , 2011, Comput. Graph..

[28]  H. Butler,et al.  plas.io: Open Source, Browser-based WebGL Point Cloud Visualization , 2014 .

[29]  Benjamin Pross,et al.  OGC® WPS 2.0 Interface Standard , 2015 .

[30]  Ruggero Pintus,et al.  Interactive Exploration of Gigantic Point Clouds on Mobile Devices , 2012, VAST.

[31]  Jürgen Döllner,et al.  Server-based rendering of large 3D scenes for mobile devices using G-buffer cube maps , 2012, Web3D '12.

[32]  Dong Chen,et al.  Topologically Aware Building Rooftop Reconstruction From Airborne Laser Scanning Point Clouds , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Hans-Peter Seidel,et al.  Processing and interactive editing of huge point clouds from 3D scanners , 2008, Comput. Graph..

[34]  Jürgen Döllner,et al.  Out-of-Core Visualization of Classified 3D Point Clouds , 2015 .

[35]  Heinz Rüther,et al.  From Point Cloud to Textured Model, the Zamani Laser Scanning Pipeline in Heritage Documentation , 2012 .

[36]  Volker Coors,et al.  A framework for server side rendering using OGC's 3D portrayal service , 2016, Web3D.

[37]  Andreas Nüchter,et al.  One billion points in the cloud – an octree for efficient processing of 3D laser scans , 2013 .

[38]  Carl T. Haas,et al.  State of research in automatic as-built modelling , 2015, Adv. Eng. Informatics.

[39]  Jürgen Döllner,et al.  Out‐of‐Core GPU‐based Change Detection in Massive 3D Point Clouds , 2013, Trans. GIS.

[40]  Qian Sun,et al.  Splatting lines: an efficient method for illustrating 3D surfaces and volumes , 2014, I3D.

[41]  Ulrich Neumann,et al.  Visualizing aerial LiDAR cities with hierarchical hybrid point-polygon structures , 2014, Graphics Interface.

[42]  Alexander Zipf,et al.  Area-wide roof plane segmentation in airborne LiDAR point clouds , 2012, Comput. Environ. Urban Syst..

[43]  Gottfried Mandlburger,et al.  Beyond 3-D: The New Spectrum of Lidar Applications for Earth and Ecological Sciences , 2016 .