Stroke-based splatting: an efficient multi-resolution point cloud visualization technique

Current state-of-the-art point cloud visualization techniques have shortcomings when dealing with sparse and less accurate data or close-up interactions. In this paper, we present a visualization technique called stroke-based splatting, which applies concepts of stroke-based rendering to surface-aligned splatting, allowing for better shape perception at lower resolutions and close-ups. We create a painterly depiction of the data with an impressionistic aesthetic, which is a metaphor the user is culturally trained to recognize, thus attributing higher quality to the visualization. This is achieved by shaping each object-aligned splat as a brush stroke, and orienting it according to globally coherent tangent vectors from the Householder formula, creating a painterly depiction of the scanned cloud. Each splat is sized according to a color-based clustering analysis of the data, ensuring the consistency of brush strokes within neighborhood areas. By controlling brush shape generation parameters and blending factors between neighboring splats, the user is able to simulate different painting styles in real time. We have tested our method with data sets captured by commodity laser scanners as well as publicly available high-resolution point clouds, both having highly interactive frame rates in all cases. In addition, a user study was conducted comparing our approach to state-of-the-art point cloud visualization techniques. Users considered stroke-based splatting a valuable technique as it provides a higher or similar visual quality to current approaches.

[1]  Leif Kobbelt,et al.  Efficient High Quality Rendering of Point Sampled Geometry , 2002, Rendering Techniques.

[2]  Renato Pajarola,et al.  Confetti: object-space point blending and splatting , 2004, IEEE Transactions on Visualization and Computer Graphics.

[3]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[4]  James T. Enns,et al.  Perceptually based brush strokes for nonphotorealistic visualization , 2004, TOGS.

[5]  David Eberly Computing Orthonormal Sets in 2 D , 3 D , and 4 D , 2015 .

[6]  Chuan-Kai Yang,et al.  Realization of Seurat’s pointillism via non-photorealistic rendering , 2008, The Visual Computer.

[7]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[8]  Ronen Basri,et al.  Direct visibility of point sets , 2007, ACM Trans. Graph..

[9]  Lee Westover,et al.  Splatting: a parallel, feed-forward volume rendering algorithm , 1991 .

[10]  Luis Salgado,et al.  Depth-Color Fusion Strategy for 3-D Scene Modeling With Kinect , 2013, IEEE Transactions on Cybernetics.

[11]  Matthias Zwicker,et al.  Perspective Accurate Splatting , 2004, Graphics Interface.

[12]  R. Fabio From point cloud to surface the modeling and visualization problem , 2003 .

[13]  Fabio Remondino From point cloud to surface , 2003 .

[14]  James F. O'Brien,et al.  Spectral surface reconstruction from noisy point clouds , 2004, SGP '04.

[15]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[16]  Hui Xu,et al.  PointWorks: Abstraction and Rendering of Sparsely Scanned Outdoor Environments , 2004, Rendering Techniques.

[17]  Barbara J. Meier Painterly rendering for animation , 1996, SIGGRAPH.

[18]  Qingming Zhana,et al.  Color-based Segmentation of Point Clouds , 2009 .

[19]  Peter Shirley,et al.  Artistic Vision: painterly rendering using computer vision techniques , 2002, NPAR '02.

[20]  J. Ambrósio,et al.  A mathematical framework for rigid contact detection between quadric and superquadric surfaces , 2010 .

[21]  Meenakshisundaram Gopi,et al.  Hardware accelerated real time charcoal rendering , 2002, NPAR '02.

[22]  Michio Shiraishi,et al.  An algorithm for automatic painterly rendering based on local source image approximation , 2000, NPAR '00.

[23]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[24]  D. Liang Color Image Denoising Using Gaussian Multiscale Multivariate Image Analysis , 2010 .

[25]  Marc Alexa,et al.  Computing and Rendering Point Set Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[26]  Hui Xu,et al.  Stylized rendering of 3D scanned real world environments , 2004, NPAR '04.

[27]  Matthias Zwicker,et al.  High-quality surface splatting on today's GPUs , 2005, Proceedings Eurographics/IEEE VGTC Symposium Point-Based Graphics, 2005..

[28]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[29]  Craig M. Shakarji,et al.  Least-Squares Fitting Algorithms of the NIST Algorithm Testing System , 1998, Journal of research of the National Institute of Standards and Technology.

[30]  Martin Buss,et al.  Comparison of surface normal estimation methods for range sensing applications , 2009, 2009 IEEE International Conference on Robotics and Automation.

[31]  Michael Wimmer,et al.  Auto Splats: Dynamic Point Cloud Visualization on the GPU , 2012, EGPGV@Eurographics.

[32]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[33]  N. Awano,et al.  Interactive Stipple Rendering for Point Clouds , 2014 .

[34]  Matthias Zwicker,et al.  Object Space EWA Surface Splatting: A Hardware Accelerated Approach to High Quality Point Rendering , 2002, Comput. Graph. Forum.

[35]  Takashi Kanai,et al.  Interactive point-based painterly rendering , 2004, 2004 International Conference on Cyberworlds.

[36]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[37]  Meenakshisundaram Gopi,et al.  Surface Reconstruction based on Lower Dimensional Localized Delaunay Triangulation , 2000, Comput. Graph. Forum.

[38]  Adam Runions,et al.  Ribbons: A representation for point clouds , 2007 .

[39]  Renato Pajarola,et al.  Point-based rendering techniques , 2004, Comput. Graph..

[40]  Robert W. Sumner,et al.  OverCoat: an implicit canvas for 3D painting , 2011, ACM Trans. Graph..

[41]  Simon Fuhrmann,et al.  Ambient point clouds for view interpolation , 2010, SIGGRAPH 2010.

[42]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[43]  Daniel Simões Lopes,et al.  Tangent vectors to a 3-D surface normal: A geometric tool to find orthogonal vectors based on the Householder transformation , 2013, Comput. Aided Des..

[44]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.