3D Point Cloud Color Denoising Using Convex Graph-Signal Smoothness Priors

Point cloud is a collection of 3D coordinates and associated color information, which are discrete samples of an object's 2D surfaces. Imperfection in the acquisition process means that point clouds are often corrupted with noise in both geometric and color spaces. Building on recent advances in graph signal processing, we design two algorithms for 3D point cloud color denoising. Specifically, we develop a smoothness notion for 3D color point clouds using graph Laplacian regularizer (GLR) or graph total variation (GTV) priors defined on the RGB space to promote piecewise smoothness (PWS) of RGB values. Using GLR or GTV as signal prior, we formulate the point cloud color denoising problem as a maximum a posteriori (MAP) estimation problem. For the GLR prior, the MAP formulation leads to an unconstrained quadratic programming (QP) problem, which can be efficiently computed using conjugate gradient (CG). For the GTV prior, the MAP formulation results in an ℓ1-ℓ2 cost function; we minimize it using alternating direction method of multipliers (ADMM) and proximal gradient descent, where a good step size is chosen via Lipschitz continuity analysis. Extensive experiments show satisfactory denoising performance using our proposed algorithms.

[1]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[2]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[3]  Camille Couprie,et al.  Dual constrained TV-based regularization , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Xianming Liu,et al.  Random Walk Graph Laplacian-Based Smoothness Prior for Soft Decoding of JPEG Images , 2016, IEEE Transactions on Image Processing.

[5]  Stefano Alliney,et al.  A property of the minimum vectors of a regularizing functional defined by means of the absolute norm , 1997, IEEE Trans. Signal Process..

[6]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[7]  Kaoru Yamamoto,et al.  Deblurring of point cloud attributes in graph spectral domain , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Wen Gao,et al.  Cluster-Based Point Cloud Coding with Normal Weighted Graph Fourier Transform , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Gene Cheung,et al.  Graph Laplacian Regularization for Image Denoising: Analysis in the Continuous Domain , 2016, IEEE Transactions on Image Processing.

[10]  Jianzhong Wang,et al.  Geometric Structure of High-Dimensional Data and Dimensionality Reduction , 2012 .

[11]  Gene Cheung,et al.  3D Point Cloud Denoising via Bipartite Graph Approximation and Reweighted Graph Laplacian , 2018, 1812.07711.

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  Lu Fang,et al.  SurfaceNet: An End-to-End 3D Neural Network for Multiview Stereopsis , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Enrico Magli,et al.  Graph Spectral Image Processing , 2018, Proceedings of the IEEE.

[15]  Maks Ovsjanikov,et al.  PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Clouds , 2019, Comput. Graph. Forum.

[16]  Christophe Charrier,et al.  Technical report : Greyc 3D colored mesh database , 2017 .

[17]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[18]  Henry Stark,et al.  Probability, Statistics, and Random Processes for Engineers , 2011 .

[19]  Olivier Lézoray,et al.  3D colored mesh graph signals multi-layer morphological enhancement , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Ju Shen,et al.  Virtual Mirror Rendering With Stationary RGB-D Cameras and Stored 3-D Background , 2013, IEEE Transactions on Image Processing.

[21]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[22]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[23]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[24]  Wen Gao,et al.  Graph-Based Blind Image Deblurring From a Single Photograph , 2018, IEEE Transactions on Image Processing.

[25]  Gene Cheung,et al.  3D Point Cloud Denoising Using Graph Laplacian Regularization of a Low Dimensional Manifold Model , 2018, IEEE Transactions on Image Processing.

[26]  Antonin Chambolle,et al.  On Total Variation Minimization and Surface Evolution Using Parametric Maximum Flows , 2009, International Journal of Computer Vision.

[27]  Gene Cheung,et al.  Local 3D Point Cloud Denoising via Bipartite Graph Approximation & Total Variation , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[28]  Pierre Vandergheynst,et al.  Graph-based denoising for time-varying point clouds , 2015, 2015 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[29]  Alexey Castrodad,et al.  Point Cloud Denoising via Moving RPCA , 2017, Comput. Graph. Forum.

[30]  Fan Chung,et al.  Spectral Graph Theory , 1996 .