Multi-Patch Collaborative Point Cloud Denoising via Low-Rank Recovery with Graph Constraint

Point cloud is the primary source from 3D scanners and depth cameras. It usually contains more raw geometric features, as well as higher levels of noise than the reconstructed mesh. Although many mesh denoising methods have proven to be effective in noise removal, they hardly work well on noisy point clouds. We propose a new multi-patch collaborative method for point cloud denoising, which is solved as a low-rank matrix recovery problem. Unlike the traditional single-patch based denoising approaches, our approach is inspired by the geometric statistics which indicate that a number of surface patches sharing approximate geometric properties always exist within a 3D model. Based on this observation, we define a rotation-invariant height-map patch (HMP) for each point by robust Bi-PCA encoding bilaterally filtered normal information, and group its non-local similar patches together. Within each group, all patches are geometrically similar, while suffering from noise. We pack the height maps of each group into an HMP matrix, whose initial rank is high, but can be significantly reduced. We design an improved low-rank recovery model, by imposing a graph constraint to filter noise. Experiments on synthetic and raw datasets demonstrate that our method outperforms state-of-the-art methods in both noise removal and feature preservation.

[1]  Alexandre Boulch,et al.  Deep Learning for Robust Normal Estimation in Unstructured Point Clouds , 2016, Comput. Graph. Forum.

[2]  Julie Digne,et al.  Similarity based filtering of point clouds , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Daniel Cohen-Or,et al.  Edge-aware point set resampling , 2013, ACM Trans. Graph..

[4]  David Zhang,et al.  Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoising , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Qian Xie,et al.  Data‐Driven Sparse Priors of 3D Shapes , 2017, Comput. Graph. Forum.

[6]  WangRuimin,et al.  Decoupling noise and features via weighted ℓ1-analysis compressed sensing , 2014 .

[7]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Charlie C. L. Wang,et al.  Bas-Relief Modeling from Normal Layers , 2019, IEEE Transactions on Visualization and Computer Graphics.

[9]  Markus H. Gross,et al.  PointProNets: Consolidation of Point Clouds with Convolutional Neural Networks , 2018, Comput. Graph. Forum.

[10]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[11]  Maryam Fazel,et al.  Iterative reweighted algorithms for matrix rank minimization , 2012, J. Mach. Learn. Res..

[12]  Matthias Zwicker,et al.  Deep points consolidation , 2015, ACM Trans. Graph..

[13]  Haoran Xie,et al.  Learning-based 3D surface optimization from medical image reconstruction , 2018 .

[14]  Marc Alexa,et al.  Computing and Rendering Point Set Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[15]  Frédo Durand,et al.  Normal improvement for point rendering , 2004, IEEE Computer Graphics and Applications.

[16]  Lei Zhang,et al.  Image Restoration: From Sparse and Low-Rank Priors to Deep Priors [Lecture Notes] , 2017, IEEE Signal Processing Magazine.

[17]  Lei Zhang,et al.  Robust Principal Component Analysis with Complex Noise , 2014, ICML.

[18]  Xin Tong,et al.  Mesh denoising via cascaded normal regression , 2016, ACM Trans. Graph..

[19]  Jie Zhang,et al.  Online Low-Rank Representation Learning for Joint Multi-Subspace Recovery and Clustering , 2018, IEEE Transactions on Image Processing.

[20]  Daniel Cohen-Or,et al.  Consolidation of unorganized point clouds for surface reconstruction , 2009, ACM Trans. Graph..

[21]  Cohen-OrDaniel,et al.  ℓ1-Sparse reconstruction of sharp point set surfaces , 2010 .

[22]  Ligang Liu,et al.  Decoupling noise and features via weighted ℓ1-analysis compressed sensing , 2014, TOGS.

[23]  Sébastien Valette,et al.  Sparse Geometric Representation Through Local Shape Probing , 2016, IEEE Transactions on Visualization and Computer Graphics.

[24]  L. Mirsky A trace inequality of John von Neumann , 1975 .

[25]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[26]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[27]  Markus H. Gross,et al.  Dynamic Sampling and Rendering of Algebraic Point Set Surfaces , 2008, Comput. Graph. Forum.

[28]  Qian Xie,et al.  Surface reconstruction with data-driven exemplar priors , 2017, Comput. Aided Des..

[29]  Ji Wan,et al.  Multi-view 3D Object Detection Network for Autonomous Driving , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Daniel Cohen-Or,et al.  GlobFit: consistently fitting primitives by discovering global relations , 2011, ACM Trans. Graph..

[31]  Raphaëlle Chaine,et al.  Super‐Resolution of Point Set Surfaces Using Local Similarities , 2018, Comput. Graph. Forum.

[32]  David Levin,et al.  The approximation power of moving least-squares , 1998, Math. Comput..

[33]  Bailin Deng,et al.  Static/Dynamic Filtering for Mesh Geometry , 2017, IEEE Transactions on Visualization and Computer Graphics.

[34]  Pheng-Ann Heng,et al.  Non‐Local Sparse and Low‐Rank Regularization for Structure‐Preserving Image Smoothing , 2016, Comput. Graph. Forum.

[35]  Hongbin Zha,et al.  A Unified Convex Surrogate for the Schatten-p Norm , 2016, AAAI.

[36]  Alexey Castrodad,et al.  Point Cloud Denoising via Moving RPCA , 2017, Comput. Graph. Forum.

[37]  N. Mitra,et al.  Non-local scan consolidation for 3D urban scenes , 2010, ACM Trans. Graph..

[38]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[39]  Ligang Liu,et al.  Multi-Normal Estimation via Pair Consistency Voting , 2019, IEEE Transactions on Visualization and Computer Graphics.

[40]  Markus H. Gross,et al.  Algebraic point set surfaces , 2007, ACM Trans. Graph..

[41]  Marc Alexa,et al.  Point-sampled cell complexes , 2006, ACM Trans. Graph..

[42]  Guangcan Liu,et al.  Implicit Block Diagonal Low-Rank Representation , 2018, IEEE Transactions on Image Processing.

[43]  Bolei Zhou,et al.  SegICP: Integrated deep semantic segmentation and pose estimation , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[44]  Weishi Li,et al.  Tensor Voting Guided Mesh Denoising , 2017, IEEE Transactions on Automation Science and Engineering.

[45]  Robert Patro,et al.  A robust and rotationally invariant local surface descriptor with applications to non-local mesh processing , 2011, Graph. Model..

[46]  Yilong Yin,et al.  Patch-Based Image Inpainting via Two-Stage Low Rank Approximation , 2018, IEEE Transactions on Visualization and Computer Graphics.

[47]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[48]  Lizhuang Ma,et al.  Low Rank Matrix Approximation for Geometry Filtering , 2018, ArXiv.

[49]  Ligang Liu,et al.  Bi-Normal Filtering for Mesh Denoising , 2015, IEEE Transactions on Visualization and Computer Graphics.

[50]  Yuxin Liu,et al.  Guided point cloud denoising via sharp feature skeletons , 2017, The Visual Computer.

[51]  Michael Wimmer,et al.  Continuous projection for fast L1 reconstruction , 2014, ACM Trans. Graph..

[52]  Bailin Deng,et al.  Guided Mesh Normal Filtering , 2015, Comput. Graph. Forum.

[53]  Chunxia Xiao,et al.  Efficient feature-preserving local projection operator for geometry reconstruction , 2013, Comput. Aided Des..

[54]  Yan Liu,et al.  Weighted Schatten $p$ -Norm Minimization for Image Denoising and Background Subtraction , 2015, IEEE Transactions on Image Processing.

[55]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Youyi Zheng,et al.  IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 1 Bilateral Normal Filtering for Mesh Denoising , 2022 .

[57]  Wenping Wang,et al.  Denoising point sets via L0 minimization , 2015, Comput. Aided Geom. Des..

[58]  Jun Wang,et al.  Matrix Recovery with Implicitly Low-Rank Data , 2018, Neurocomputing.

[59]  Daniel Cohen-Or,et al.  Parameterization-free projection for geometry reconstruction , 2007, ACM Trans. Graph..

[60]  Qionghai Dai,et al.  Robust Non-rigid Motion Tracking and Surface Reconstruction Using L0 Regularization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[61]  Ron Kimmel,et al.  Patch‐Collaborative Spectral Point‐Cloud Denoising , 2013, Comput. Graph. Forum.

[62]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[63]  Haoran Xie,et al.  Nonrigid iterative closest points for registration of 3D biomedical surfaces , 2018 .

[64]  Zhigang Deng,et al.  A Robust Scheme for Feature-Preserving Mesh Denoising , 2016, IEEE Transactions on Visualization and Computer Graphics.

[65]  Matthias Zwicker,et al.  GPF: GMM-Inspired Feature-Preserving Point Set Filtering , 2018, IEEE Transactions on Visualization and Computer Graphics.