Spectral Processing for Denoising and Compression of 3D Meshes Using Dynamic Orthogonal Iterations

Recently, spectral methods have been extensively used in the processing of 3D meshes. They usually take advantage of some unique properties that the eigenvalues and the eigenvectors of the decomposed Laplacian matrix have. However, despite their superior behavior and performance, they suffer from computational complexity, especially while the number of vertices of the model increases. In this work, we suggest the use of a fast and efficient spectral processing approach applied to dense static and dynamic 3D meshes, which can be ideally suited for real-time denoising and compression applications. To increase the computational efficiency of the method, we exploit potential spectral coherence between adjacent parts of a mesh and then we apply an orthogonal iteration approach for the tracking of the graph Laplacian eigenspaces. Additionally, we present a dynamic version that automatically identifies the optimal subspace size that satisfies a given reconstruction quality threshold. In this way, we overcome the problem of the perceptual distortions, due to the fixed number of subspace sizes that is used for all the separated parts individually. Extensive simulations carried out using different 3D models in different use cases (i.e., compression and denoising), showed that the proposed approach is very fast, especially in comparison with the SVD based spectral processing approaches, while at the same time the quality of the reconstructed models is of similar or even better reconstruction quality. The experimental analysis also showed that the proposed approach could also be used by other denoising methods as a preprocessing step, in order to optimize the reconstruction quality of their results and decrease their computational complexity since they need fewer iterations to converge.

[1]  Bailin Deng,et al.  Guided Mesh Normal Filtering , 2015, Comput. Graph. Forum.

[2]  JunJie Liu Research on laser stripe extraction in underwater 3D laser scanning , 2016, 2016 IEEE International Conference on Information and Automation (ICIA).

[3]  Jacopo Aleotti,et al.  Ground Segmentation From Large-Scale Terrestrial Laser Scanner Data of Industrial Environments , 2017, IEEE Robotics and Automation Letters.

[4]  Céline Hudelot,et al.  3D Mesh Compression , 2015, ACM Comput. Surv..

[5]  Konstantinos Moustakas,et al.  Compressed Sensing for Efficient Encoding of Dense 3D Meshes Using Model-Based Bayesian Learning , 2017, IEEE Transactions on Multimedia.

[6]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[7]  Youyi Zheng,et al.  IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 1 Bilateral Normal Filtering for Mesh Denoising , 2022 .

[8]  Michele Sanna,et al.  Enabling Geometry-Based 3-D Tele-Immersion With Fast Mesh Compression and Linear Rateless Coding , 2014, IEEE Transactions on Multimedia.

[9]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[10]  G. Golub,et al.  Tracking a few extreme singular values and vectors in signal processing , 1990, Proc. IEEE.

[11]  Yan Ren,et al.  View-Based 3D Model Retrieval by Joint Subgraph Learning and Matching , 2020, IEEE Access.

[12]  Gabriel Taubin,et al.  Geometric Signal Processing on Polygonal Meshes , 2000, Eurographics.

[13]  DurandFrédo,et al.  Non-iterative, feature-preserving mesh smoothing , 2003 .

[14]  Konstantinos Moustakas,et al.  Signal Processing on Static and Dynamic 3D Meshes: Sparse Representations and Applications , 2019, IEEE Access.

[15]  Bruno Lévy,et al.  Spectral Geometry Processing with Manifold Harmonics , 2008, Comput. Graph. Forum.

[16]  Aboelmagd Noureldin,et al.  Integrated Indoor Navigation System for Ground Vehicles With Automatic 3-D Alignment and Position Initialization , 2015, IEEE Transactions on Vehicular Technology.

[17]  Andrea Tagliasacchi,et al.  Real-time compression and streaming of 4D performances , 2018, ACM Trans. Graph..

[18]  Yousef Saad Analysis of Subspace Iteration for Eigenvalue Problems with Evolving Matrices , 2016, SIAM J. Matrix Anal. Appl..

[19]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[20]  Konstantinos Moustakas,et al.  Feature Preserving Mesh Denoising Based on Graph Spectral Processing , 2019, IEEE Transactions on Visualization and Computer Graphics.

[21]  Paolo Barsocchi,et al.  Monitoring Ancient Buildings: Real Deployment of an IoT System Enhanced by UAVs and Virtual Reality , 2020, IEEE Access.

[22]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[23]  Ralph R. Martin,et al.  Fast and Effective Feature-Preserving Mesh Denoising , 2007, IEEE Transactions on Visualization and Computer Graphics.

[24]  Petros Daras,et al.  Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras , 2013, IEEE Transactions on Multimedia.

[25]  Yifan Wang,et al.  DeepOrganNet: On-the-Fly Reconstruction and Visualization of 3D / 4D Lung Models from Single-View Projections by Deep Deformation Network , 2019, IEEE Transactions on Visualization and Computer Graphics.

[26]  Henri Maître,et al.  Application of spectral decomposition to compression and watermarking of 3D triangle mesh geometry , 2003, Signal Process. Image Commun..

[27]  Konstantinos Moustakas,et al.  Adaptive compression of animated meshes by exploiting orthogonal iterations , 2017, The Visual Computer.

[28]  Lei He,et al.  Mesh denoising via L0 minimization , 2013, ACM Trans. Graph..

[29]  Konstantinos Moustakas,et al.  Block based Spectral Processing of Dense 3D Meshes using Orthogonal Iterations , 2018, VISIGRAPP.

[30]  J. Leydold,et al.  Discrete Nodal Domain Theorems , 2000, math/0009120.

[31]  Cohen-OrDaniel,et al.  Bilateral mesh denoising , 2003 .

[32]  Yingbo Hua,et al.  Asymptotical orthonormalization of subspace matrices without square root , 2004, IEEE Signal Process. Mag..

[33]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.