Multi-scale geometry detail recovery on surfaces via Empirical Mode Decomposition

Abstract In this paper, to recover the missing geometry details on 3D surfaces, we develop a novel geometry detail recovery algorithm for 3D surfaces based on Empirical Mode Decomposition (EMD). EMD is a powerful tool for processing non-linear and non-stationary signals and has been successfully used in 3D surface analysis and processing. Given a signal defined on 3D surface, EMD could represent the signal in a multi-scale fashion and decompose the signal into a number of Intrinsic Mode Functions (IMFs) and a residue, which usually encode the multi-level finer-scale details and the overall shape of the signal, respectively. Benefiting from the multi-scale representation of geometry details, the EMD-based multi-scale geometry detail recovery algorithm is developed. Our strategy starts from an initial smooth filling of a hole and then transfers the desirable details from the most similar region to the smoothly-filled surface within the framework of EMD. Taking the advantages of EMD, we first apply EMD on the whole completed surface to obtain the multi-scale representation of geometry details. Then, the most similar region corresponding to the hole region is located by the patch descriptor constructed from Heat Kernel Signature (HKS). Finally, the missing geometry details can be effectively recovered by transferring the geometry details from the found similar region to the smoothly-filled surface. Traditional methods, such as context-based methods or example-based methods, usually cut the similar patch and paste them onto the hole region, and they require to match with the hole boundary, are complex in general. In contrast, our method is simple and can transfer different scale details individually or in a concerted way, which makes our algorithm more flexible and can achieve versatile detail recovery results. Comprehensive experiments and quantitative comparisons on popular models have been used to demonstrate the effectiveness of our EMD-based multi-scale geometry detail recovery algorithm.

[1]  Jianping Hu,et al.  Improved, feature-centric EMD for 3D surface modeling and processing , 2014, Graph. Model..

[2]  Wei Yu,et al.  Fragmented skull modeling using heat kernels , 2012, Graph. Model..

[3]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[4]  Bruno Lévy.  Dual domain extrapolation , 2003, ACM Trans. Graph..

[5]  Tao Ju,et al.  Robust repair of polygonal models , 2004, ACM Trans. Graph..

[6]  Eitan Grinspun,et al.  Eurographics Symposium on Geometry Processing 2014 Feature-preserving Surface Completion Using Four Points , 2022 .

[7]  M. Teschner,et al.  Meshless deformations based on shape matching , 2005, SIGGRAPH 2005.

[8]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[9]  Chunxia Xiao,et al.  Shape-controllable geometry completion for point cloud models , 2016, The Visual Computer.

[10]  Marco Attene,et al.  A lightweight approach to repairing digitized polygon meshes , 2010, The Visual Computer.

[11]  Leif Kobbelt,et al.  Structure Preserving CAD Model Repair , 2005, Comput. Graph. Forum.

[12]  Jianping Hu,et al.  Novel and efficient computation of Hilbert-Huang transform on surfaces , 2016, Comput. Aided Geom. Des..

[13]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[14]  Robert B. Fisher,et al.  Three-Dimensional Surface Relief Completion Via Nonparametric Techniques , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Eitan Grinspun,et al.  Context-based coherent surface completion , 2014, ACM Trans. Graph..

[16]  Jean-Philippe Pernot,et al.  Towards recovery of complex shapes in meshes using digital images for reverse engineering applications , 2010, Comput. Aided Des..

[17]  Junjie Cao,et al.  Empirical mode decomposition on surfaces , 2012, Graph. Model..

[18]  Prosenjit Bose,et al.  Filling holes in triangular meshes by curve unfolding , 2009, 2009 IEEE International Conference on Shape Modeling and Applications.

[19]  Yongtae Jun,et al.  A piecewise hole filling algorithm in reverse engineering , 2005, Comput. Aided Des..

[20]  Leonidas J. Guibas,et al.  Data-driven structural priors for shape completion , 2015, ACM Trans. Graph..

[21]  Hong Qin,et al.  Simultaneous structure and geometry detail completion based on interactive user sketches , 2011, Science China Information Sciences.

[22]  Greg Turk,et al.  Simplification and Repair of Polygonal Models Using Volumetric Techniques , 2003, IEEE Trans. Vis. Comput. Graph..

[23]  Jean-Philippe Pernot,et al.  Filling holes in meshes using a mechanical model to simulate the curvature variation minimization , 2006, Comput. Graph..

[24]  Chunxia Xiao,et al.  A unified method for appearance and geometry completion of point set surfaces , 2007, The Visual Computer.

[25]  Szymon Rusinkiewicz,et al.  Eurographics Symposium on Geometry Processing (2005) Atomic Volumes for Mesh Completion , 2022 .

[26]  Flavio Prieto,et al.  Automatic Hole-Filling of Triangular Meshes Using Local Radial Basis Function , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[27]  Xin Li,et al.  Symmetry and template guided completion of damaged skulls , 2011, Comput. Graph..

[28]  Marco Attene,et al.  Polygon mesh repairing: An application perspective , 2013, CSUR.

[29]  Z. Li,et al.  Polynomial blending in a mesh hole-filling application , 2010, Comput. Aided Des..

[30]  Nicolas Mellado,et al.  Adaptive multi‐scale analysis for point‐based surface editing , 2014, Comput. Graph. Forum.

[31]  Alberto Signoroni,et al.  RameshCleaner: Conservative Fixing of Triangular Meshes , 2015, STAG.

[32]  Jianping Hu,et al.  Interactive modeling of complex geometric details based on empirical mode decomposition for multi-scale 3D shapes , 2017, Comput. Aided Des..

[33]  Wei Zhao,et al.  A Robust Hole-Filling Algorithm for Triangular Mesh , 2007, CAD/Graphics.

[34]  Xiaoru Yuan,et al.  Geometry completion and detail generation by texture synthesis , 2005, The Visual Computer.

[35]  Marc Alexa,et al.  Context-based surface completion , 2004, ACM Trans. Graph..

[36]  Weihong Wang,et al.  EMD based fairing algorithm for mesh surface , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[37]  居涛.  Fixing Geometric Errors on Polygonal Models： A Survey , 2009 .

[38]  Leonidas J. Guibas,et al.  Example-Based 3D Scan Completion , 2005 .

[39]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[40]  Hong Qin,et al.  Surface completion for shape and appearance , 2006, The Visual Computer.

[41]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[42]  Ming Zhong,et al.  Surface inpainting with sparsity constraints , 2016, Comput. Aided Geom. Des..

[43]  Reinhard Klein,et al.  Detail-Preserving Surface Inpainting , 2005, VAST.

[44]  Baocai Yin,et al.  Automatic hole-filling of CAD models with feature-preserving , 2012, Comput. Graph..

[45]  Kuo-Young Cheng,et al.  A Sharpness-Dependent Filter for Recovering Sharp Features in Repaired 3D Mesh Models , 2008, IEEE Transactions on Visualization and Computer Graphics.

[46]  Jianping Hu,et al.  Efficient EMD and Hilbert spectra computation for 3D geometry processing and analysis via space-filling curve , 2015, The Visual Computer.

[47]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[48]  Alla Sheffer,et al.  Template-based mesh completion , 2005, SGP '05.

[49]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[50]  Leif Kobbelt,et al.  Automatic restoration of polygon models , 2005, TOGS.

[51]  Markus H. Gross,et al.  Point-based multiscale surface representation , 2006, TOGS.