Detail-Preserving Surface Inpainting

Inpainting is a well-known technique in the context of image and art restoration, where paint losses are filled up to the level of the surrounding paint and then coloured to match. Analogue tasks can be found in 3D geometry processing, as digital representations of real-world objects often contain holes, due to hindrances during data acquisition or as a consequence of interactive modelling operations. In this paper we present a novel approach to automatically fill-in holes in structured surfaces where smooth hole filling is not sufficient. Previous approaches inspired by texture synthesis algorithms require specific spatial structures to identify holes and possible candidate fragments to be copied to defective regions. Consequently, the results depend heavily on the choice and location of these auxiliary structures, such that for instance symmetries are not reconstructed faithfully. In contrast, our approach is based on local neighbourhoods and therefore insensitive with respect to similarity transformations. We use so-called guidance surfaces to guide and prioritise the atomic filling operations, such that even non-trivial and larger holes can be filled consistently. The guidance surfaces are automatically computed and iteratively updated during the filling process, but can also incorporate any additional information about the surface, if available.

[1]  Chi-Keung Tang,et al.  Image repairing: robust image synthesis by adaptive ND tensor voting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Michael Garland,et al.  Similarity-based surface modelling using geodesic fans , 2004, SGP '04.

[3]  Martin Rumpf,et al.  Anisotropic geometric diffusion in surface processing , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[4]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[5]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[6]  Martin Rumpf,et al.  A finite element method for surface restoration with smooth boundary conditions , 2004, Comput. Aided Geom. Des..

[7]  Guillermo Sapiro,et al.  Inpainting surface holes , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Markus H. Gross,et al.  Spectral processing of point-sampled geometry , 2001, SIGGRAPH.

[9]  Dinesh Manocha,et al.  Fast computation of generalized Voronoi diagrams using graphics hardware , 1999, SIGGRAPH.

[10]  Gabriel Zachmann,et al.  Proximity Graphs for Defining Surfaces over Point Clouds , 2004, PBG.

[11]  Alla Sheffer,et al.  Template-based mesh completion , 2005, SGP '05.

[12]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Robert B. Schnabel Detecting holes in surfaces , 2005 .

[14]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[15]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[16]  Marc Alexa,et al.  Context-based surface completion , 2004, ACM Trans. Graph..

[17]  Leonidas J. Guibas,et al.  Example-Based 3D Scan Completion , 2005 .

[18]  Peter Schröder,et al.  Multiresolution signal processing for meshes , 1999, SIGGRAPH.

[19]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[20]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[21]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..

[22]  V. Savchenko,et al.  An Approach to Blend Surfaces , 2002 .

[23]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[24]  Gerd Häusler,et al.  New approach for the modeling and smoothing of scattered 3D data , 1998, Electronic Imaging.