Exemplar-Based Hole-Filling Technique for Multiple Dynamic Objects

Entire shape reconstruction of dynamic objects is an important research subject with applications on film production, virtual reality, modeling and engineering. Typically, entire shape reconstruction of real objects is achieved by combining the outcome of objects scanned from multiple directions. However, due to limitations on the number of 3D sensors enclosing the scene, occlusions inevitably occur, causing holes to appear on the reconstructed surfaces. These issues are intensified if dynamic, moving objects are considered. Volumetric and polygonal approaches exist to address these problems. Most notably, exemplar-based polygonal methods have gained momentum due to their overall improved visual quality. In this paper we propose an extension to the plain exemplar-based technique that allows for multiple dynamic objects. With our method, adequate hole-filling candidates are sampled from spatial and temporal domains and then used to synthesize likely plausible surfaces with smooth boundaries for the hole regions.

[1]  Randal C. Burns,et al.  Parallel Poisson Surface Reconstruction , 2009, ISVC.

[2]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[3]  Ryo Furukawa,et al.  Shape-merging and interpolation using class estimation for unseen voxels with a GPU-based efficient implementation , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[4]  Ryo Furukawa,et al.  Improved Space Carving Method for Merging and Interpolating Multiple Range Images Using Information of Light Sources of Active Stereo , 2007, ACCV.

[5]  Naokazu Yokoya,et al.  Surface completion by minimizing energy based on similarity of shape , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[7]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[8]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[9]  Yasushi Yagi.  Computer Vision - ACCV 2007, 8th Asian Conference on Computer Vision, Tokyo, Japan, November 18-22, 2007, Proceedings, Part I , 2007, ACCV.

[10]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[11]  Takeshi Masuda,et al.  Registration and Integration of Multiple Range Images by Matching Signed Distance Fields for Object Shape Modeling , 2002, Comput. Vis. Image Underst..

[12]  Avideh Zakhor,et al.  Surface completion of shape and texture based on energy minimization , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[14]  Katsushi Ikeuchi,et al.  Adaptively merging large-scale range data with reflectance properties , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Naokazu Yokoya,et al.  Efficient surface completion using principal curvature and its evaluation , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[16]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.