Scanning and Reconstruction for Dynamic Surfaces

We present a novel 3D scanning system with the potential for interactive acquisition and visualization of dynamic scenes. Our system uses a spatiotemporally adaptive sampling strategy, and can take advantage of multiple simultaneous scanning devices operating at different resolutions. We also employ a level set framework for reconstructing potentially dynamic scenes from multiple concurrent streams of range data. In our framework, implicit surfaces are reconstructed periodically from new samples on a coarse grid, creating a sequence of reconstructions from disjoint sample sets that is used to estimate motion in the scene. A high-resolution reconstruction proceeds alongside, where the surface is evolved by a convective flow that guides it towards the sample set. We employ a spatially-varying distance metric based on our motion estimate that adaptively controls the contribution of older samples to the final reconstruction.

[1]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Herbert Edelsbrunner,et al.  Shape Reconstruction with Delaunay Complex , 1998, LATIN.

[3]  Suyash P. Awate,et al.  An Interactive Parallel Multiprocessor Level-Set Solver with Dynamic Load Balancing , 2004 .

[4]  David Eppstein,et al.  The Crust and the beta-Skeleton: Combinatorial Curve Reconstruction , 1998, Graph. Model. Image Process..

[5]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  S. Osher,et al.  Spatially adaptive techniques for level set methods and incompressible flow , 2006 .

[7]  Ross T. Whitaker,et al.  Interactive, GPU-Based Level Sets for 3D Segmentation , 2003, MICCAI.

[8]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[9]  Lance Williams,et al.  Pyramidal parametrics , 1983, SIGGRAPH.

[10]  Benjamin Watson,et al.  Adaptive frameless rendering , 2005, EGSR '05.

[11]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[12]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[13]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[14]  S. Osher,et al.  A PDE-Based Fast Local Level Set Method 1 , 1998 .

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  S. Osher,et al.  A level set approach for computing solutions to incompressible two-phase flow , 1994 .

[17]  Guillermo Sapiro,et al.  Morphing Active Contours , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[19]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[20]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[21]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[22]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[23]  Guy Godin,et al.  Recursive model optimization using ICP and free moving 3D data acquisition , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[24]  Luc Van Gool,et al.  Real-time range scanning of deformable surfaces by adaptively coded structured light , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[25]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[26]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[27]  Ross T. Whitaker,et al.  A Streaming Narrow-Band Algorithm: Interactive Computation and Visualization of Level Sets , 2004, IEEE Trans. Vis. Comput. Graph..

[28]  Guy Godin,et al.  Accurate 3D acquisition of freely moving objects , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[29]  Dinesh Manocha,et al.  DiFi: Fast 3D Distance Field Computation Using Graphics Hardware , 2004, Comput. Graph. Forum.