High-Resolution Object Deformation Reconstruction with Active Range Camera

This contribution discusses the 3D reconstruction of deformable freeform surfaces with high spatial and temporal resolution. These are conflicting requirements, since high-resolution surface scanners typically cannot achieve high temporal resolution, while high-speed range cameras like the Time-of-Flight (ToF) cameras capture depth at 25 fps but have a limited spatial resolution. We propose to combine a high-resolution surface scan with a ToF-camera and a color camera to achieve both requirements. The 3D surface deformation is modeled by a NURBS surface that approximates the object surface and estimates the 3D object motion and local 3D deformation from the ToF and color camera data. A set of few NURBS control points can faithfully model the motion and deformation and will be estimated from the ToF and color data with high accuracy. The contribution will focus on the estimation of the 3D deformation NURBS from the ToF and color data.

[1]  Francesca Odone,et al.  An open system for 3D data acquisition from multiple sensor , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[2]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[3]  Slobodan Ilic,et al.  Iterative mesh deformation for dense surface tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[4]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[5]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[6]  Johan Montagnat,et al.  A review of deformable surfaces: topology, geometry and deformation , 2001, Image Vis. Comput..

[7]  Hong Qin,et al.  Dynamic NURBS with geometric constraints for interactive sculpting , 1994, TOGS.

[8]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[9]  Alice Biber,et al.  Time-of-flight range imaging with a custom solid state image sensor , 1999, Industrial Lasers and Inspection.

[10]  Bernhard Schölkopf,et al.  Markerless 3D Face Tracking , 2009, DAGM-Symposium.

[11]  Fernand S. Cohen,et al.  Ordering and Parameterizing Scattered 3D Data for B-Spline Surface Approximation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Zenglin Xu,et al.  An Effective Approach to 3D Deformable Surface Tracking , 2008, ECCV.

[13]  Les A. Piegl,et al.  The NURBS book (2nd ed.) , 1997 .

[14]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.