Cloth Motion Capture

Recent years have seen an increased interest in motion capture systems. Current systems, however, are limitedto only a few degrees of freedom, so that effectively only the motion of linked rigid bodies can be acquired. Wepresent a system for the capture of deformable surfaces, most notably moving cloth, including both geometry andparameterisation. We recover geometry using stereo correspondence, and use the Scale Invariant Feature Transform(SIFT) to identify an arbitrary pattern printed on the cloth, even in the presence of fast motion. We describea novel seed‐and‐grow approach to adapt the SIFT algorithm to deformable geometry. Finally, we interpolatefeature points to parameterise the complete geometry.

[1]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[2]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  David A. Forsyth,et al.  Shading primitives: finding folds and shallow grooves , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  Andrew Gardner,et al.  A lighting reproduction approach to live-action compositing , 2002, SIGGRAPH.

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Igor Guskov,et al.  Efficient tracking of regular patterns on non-rigid geometry , 2002, Object recognition supported by user interaction for service robots.

[7]  Ronald Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.

[8]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[9]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Bruno Lévy,et al.  Non-distorted texture mapping for sheared triangulated meshes , 1998, SIGGRAPH.

[11]  Leonid Zhukov,et al.  Direct Pattern Tracking On Flexible Geometry , 2002, WSCG.

[12]  Kwang-Jin Choi,et al.  Stable but responsive cloth , 2002, SIGGRAPH 2002.