Cloth capture

We present a method for capturing the geometry and parameterization of fastmoving cloth using multiple video cameras, without requiring camera calibration. Our cloth is printed with a multiscale pattern that allows capture at both high speed and high spatial resolution even though self-occlusion might block any individual camera from seeing the majority of the cloth. We show how to incorporate knowledge of this pattern into conventional structure from motion approaches, and use a novel scheme for camera calibration using the pattern, derived from the shape from texture literature. By combining strain minimization with the point reconstruction we produce visually appealing cloth sequences. We demonstrate our algorithm by capturing, retexturing and displaying several sequences of fast

[1]  Editors , 1986, Brain Research Bulletin.

[2]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[3]  M. Subbarad,et al.  Interpretation of Visual Motion: A Computational Study , 1988 .

[4]  Thomas S. Huang,et al.  Motion and structure from orthographic projections , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[5]  Xavier Provot,et al.  Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior , 1995 .

[6]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[7]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[8]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[9]  Leonid Zhukov,et al.  Direct Pattern Tracking On Flexible Geometry , 2002, WSCG.

[10]  Igor Guskov,et al.  Trackable surfaces , 2003, SCA '03.

[11]  Andrew P. Witkin,et al.  Untangling cloth , 2003, ACM Trans. Graph..

[12]  David Pritchard,et al.  Cloth Parameters and Motion Capture , 2003 .

[13]  Wolfgang Heidrich,et al.  Cloth Motion Capture , 2003, Comput. Graph. Forum.

[14]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[15]  Ronald Fedkiw,et al.  Simulation of clothing with folds and wrinkles , 2003, SCA '03.

[16]  David A. Forsyth,et al.  Recovering shape and irradiance maps from rich dense texton fields , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[17]  Volker Scholz,et al.  Cloth Motion from Optical Flow , 2004, VMV.

[18]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[19]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[20]  Ronald Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.

[21]  David A. Forsyth,et al.  Shape from Texture without Boundaries , 2002, International Journal of Computer Vision.