Cloth Motion from Optical Flow

This paper presents an algorithm for capturing the motion of deformable surfaces, in particular textured cloth. In a calibrated multi-camera setup, the optical o w between consecutive video frames is determined and 3D scene o w is computed. We use a deformable surface model with constraints for vertex distances and curvature to increase the robustness of the optical o w measurements. Tracking errors in long video sequences are corrected by a silhouette matching procedure. We present results for synthetic cloth simulations and discuss how they can be extended to real-world footage.

[1]  Wolfgang Heidrich,et al.  Cloth Motion Capture , 2003, Comput. Graph. Forum.

[2]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[3]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[4]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[5]  David E. Breen,et al.  Cloth modeling and animation , 2000 .

[6]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[7]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Dave H. Eberly.  Game Physics , 2003 .

[9]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[10]  Michael G. Strintzis,et al.  Model-Based Joint Motion and Structure Estimation from Stereo Images , 1997, Comput. Vis. Image Underst..

[11]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[12]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[13]  William H. Press,et al.  Numerical recipes in C , 2002 .

[14]  Ronald Fedkiw,et al.  Simulation of clothing with folds and wrinkles , 2003, SCA '03.

[15]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[16]  Takeo Kanade,et al.  Three-dimensional scene flow , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jun Zhang,et al.  Flexible filaments in a flowing soap film as a model for one-dimensional flags in a two-dimensional wind , 2000, Nature.