Estimating cloth simulation parameters from video

Cloth simulations are notoriously difficult to tune due to the many parameters that must be adjusted to achieve the look of a particular fabric. In this paper, we present an algorithm for estimating the parameters of a cloth simulation from video data of real fabric. A perceptually motivated metric based on matching between folds is used to compare video of real cloth with simulation. This metric compares two video sequences of cloth and returns a number that measures the differences in their folds. Simulated annealing is used to minimize the frame by frame error between the metric for a given simulation and the real-world footage. To estimate all the cloth parameters, we identify simple static and dynamic calibration experiments that use small swatches of the fabric. To demonstrate the power of this approach, we use our algorithm to find the parameters for four different fabrics. We show the match between the video footage and simulated motion on the calibration experiments, on new video sequences for the swatches, and on a simulation of a full skirt.

[1]  F. T. Peirce.  The geometry of cloth structure , 1937 .

[2]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[3]  川端 季雄,et al.  The standardization and analysis of hand evaluation. , 1975 .

[4]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[5]  C. Frohlich.  Aerodynamic drag crisis and its possible effect on the flight of baseballs , 1984 .

[6]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[7]  William H. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[8]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[9]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[10]  William H. Press,et al.  Numerical recipes , 1990 .

[11]  D. Acheson.  Elementary Fluid Dynamics , 1990 .

[12]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Alex Pentland,et al.  Generalized implicit functions for computer graphics , 1991, SIGGRAPH.

[14]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[15]  P. Volino,et al.  Efficient self‐collision detection on smoothly discretized surface animations using geometrical shape regularity , 1994 .

[16]  David E. Breen,et al.  Predicting the drape of woven cloth using interacting particles , 1994, SIGGRAPH.

[17]  Nadia Magnenat-Thalmann,et al.  Efficient Self-Collision Detection on Smoothly Discretized Surface Animations using Geometrical Shape Regularity , 1994, Comput. Graph. Forum.

[18]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[19]  Xavier Provot,et al.  Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior , 1995 .

[20]  Nadia Magnenat-Thalmann,et al.  Versatile and efficient techniques for simulating cloth and other deformable objects , 1995, SIGGRAPH.

[21]  David E. Breen,et al.  Towards simulating cloth dynamics using interacting particles , 1996 .

[22]  Tomas Akenine-Möller,et al.  A Fast Triangle-Triangle Intersection Test , 1997, J. Graphics, GPU, & Game Tools.

[23]  Xavier Provot,et al.  Collision and self-collision handling in cloth model dedicated to design garments , 1997, Computer Animation and Simulation.

[24]  David A. Forsyth,et al.  Shading primitives: finding folds and shallow grooves , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Uri M. Ascher,et al.  Computer methods for ordinary differential equations and differential-algebraic equations , 1998 .

[26]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[27]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[28]  David E. Breen,et al.  Cloth modeling and animation , 2000 .

[29]  Li Ling,et al.  Aerodynamic effects , 2000 .

[30]  Nadia Magnenat-Thalmann,et al.  Accurate collision response on polygonal meshes , 2000, Proceedings Computer Animation 2000.

[31]  Lorenzo Torresani,et al.  Tracking and modeling non-rigid objects with rank constraints , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[32]  Norman I. Badler,et al.  Collision resolutions in cloth simulation , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[33]  Tomas Akenine-Möller,et al.  Collision Detection for Continuously Deforming Bodies , 2001, Eurographics.

[34]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[35]  Timothy John Lahey,et al.  Modelling Hysteresis in the Bending of Fabrics , 2002 .

[36]  Kwang-Jin Choi,et al.  Stable but responsive cloth , 2002, SIGGRAPH 2002.

[37]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[38]  Andrew P. Witkin,et al.  Untangling cloth , 2003, ACM Trans. Graph..

[39]  Ronald Fedkiw,et al.  Simulation of clothing with folds and wrinkles , 2003, SCA '03.

[40]  Kiriakos N. Kutulakos,et al.  Multi-View Scene Capture by Surfel Sampling: From Video Streams to Non-Rigid 3D Motion, Shape and Reflectance , 2002, International Journal of Computer Vision.

[41]  Ronald Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.