Learning Physics Properties of Fabrics and Garments with a Physics Similarity Neural Network

In this paper, we propose to predict the physics parameters of real fabrics and garments by learning their physics similarities between simulated fabrics via a Physics Similarity Network (PhySNet). For this, we estimate wind speeds generated by an electric fan and the area weight to predict bending stiffness of simulated and real fabrics and garments. We found that PhySNet coupled with a Bayesian optimiser can predict physics parameters and improve the state-of-art by 34% for real fabrics and 68% for real garments. © 2021 Elsevier Ltd. All rights reserved.

[1]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[2]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[3]  K. Bowman.  Mechanical Behavior of Materials , 2003 .

[4]  James F. O'Brien,et al.  Adaptive anisotropic remeshing for cloth simulation , 2012, ACM Trans. Graph..

[5]  Ming C. Lin,et al.  Learning-Based Cloth Material Recovery from Video , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Belhassen-Chedli Bouzgarrou,et al.  Model-based strategy for grasping 3D deformable objects using a multi-fingered robotic hand , 2017, Robotics Auton. Syst..

[7]  Daniel R. Jiang,et al.  BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimization , 2020, NeurIPS.

[8]  Arnold W.M. Smeulders,et al.  Cloth in the Wind: A Case Study of Physical Measurement Through Simulation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Roland Hess,et al.  Blender Foundations: The Essential Guide to Learning Blender 2.6 , 2010 .

[10]  Li Sun,et al.  Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[12]  Jeremy L. Wyatt,et al.  A Multimodal Model of Object Deformation Under Robotic Pushing , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[13]  Yan-Bin Jia,et al.  Picking up a soft 3D object by “feeling” the grip , 2015, Int. J. Robotics Res..

[14]  F. Karray,et al.  Fisher Discriminant Triplet and Contrastive Losses for Training Siamese Networks , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[15]  William T. Freeman,et al.  Estimating the Material Properties of Fabric from Video , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, ACM Trans. Graph..

[17]  Danica Kragic,et al.  Estimating deformability of objects using meshless shape matching , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Maud Marchal,et al.  Simultaneous Tracking and Elasticity Parameter Estimation of Deformable Objects , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Masatoshi Ishikawa,et al.  Simple Model and Deformation Control of a Flexible Rope using Constant, High-Speed Motion of a Robot Arm , 2012, 2012 IEEE International Conference on Robotics and Automation.

[20]  Trevor Darrell,et al.  A geometric approach to robotic laundry folding , 2012, Int. J. Robotics Res..

[21]  Wolfgang Schwanghart,et al.  TopoToolbox: A set of Matlab functions for topographic analysis , 2010, Environ. Model. Softw..

[22]  J. Tenenbaum,et al.  A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects , 2020, CoRL.