Coupling cloth and rigid bodies for dexterous manipulation

This paper introduces a new simulation technique to enable detailed dexterous manipulation of cloth. Without reimplementation or substantial modification, existing cloth simulators can only be used to approximate limited interaction between cloth and rigid bodies due to the incorrect computation of contact forces. For example, a simple scenario of two fingers pinching a piece of cloth often results in the cloth slipping out of the hand. Our technique provides a simple solution to cloth-rigid coupling using existing cloth and rigid body simulators as-is. We develop a light-weight interface so that the rigid body and cloth simulators communicate on a demand-driven manner to achieve two main goals: allow the rigid bodies to impart friction forces to the cloth and avoid unsolvable collision situations between the rigid bodies and the cloth. We demonstrate a set of basic manipulation skills including gripping, pinching, and pressing, that are frequently seen in daily activities such as dressing and folding clothes.

[1]  Doug L. James,et al.  Efficient yarn-based cloth with adaptive contact linearization , 2010, ACM Trans. Graph..

[2]  David Harmon,et al.  Robust treatment of simultaneous collisions , 2008, SIGGRAPH 2008.

[3]  Zoe Doulgeri,et al.  Robot handling of flat textile materials , 1997, IEEE Robotics Autom. Mag..

[4]  Jinxiang Chai,et al.  Robust realtime physics-based motion control for human grasping , 2013, ACM Trans. Graph..

[5]  Andrew P. Witkin,et al.  Untangling cloth , 2003, ACM Trans. Graph..

[6]  Eitan Grinspun,et al.  Speculative parallel asynchronous contact mechanics , 2012, ACM Trans. Graph..

[7]  Ronald Fedkiw,et al.  Simulation of clothing with folds and wrinkles , 2003, SCA '03.

[8]  Erik Millán,et al.  Impostors, Pseudo-instancing and Image Maps for GPU Crowd Rendering , 2007, Int. J. Virtual Real..

[9]  Eder Miguel EFFICIENT SIMULATION OF CONTACT BETWEEN RIGID AND DEFORMABLE OBJECTS , 2011 .

[10]  Sören Kammel,et al.  Bimanual robotic cloth manipulation for laundry folding , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Dinesh Manocha,et al.  Fast continuous collision detection using deforming non-penetration filters , 2010, I3D '10.

[12]  Trevor Darrell,et al.  A geometric approach to robotic laundry folding , 2012, Int. J. Robotics Res..

[13]  C. Karen Liu,et al.  Dexterous manipulation using both palm and fingers , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  D. Stewart,et al.  AN IMPLICIT TIME-STEPPING SCHEME FOR RIGID BODY DYNAMICS WITH INELASTIC COLLISIONS AND COULOMB FRICTION , 1996 .

[15]  James F. O'Brien,et al.  Bringing clothing into desired configurations with limited perception , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Markus H. Gross,et al.  Implicit Contact Handling for Deformable Objects , 2009, Comput. Graph. Forum.

[17]  James F. O'Brien,et al.  Folding and crumpling adaptive sheets , 2013, ACM Trans. Graph..

[18]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, SIGGRAPH 2011.

[19]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, SIGGRAPH 2005.

[20]  Qionghai Dai,et al.  Video-based hand manipulation capture through composite motion control , 2013, ACM Trans. Graph..

[21]  Karen Liu Dynamic Animation and Robotics Toolkit , 2014 .

[22]  Ronald Fedkiw,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Hybrid Simulation of Deformable Solids , 2022 .

[23]  C. Karen Liu,et al.  Dextrous manipulation from a grasping pose , 2009, ACM Trans. Graph..

[24]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[25]  Eitan Grinspun,et al.  Robust treatment of simultaneous collisions , 2008, ACM Trans. Graph..

[26]  James F. O'Brien,et al.  Fast simulation of mass-spring systems , 2013, ACM Trans. Graph..

[27]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, ACM Trans. Graph..

[28]  Massimo Bergamasco,et al.  From Physics-based Simulation to the Touching of Textiles: The HAPTEX Project , 2007, Int. J. Virtual Real..

[29]  Dinesh K. Pai,et al.  Staggered projections for frictional contact in multibody systems , 2008, SIGGRAPH Asia '08.

[30]  Joris S. M. Vergeest,et al.  Combining deformable- and rigid-body mechanics simulation , 2001, The Visual Computer.

[31]  Ronald Fedkiw,et al.  Two-way coupling of rigid and deformable bodies , 2008, SCA '08.

[32]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, ACM Trans. Graph..

[33]  James F. O'Brien,et al.  Adaptive anisotropic remeshing for cloth simulation , 2012, ACM Trans. Graph..

[34]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[35]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[36]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[37]  Matthias Müller,et al.  Position based dynamics , 2007, J. Vis. Commun. Image Represent..

[38]  山田 祐,et al.  Open Dynamics Engine を用いたスノーボードロボットシミュレータの開発 , 2007 .

[39]  Kazuhiro Kosuge,et al.  Manipulation of a flexible object by dual manipulators , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[40]  Zhiwei Luo,et al.  Adaptive hybrid control of manipulators on uncertain flexible objects , 1995, Adv. Robotics.

[41]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[42]  David Harmon,et al.  Asynchronous contact mechanics , 2009, SIGGRAPH 2009.

[43]  Ronald Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.

[44]  Matthias Müller,et al.  Position based dynamics , 2007, J. Vis. Commun. Image Represent..

[45]  Mathieu Desbrun,et al.  Discrete shells , 2003, SCA '03.

[46]  Eitan Grinspun,et al.  Asynchronous contact mechanics , 2009, ACM Trans. Graph..

[47]  Dinesh K. Pai,et al.  A unified treatment of elastostatic contact simulation for real time haptics , 2005, SIGGRAPH Courses.

[48]  Steve Marschner,et al.  Efficient yarn-based cloth with adaptive contact linearization , 2010, SIGGRAPH 2010.

[49]  C. Karen Liu,et al.  Synthesis of detailed hand manipulations using contact sampling , 2012, ACM Trans. Graph..