Animating human dressing

Dressing is one of the most common activities in human society. Perfecting the skill of dressing can take an average child three to four years of daily practice. The challenge is primarily due to the combined difficulty of coordinating different body parts and manipulating soft and deformable objects (clothes). We present a technique to synthesize human dressing by controlling a human character to put on an article of simulated clothing. We identify a set of primitive actions which account for the vast majority of motions observed in human dressing. These primitive actions can be assembled into a variety of motion sequences for dressing different garments with different styles. Exploiting both feed-forward and feedback control mechanisms, we develop a dressing controller to handle each of the primitive actions. The controller plans a path to achieve the action goal while making constant adjustments locally based on the current state of the simulated cloth when necessary. We demonstrate that our framework is versatile and able to animate dressing with different clothing types including a jacket, a pair of shorts, a robe, and a vest. Our controller is also robust to different cloth mesh resolutions which can cause the cloth simulator to generate significantly different cloth motions. In addition, we show that the same controller can be extended to assistive dressing.

[1]  Kazuhiro Kosuge,et al.  Manipulation of a flexible object by dual manipulators , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[2]  Zhiwei Luo,et al.  Adaptive hybrid control of manipulators on uncertain flexible objects , 1995, Adv. Robotics.

[3]  Zoe Doulgeri,et al.  Robot handling of flat textile materials , 1997, IEEE Robotics Autom. Mag..

[4]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[5]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[6]  Joris S. M. Vergeest,et al.  Combining deformable- and rigid-body mechanics simulation , 2001, The Visual Computer.

[7]  Shuuji Kajita,et al.  Pushing manipulation by humanoid considering two-kinds of ZMPs , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[8]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, ACM Trans. Graph..

[9]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[10]  Eiichi Yoshida,et al.  Humanoid motion planning for dynamic tasks , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[11]  Tatsuo Arai,et al.  Pushing an Object Considering the Hand Reflect Forces by Humanoid Robot in Dynamic Walking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[12]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, SIGGRAPH 2005.

[13]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[14]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, ACM Trans. Graph..

[15]  Satoshi Kagami,et al.  Motion Control System that Realizes Physical Interaction between Robot's Hands and Environment during Walk , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[16]  C. Karen Liu,et al.  Composition of complex optimal multi-character motions , 2006, SCA '06.

[17]  Ronald Fedkiw,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Hybrid Simulation of Deformable Solids , 2022 .

[18]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[19]  Ronald Fedkiw,et al.  Two-way coupling of rigid and deformable bodies , 2008, SCA '08.

[20]  D. Thalmann,et al.  Planning collision-free reaching motions for interactive object manipulation and grasping , 2008, SIGGRAPH '08.

[21]  Eitan Grinspun,et al.  Robust treatment of simultaneous collisions , 2008, ACM Trans. Graph..

[22]  Jehee Lee,et al.  Synchronized multi-character motion editing , 2009, ACM Trans. Graph..

[23]  Taku Komura,et al.  Character Motion Synthesis by Topology Coordinates , 2009, Comput. Graph. Forum.

[24]  Markus H. Gross,et al.  Implicit Contact Handling for Deformable Objects , 2009, Comput. Graph. Forum.

[25]  Edmond S. L. Ho,et al.  Spatial relationship preserving character motion adaptation , 2010, ACM Trans. Graph..

[26]  Taku Komura,et al.  Spatial relationship preserving character motion adaptation , 2010, SIGGRAPH 2010.

[27]  Dinesh Manocha,et al.  Fast continuous collision detection using deforming non-penetration filters , 2010, I3D '10.

[28]  James F. O'Brien,et al.  Bringing clothing into desired configurations with limited perception , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Eder Miguel EFFICIENT SIMULATION OF CONTACT BETWEEN RIGID AND DEFORMABLE OBJECTS , 2011 .

[30]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, ACM Trans. Graph..

[31]  Takamitsu Matsubara,et al.  Reinforcement learning of clothing assistance with a dual-arm robot , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[32]  Sören Kammel,et al.  Bimanual robotic cloth manipulation for laundry folding , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  James F. O'Brien,et al.  Adaptive anisotropic remeshing for cloth simulation , 2012, ACM Trans. Graph..

[34]  Taku Komura,et al.  Manipulation of Flexible Objects by Geodesic Control , 2012, Comput. Graph. Forum.

[35]  Trevor Darrell,et al.  A geometric approach to robotic laundry folding , 2012, Int. J. Robotics Res..

[36]  C. Karen Liu,et al.  Synthesis of detailed hand manipulations using contact sampling , 2012, ACM Trans. Graph..

[37]  Jinxiang Chai,et al.  Robust realtime physics-based motion control for human grasping , 2013, ACM Trans. Graph..

[38]  James F. O'Brien,et al.  Folding and crumpling adaptive sheets , 2013, ACM Trans. Graph..

[39]  Taku Komura,et al.  Harmonic parameterization by electrostatics , 2013, TOGS.

[40]  Qionghai Dai,et al.  Video-based hand manipulation capture through composite motion control , 2013, ACM Trans. Graph..

[41]  Tae-Yong Kim,et al.  Unified particle physics for real-time applications , 2014, ACM Trans. Graph..

[42]  C. Karen Liu,et al.  Dexterous manipulation using both palm and fingers , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[43]  C. Karen Liu,et al.  Coupling cloth and rigid bodies for dexterous manipulation , 2014, MIG.