A method of state recognition of dressing clothes based on dynamic state matching

This paper describes a method of clothing recognition using dynamic state matching. One purpose of this research is to develop a function that is used to observe the progress of dressing a bottom at a toilet or a bedside. In this dressing, although we just have to do is to put my or others' legs on the bottom. some undesirable situations may occur. For instance, the feet gets hung up on the part of the bottom, and so on. Assuming to use a single camera, we propose a method that distinguishes whether or not a behavior of dressing a bottom is working in order. The input data is an image stream that captures a dressing sequence. Optical flow is calculated from two consecutive images, and then the distribution of the flows is used to distinguish the present clothing state by matching the optical flow with training dataset. The method outputs whether or not the present clothing is in a successful situation. The effectiveness of the proposed method was proven by means of real image data.

[1]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Nobuyuki Kita,et al.  A deformable model driven visual method for handling clothes , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[4]  Hitoshi Akami,et al.  Robot Hand with a Sensor for Cloth Handling , 1989 .

[5]  Hitoshi Akami,et al.  Robot hand with sensor for handling cloth , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[6]  Pieter Abbeel,et al.  Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Takamitsu Matsubara,et al.  Reinforcement learning of a motor skill for wearing a T-shirt using topology coordinates , 2013, Adv. Robotics.

[8]  Masayoshi Kakikura,et al.  Planning strategy for unfolding task of clothes - isolation of clothes from washed mass , 1996, Proceedings of the 35th SICE Annual Conference. International Session Papers.

[9]  Hiroaki Seki,et al.  Unfolding of Massive Laundry and Classification Types by Dual Manipulator , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[10]  Nobuyuki Kita,et al.  A deformable model driven method for handling clothes , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Eric Wahl,et al.  Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[12]  A. Shumway-cook,et al.  Managing activity difficulties at home: a survey of Medicare beneficiaries. , 2008, Archives of physical medicine and rehabilitation.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Ian D. Walker,et al.  Classification of clothing using interactive perception , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  P. Kohli,et al.  Efficiently solving dynamic Markov random fields using graph cuts , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.