Real-time, automatic shape-changing robot adjustment and gender classification

This paper introduces the results of novel theoretical and practical studies aimed at providing automatic and accurate real-time activation and adjustment of shape-changing robots in accord to the shape of the body of the user. The proposed method consists of scanning, classifying the instances according to gender and size, performing analysis on both the user’s body and the prospective garment, which is be virtually fitted, modelling, extracting measurements and assigning reference points on them, segmenting the 3D visual data imported from the shape-changing robot, and finally, superimposing, adopting and depicting the resulting garment model on the user’s body. The estimation process of the positions of the moving actuators for adjusting the shape-changing robots tries to determine which input values could result in the closest representation of the desired sizes and distances through devising the mathematical description of a map relating them to each other. In order to classify the data obtained by the 3D scanner, first maximum likelihood function is used for selecting one of the shape-changing robots, according to the presumed gender and size, to be activated, and subsequently, support vector machine is utilized so as to find out which shape template from the dictionary best matches the scanning instance being considered. As a use case, the proposed method is applied to the visual data obtained by scanning Fits.me’s shape-changing robots using 3D laser scanner. The methods currently used are manual, whereas the proposed method is automatic and the experimental results show that it is the accurate and reliable.

[1]  Masaki Izutsu,et al.  Estimation Method of Clothes Size for Virtual Fitting Room with Kinect Sensor , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[2]  Zhentai Lu,et al.  Hybrid elastic registration using constrained free-form deformation , 2010, 2010 International Conference of Medical Image Analysis and Clinical Application.

[3]  Maarja Kruusmaa,et al.  Design of a shape-changing anthropomorphic mannequin for tailoring applications , 2009, 2009 International Conference on Advanced Robotics.

[4]  Kai Liu,et al.  A Method of 3D Garment Model Generation Using Sketchy Contours , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[5]  Clément Gosselin,et al.  Kinematic-Sensitivity Indices for Dimensionally Nonhomogeneous Jacobian Matrices , 2010, IEEE Transactions on Robotics.

[6]  Maarja Kruusmaa,et al.  Shape Control of an anthropomorphic Tailoring Robot mannequin , 2013, Int. J. Humanoid Robotics.

[7]  Robert Bogue Shape changing and self-reconfiguring robots , 2015, Ind. Robot.

[8]  Rong Li,et al.  Research of Interactive 3D Virtual Fitting Room on Web Environment , 2011, 2011 Fourth International Symposium on Computational Intelligence and Design.

[9]  Robin De Keyser,et al.  Robustness evaluation of fractional order control for varying time delay processes , 2012, Signal Image Video Process..

[10]  Mohamed-Chaker Larabi,et al.  Color calibration of multi-view video plus depth for advanced 3D video , 2015, Signal Image Video Process..

[11]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[12]  Mário Alves,et al.  Virtual Fitting Room Augmented Reality Techniques for e-Commerce , 2011, CENTERIS.

[13]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[14]  Rodney A. Brooks,et al.  Humanoid robots , 2002, CACM.

[15]  Stephen Lin,et al.  Image-based clothes animation for virtual fitting , 2012, SIGGRAPH Asia Technical Briefs.

[16]  Hassan Foroosh,et al.  Single-class SVM for dynamic scene modeling , 2013, Signal Image Video Process..

[17]  Sergio Escalera,et al.  A new retexturing method for virtual fitting room using Kinect 2 camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Ieee Staff,et al.  2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG) , 2013 .

[19]  Ligang Liu,et al.  A Local/Global Approach to Mesh Parameterization , 2008, Comput. Graph. Forum.

[20]  Parag Chaudhuri,et al.  Virtual garment simulation , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[21]  Daniel Thalmann,et al.  Dressing animated synthetic actors with complex deformable clothes , 1992, SIGGRAPH.

[22]  Paolo Fiorini,et al.  Simulation of deformable environment with haptic feedback on GPU , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Nadia Magnenat-Thalmann,et al.  The MIRACloth Software , 2000 .

[24]  Charlie C. L. Wang,et al.  Feature based 3D garment design through 2D sketches , 2003, Comput. Aided Des..

[25]  Adel Al-Jumaily,et al.  Bio-driven system-based virtual reality for prosthetic and rehabilitation systems , 2012, Signal Image Video Process..

[26]  Gholamreza Anbarjafari,et al.  Size-Dictionary Interpolation for Robot’s Adjustment , 2015, Front. Bioeng. Biotechnol..

[27]  Nadia Magnenat-Thalmann,et al.  A body and Garment Creation Method for an Internet Based Virtual Fitting Room. , 2002 .

[28]  Victor E. Kuzmichev,et al.  Human-Friendly Design of Virtual System “female Body-dress” , 2015 .

[29]  Farbod Razzazi,et al.  Spatio-temporal 3D surface matching for hand gesture recognition using ICP algorithm , 2015, Signal Image Video Process..

[30]  Mehdi Tale Masouleh,et al.  Kinematic sensitivity and workspace optimization of planar parallel mechanisms using evolutionary techniques , 2013, 2013 First RSI/ISM International Conference on Robotics and Mechatronics (ICRoM).

[31]  Jian Xie,et al.  Foldover-Free Mesh Warping for Constrained Texture Mapping , 2015, IEEE Transactions on Visualization and Computer Graphics.