Prediction of Anthropometric Data Based on Ladder Network

The inadequacy of training data is an acute contradiction in anthropometric data prediction. To address this problem, a novel anthropometric data prediction method based on Ladder network is proposed. On one hand, some volunteers in various pose are captured with RGB cameras, whose anthropometric data (e.g., chest circumference) are measured manually. On the other hand, a series of unlabeled sample data are collected through virtual human bodies. After segmenting human body silhouettes from the background, a semi-supervised network (e.g., Ladder network) can be trained to predict the ratio between anthropometric data and height. Therefore, anthropometric data of arbitrary human body can be inferred with height, which can be potentially used in 3D human modeling and clothing industry. Experiments show that our method can achieve acceptable results with limited training data.

[1]  Lin Wang,et al.  Single-View Dressed Human Modeling via Morphable Template , 2014, 2014 International Conference on Virtual Reality and Visualization.

[2]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[3]  Kunwoo Lee,et al.  Parametric human body shape modeling framework for human-centered product design , 2012, Comput. Aided Des..

[4]  Bernt Schiele,et al.  PoseTrack: A Benchmark for Human Pose Estimation and Tracking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Andrew Zisserman,et al.  Recurrent Human Pose Estimation , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[6]  Meekyoung Kim,et al.  Data-driven physics for human soft tissue animation , 2017, ACM Trans. Graph..

[7]  Juntao Ye,et al.  Modeling 3D human body with a smart vest , 2018, Comput. Graph..

[8]  Eun-Joo Park,et al.  Example-based statistical framework for parametric modeling of human body shapes , 2015, Comput. Ind..

[9]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Bernt Schiele,et al.  2D Human Pose Estimation: New Benchmark and State of the Art Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Stefano Corazza,et al.  Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Michael J. Black,et al.  The Naked Truth: Estimating Body Shape Under Clothing , 2008, ECCV.

[13]  Chen Long Extraction of feature parameters of three-dimensional human body based on image , 2010 .

[14]  Susu Yao,et al.  A Mixed Reality Virtual Clothes Try-On System , 2013, IEEE Transactions on Multimedia.

[15]  Hecht-Nielsen Theory of the backpropagation neural network , 1989 .

[16]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[17]  Dong Liu,et al.  Deep High-Resolution Representation Learning for Human Pose Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Chang Shu,et al.  Three-dimensional human shape inference from silhouettes: reconstruction and validation , 2011, Machine Vision and Applications.

[19]  Charlie C. L. Wang,et al.  Virtual human modeling from photographs for garment industry , 2003, Comput. Aided Des..

[20]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[21]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[22]  Michael J. Black,et al.  Shining a Light on Human Pose: On Shadows, Shading and the Estimation of Pose and Shape , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[23]  Jituo Li,et al.  Modeling 3D garments by examples , 2014, Comput. Aided Des..

[24]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[25]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[26]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[27]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..