Fashion pose machine for fashion landmark detection

Combined with deep learning technologies, fashion landmark detection is an efficient method for visual fashion analysis. Existing works mainly focus on eliminating the effect of scale and background, and require prior knowledge of body structure. In this paper, we propose a fashion pose machine which is based on the location method of the landmark for human posture estimation. To increase the accuracy of fashion detection, we utilize convolutional neural network to learn the spatial structure among fashion landmarks in sequential prediction framework, which can eliminate the effect of the clothing placement and model posture on fashion landmark in the image. Our method does not require any prior knowledge of human body structure to learn the dependencies between different landmarks. We evaluated our model on the dataset of FashionAI, and the result showed that our model is 25% better than the state-of-the-art alternative.

[1]  Jen-Hao Hsiao,et al.  Deep learning of binary hash codes for fast image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Xiaogang Wang,et al.  Unconstrained Fashion Landmark Detection via Hierarchical Recurrent Transformer Networks , 2017, ACM Multimedia.

[3]  Jian Dong,et al.  Deep domain adaptation for describing people based on fine-grained clothing attributes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Xiaogang Wang,et al.  DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Varun Ramakrishna,et al.  Pose Machines: Articulated Pose Estimation via Inference Machines , 2014, ECCV.

[6]  Alexander C. Berg,et al.  Hipster Wars: Discovering Elements of Fashion Styles , 2014, ECCV.

[7]  Xiaogang Wang,et al.  Fashion Landmark Detection in the Wild , 2016, ECCV.

[8]  Song-Chun Zhu,et al.  Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Huizhong Chen,et al.  Describing Clothing by Semantic Attributes , 2012, ECCV.