GRNet: An Efficient Group Ranking Network for Face Attribute Recognition

Face attribute recognition methods have been far from real-world applications despite remarkable progress in recent years. Most of these methods fail to mine attribute relationships with traditional cross entropy loss and hold considerable computational complexity. In this work, we propose a group ranking network (GRNet) to investigate substantial relationships among face attributes. First, an attribute grouping manner is designed to capture interactions among spatially related attributes and enhance computational efficiency. Second, a new supervision signal is presented to model attribute ranking relationships. Under the supervision of ranking loss, GRNet learns intra-attribute and inter-attribute ranking features to intensify the representational capability of attribute models. We evaluate our approach on aligned and unaligned CelebA datasets. Results show that the performance of the proposed approach is superior to other start-of-the-art methods on attribute recognition.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Rama Chellappa,et al.  Segment-Based Methods for Facial Attribute Detection from Partial Faces , 2018, IEEE Transactions on Affective Computing.

[3]  Rama Chellappa,et al.  Attributes for Improved Attributes: A Multi-Task Network Utilizing Implicit and Explicit Relationships for Facial Attribute Classification , 2017, AAAI.

[4]  Yangqing Jia,et al.  Deep Convolutional Ranking for Multilabel Image Annotation , 2013, ICLR.

[5]  Terrance E. Boult,et al.  MOON: A Mixed Objective Optimization Network for the Recognition of Facial Attributes , 2016, ECCV.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Rama Chellappa,et al.  A Deep Cascade Network for Unaligned Face Attribute Classification , 2017, AAAI.

[9]  Fei Su,et al.  Joint multi-feature fusion and attribute relationships for facial attribute prediction , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[10]  Feiyue Huang,et al.  Harnessing Synthesized Abstraction Images to Improve Facial Attribute Recognition , 2018, IJCAI.

[11]  Boqing Gong,et al.  Improving Facial Attribute Prediction Using Semantic Segmentation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jie Li,et al.  Deep Attribute Guided Representation for Heterogeneous Face Recognition , 2018, IJCAI.

[13]  Yongxin Yang,et al.  Attribute-Enhanced Face Recognition with Neural Tensor Fusion Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Yale Song,et al.  Improving Pairwise Ranking for Multi-label Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jason Weston,et al.  WSABIE: Scaling Up to Large Vocabulary Image Annotation , 2011, IJCAI.

[16]  Xin Yu,et al.  Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Xiaoou Tang,et al.  Learning Deep Representation for Face Alignment with Auxiliary Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jun Yu,et al.  General-to-specific learning for facial attribute classification in the wild , 2018, J. Vis. Commun. Image Represent..