Enhance Feature Representation of Dual Networks for Attribute Prediction

Traditional single branch CNN could not extract all the details of the input, which may lose some vital information, resulting in a decrease in recognition accuracy. In this paper, we propose a novel dual branch adversarial neural network named D-BANN. Inspired by adversarial learning, we drive parallel networks to extract complementary features and adopt a novel loss function to extend the application domain of the model. Moreover, we divide the network training procedure into multi-steps to alternatively optimize the loss functions. In order to evaluate the proposed method, we carry out comprehensive experiments on three attribute datasets. The results on facial attributes demonstrate that the proposed method can outperform other single task networks in face attribute recognition. Also, D-BANN achieves competitive results in two pedestrian datasets compared to the state-of-the-art multi-task methods. We visualize the D-BANN using Grad-CAM to verify the effectiveness of feature annotation.

[1]  Dorin Comaniciu,et al.  Deep Decision Network for Multi-class Image Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Gang Peng,et al.  D-PCN: Parallel Convolutional Neural Networks for Image Recognition in Reverse Adversarial Style , 2017, ArXiv.

[3]  Xinyu Ou,et al.  Improving person re-identification by multi-task learning , 2019, Multimedia Tools and Applications.

[4]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[5]  Robinson Piramuthu,et al.  HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Xu Liu,et al.  DualNet: Learn Complementary Features for Image Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Rama Chellappa,et al.  Attributes for Improved Attributes: A Multi-Task Network Utilizing Implicit and Explicit Relationships for Facial Attribute Classification , 2017, AAAI.

[8]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[9]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Gang Peng,et al.  Parallel Convolutional Networks for Image Recognition via a Discriminator , 2018, ACCV.

[11]  Subhransu Maji,et al.  Bilinear CNN Models for Fine-Grained Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).