A Novel Face Attribute Segmentation Algorithm

We propose a novel segmentation algorithm for face attribute segmentation with a fully convolutional encoder-decoder network. Our network is trained end-to-end on Helen dataset, and optimizes by minimizing two loss functions: the L1 loss and the negative-log-likelihood. Strategies such as transfer learning, dilated convolution, skip layer are used to improve network accuracy. We also add maximum connected region extraction (MCRE) to the output of the network, and show that these strategies have significantly improved the network performance. The experimental results show that the network has obtained F-Measure 0.872 on the Helen dataset, which yielding higher score in facial segmentation than previous methods. Moreover, our algorithm also achieves a good visual segmentation effect on other images outside the dataset, which demonstrate strong generalization performance of the proposed algorithm.

[1]  Ming-Hsuan Yang,et al.  Multi-objective convolutional learning for face labeling , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[4]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[5]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  W. Marsden I and J , 2012 .

[10]  Thomas S. Huang,et al.  Interactive Facial Feature Localization , 2012, ECCV.

[11]  Honglak Lee,et al.  Object Contour Detection with a Fully Convolutional Encoder-Decoder Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Arati Dandavate,et al.  Semantic Texton Forests for Image Categorization and Segmentation , 2018, IJARCCE.

[13]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[14]  Zhe L. Lin,et al.  Exemplar-Based Face Parsing , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.