Regression Facial Attribute Classification via simultaneous dictionary learning

Recently, many researchers have attempted to classify Facial Attributes (FAs) by representing characteristics of FAs such as attractiveness, age, smiling and so on. In this context, recent studies have demonstrated that visual FAs are a strong background for many applications such as face verification, face search and so on. However, Facial Attribute Classification (FAC) in a wide range of attributes based on the regression representation -predicting of FAs as real-valued labels- is still a significant challenge in computer vision and psychology. In this paper, a regression model formulation is proposed for FAC in a wide range of FAs (e.g. 73 FAs). The proposed method accommodates real-valued scores to the probability of what percentage of the given FAs is present in the input image. To this end, two simultaneous dictionary learning methods are proposed to learn the regression and identity feature dictionaries simultaneously. Accordingly, a multi-level feature extraction is proposed for FAC. Then, four regression classification methods are proposed using a regression model formulated based on dictionary learning, SRC and CRC. Convincing results are acquired to handle a wide range of FAs and represent the probability of FAs on the PubFig, LFW, Groups and 10k US Adult Faces databases compared to several state-of-the-art methods. This paper proposes a method for regression facial attributes classification.We propose two simultaneous optimization problems for Facial Attribute Classification.A multilevel feature extraction method was proposed to discriminate the facial features.Promising results were obtained to classify facial attributes on the PubFig, Groups, 10k US adult and LFW databases.

[1]  Karim Faez,et al.  Makeup-Invariant Face Recognition by 3D Face: Modeling and Dual-Tree Complex Wavelet Transform from Women's 2D Real-World Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[2]  Claudio A. Perez,et al.  Gender Classification Based on Fusion of Different Spatial Scale Features Selected by Mutual Information From Histogram of LBP, Intensity, and Shape , 2013, IEEE Transactions on Information Forensics and Security.

[3]  Karim Faez,et al.  Unconstrained pose-invariant face recognition by a triplet collaborative dictionary matrix , 2015, Pattern Recognit. Lett..

[4]  Changsheng Li,et al.  Learning ordinal discriminative features for age estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Xiaoming Liu,et al.  Demographic Estimation from Face Images: Human vs. Machine Performance , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Daniel González-Jiménez,et al.  Single- and cross- database benchmarks for gender classification under unconstrained settings , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[7]  Terrance E. Boult,et al.  Multi-attribute spaces: Calibration for attribute fusion and similarity search , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  A. Moeini,et al.  Pose-invariant gender classification based on 3D face reconstruction and synthesis from single 2D image , 2015 .

[9]  Ioan Marius Bilasco,et al.  Boosting gender recognition performance with a fuzzy inference system , 2015, Expert Syst. Appl..

[10]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[12]  Tal Hassner,et al.  Age and Gender Estimation of Unfiltered Faces , 2014, IEEE Transactions on Information Forensics and Security.

[13]  Anil K. Jain,et al.  Suspect identification based on descriptive facial attributes , 2014, IEEE International Joint Conference on Biometrics.

[14]  Andrew C. Gallagher,et al.  Understanding images of groups of people , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[16]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[17]  Dao-Qing Dai,et al.  Face Recognition Using Dual-Tree Complex Wavelet Features , 2009, IEEE Transactions on Image Processing.

[18]  Andrew W. Fitzgibbon,et al.  Efficient Object Category Recognition Using Classemes , 2010, ECCV.

[19]  David S. Bolme,et al.  Discriminating projections for estimating face age in wild images , 2014, IEEE International Joint Conference on Biometrics.

[20]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Trevor Darrell,et al.  PANDA: Pose Aligned Networks for Deep Attribute Modeling , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[24]  Jordi Vitrià,et al.  Gender Recognition in Non Controlled Environments , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[25]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Song-Chun Zhu,et al.  Human Attribute Recognition by Rich Appearance Dictionary , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Hao Su,et al.  Object Bank: A High-Level Image Representation for Scene Classification & Semantic Feature Sparsification , 2010, NIPS.

[28]  Wilma A. Bainbridge,et al.  The intrinsic memorability of face photographs. , 2013, Journal of experimental psychology. General.

[29]  Domingo Mery,et al.  Automatic facial attribute analysis via adaptive sparse representation of random patches , 2015, Pattern Recognit. Lett..

[30]  Hao Su,et al.  Objects as Attributes for Scene Classification , 2010, ECCV Workshops.

[31]  Ali Moeini,et al.  Real-World and Rapid Face Recognition Toward Pose and Expression Variations via Feature Library Matrix , 2015, IEEE Transactions on Information Forensics and Security.

[32]  Shree K. Nayar,et al.  FaceTracer: A Search Engine for Large Collections of Images with Faces , 2008, ECCV.

[33]  Xiaogang Wang,et al.  A Deep Sum-Product Architecture for Robust Facial Attributes Analysis , 2013, 2013 IEEE International Conference on Computer Vision.

[34]  Roberto Paredes,et al.  Local Deep Neural Networks for gender recognition , 2016, Pattern Recognit. Lett..

[35]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[37]  Ali Farhadi,et al.  Describing objects by their attributes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Marios Savvides,et al.  3-D Generic Elastic Models for Fast and Texture Preserving 2-D Novel Pose Synthesis , 2012, IEEE Transactions on Information Forensics and Security.

[39]  Sven Behnke,et al.  Large-scale object recognition with CUDA-accelerated hierarchical neural networks , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[40]  Maher Awad,et al.  Age and gender recognition using informative features of various types , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[41]  Donald E. Knuth,et al.  Big Omicron and big Omega and big Theta , 1976, SIGA.

[42]  Guillermo Sapiro,et al.  Classification and clustering via dictionary learning with structured incoherence and shared features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Karim Faez,et al.  Unrestricted pose-invariant face recognition by sparse dictionary matrix , 2015, Image Vis. Comput..

[45]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[47]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[48]  Matti Pietikäinen,et al.  Age Classification in Unconstrained Conditions Using LBP Variants , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[49]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[50]  Karim Faez,et al.  Real-Time Pose-Invariant Face Recognition by Triplet Pose Sparse Matrix from Only a Single Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[51]  Kun Duan,et al.  Discovering localized attributes for fine-grained recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Antonio Torralba,et al.  Modifying the Memorability of Face Photographs , 2013, 2013 IEEE International Conference on Computer Vision.

[53]  Chiraz BenAbdelkader,et al.  A Local Region-based Approach to Gender Classi.cation From Face Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[54]  Peter N. Belhumeur,et al.  Tom-vs-Pete Classifiers and Identity-Preserving Alignment for Face Verification , 2012, BMVC.

[55]  José Miguel Buenaposada,et al.  Robust gender recognition by exploiting facial attributes dependencies , 2014, Pattern Recognit. Lett..

[56]  Ming-Hsuan Yang,et al.  Learning Gender with Support Faces , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Shiguang Shan,et al.  Shape driven kernel adaptation in Convolutional Neural Network for robust facial trait recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[59]  Theo Gevers,et al.  Learning-based encoding with soft assignment for age estimation under unconstrained imaging conditions , 2012, Image Vis. Comput..

[60]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Alexander C. Berg,et al.  Automatic Attribute Discovery and Characterization from Noisy Web Data , 2010, ECCV.

[62]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Hong-Yuan Mark Liao,et al.  Automatic Training Image Acquisition and Effective Feature Selection From Community-Contributed Photos for Facial Attribute Detection , 2013, IEEE Transactions on Multimedia.

[64]  Jean-Luc Dugelay,et al.  Minimalistic CNN-based ensemble model for gender prediction from face images , 2016, Pattern Recognit. Lett..

[65]  Xiaolin Hu,et al.  Recurrent convolutional neural network for object recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[66]  Subhransu Maji,et al.  Describing people: A poselet-based approach to attribute classification , 2011, 2011 International Conference on Computer Vision.

[67]  Karim Faez,et al.  Real-world gender classification via local Gabor binary pattern and three-dimensional face reconstruction by generic elastic model , 2015, IET Image Process..

[68]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[69]  Huizhong Chen,et al.  The Hidden Sides of Names—Face Modeling with First Name Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.