Stacking-based deep neural network for Facial Expression Recognition

We present a scalable stacking-based deep neural network(S-DNN) for facial expression recognition. The network is a congregate of basic learning models in series to synthesize a deep neural network with feedforward network architecture. Thur, choosing trainable learning modules is the core to effectively build S-DNN in an end-to-end manner. Inspired by the manifold learning archetype, we implement a Patch Discriminative Analysis(PDA) as a basic learning model, followed by hashing and block histogram on the top, which sample image in a low discriminative space, and finding an efficient representation of the training data. As those self-learnable models trained, a low dimensional discriminative feature is implicitly learned, which proves to be useful in facial expression recognition. Experimental results on the facial expression dataset(CK+) show that the proposed model is superior to its counterparts, capable of achieving state-of-the-art performance.

[1]  Enrique Vidal,et al.  Learning weighted metrics to minimize nearest-neighbor classification error , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Bir Bhanu,et al.  Understanding Discrete Facial Expressions in Video Using an Emotion Avatar Image , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Dong Yu,et al.  Sequential Labeling Using Deep-Structured Conditional Random Fields , 2010, IEEE Journal of Selected Topics in Signal Processing.

[4]  Enrique Vidal,et al.  Learning prototypes and distances (LPD). A prototype reduction technique based on nearest neighbor error minimization , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[6]  Andrew Beng Jin Teoh,et al.  Stacking PCANet +: An Overly Simplified ConvNets Baseline for Face Recognition , 2017, IEEE Signal Processing Letters.

[7]  Dan Meng,et al.  Facial expression recognition based on LLENet , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[8]  Charles J. Fombrun,et al.  A World of Reputation Research, Analysis and Thinking — Building Corporate Reputation Through CSR Initiatives: Evolving Standards , 2005 .

[9]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[10]  Konstantinos N. Plataniotis,et al.  Face recognition using kernel direct discriminant analysis algorithms , 2003, IEEE Trans. Neural Networks.

[11]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Desanka Polajnar,et al.  Local binary pattern network: A deep learning approach for face recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[13]  András Lörincz,et al.  High quality facial expression recognition in video streams using shape related information only , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[14]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[15]  Shiguang Shan,et al.  Learning Expressionlets on Spatio-temporal Manifold for Dynamic Facial Expression Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[17]  Hongtao Huo,et al.  GB(2D)2 PCA-based convolutional network for face recognition , 2017, J. Electronic Imaging.

[18]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[19]  Ji Feng,et al.  Deep forest , 2017, IJCAI.

[20]  Roberto Paredes,et al.  Simultaneous learning of a discriminative projection and prototypes for Nearest-Neighbor classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Carlo Gatta,et al.  Multi-scale stacked sequential learning , 2009, Pattern Recognit..

[22]  Andrew Beng Jin Teoh,et al.  DCTNet: A simple learning-free approach for face recognition , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[23]  Yue Yuan,et al.  Subject Independent Facial Expression Recognition: Cross-Connection and Spatial Pyramid Pooling Convolutional Neural Network , 2019, IVSP 2019.