MRMR-based ensemble pruning for facial expression recognition

Facial expression recognition (FER) can assist the interaction between humans and devices. The combination of FER and ensemble learning can usually improve final recognition results. However, in many cases, the produced ensemble classifiers often contain many redundant members, and those components bring potential side effects to final results. Previous studies have illustrated that a more compact subset of a classifier pool shows better performance than original classifier pool. Furthermore, the compacted subset reduces storage space and decreases computation complexity. This paper proposes a maximum relevance and minimum redundancy-based ensemble pruning (MRMREP) method that treats prediction results as features, and extends the feature selection method to the ensemble classifier reduction problem to obtain a more representative subset. This novel method ordered all base classifiers according to two important factors: the correlation between target labels and predictions, and the redundancy between classifiers. The final ensemble performance was evaluated by comparing our method with other ensemble pruning methods, and superior results were obtained on the FER2013, JAFFE, and CK + databases.

[1]  Qun Dai,et al.  An efficient ordering-based ensemble pruning algorithm via dynamic programming , 2015, Applied Intelligence.

[2]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[4]  Lin Xiong,et al.  Selective Ensemble Based on Transformation of Classifiers Used SPCA , 2015, Int. J. Pattern Recognit. Artif. Intell..

[5]  Ting Zhang,et al.  A new reverse reduce-error ensemble pruning algorithm , 2015, Appl. Soft Comput..

[6]  Bartosz Krawczyk,et al.  One-class classifier ensemble pruning and weighting with firefly algorithm , 2015, Neurocomputing.

[7]  Stefan Wermter,et al.  Face expression recognition with a 2-channel Convolutional Neural Network , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[8]  Zhuan Liu,et al.  Ensemble selection by GRASP , 2013, Applied Intelligence.

[9]  Alberto Suárez,et al.  Aggregation Ordering in Bagging , 2004 .

[10]  Giorgio Valentini,et al.  Applications of Supervised and Unsupervised Ensemble Methods , 2009, Applications of Supervised and Unsupervised Ensemble Methods.

[11]  Edilson de Aguiar,et al.  Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order , 2017, Pattern Recognit..

[12]  Danyang Li,et al.  An ensemble convolutional echo state networks for facial expression recognition , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[13]  Luiz Eduardo Soares de Oliveira,et al.  Facial expression recognition using ensemble of classifiers , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Michelle Karg,et al.  Human Movement Analysis: Extension of the F-Statistic to Time Series Using HMM , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[15]  Qun Dai,et al.  A novel ensemble pruning algorithm based on randomized greedy selective strategy and ballot , 2013, Neurocomputing.

[16]  B.V. Dasarathy,et al.  A composite classifier system design: Concepts and methodology , 1979, Proceedings of the IEEE.

[17]  Anne M. P. Canuto,et al.  Empirical comparison of Dynamic Classifier Selection methods based on diversity and accuracy for building ensembles , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[18]  Xindong Wu,et al.  Ensemble pruning via individual contribution ordering , 2010, KDD.

[19]  Grigorios Tsoumakas,et al.  Dynamic ensemble pruning based on multi-label classification , 2015, Neurocomputing.

[20]  Grigorios Tsoumakas,et al.  Pruning an ensemble of classifiers via reinforcement learning , 2009, Neurocomputing.

[21]  Douglas Stott Parker,et al.  Complementary prioritized ensemble selection , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[22]  Jing Cheng,et al.  Affective detection based on an imbalanced fuzzy support vector machine , 2015, Biomed. Signal Process. Control..

[23]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[24]  Fei Chao,et al.  Feature Selection Inspired Classifier Ensemble Reduction , 2014, IEEE Transactions on Cybernetics.

[25]  Ludmila I. Kuncheva,et al.  A Bound on Kappa-Error Diagrams for Analysis of Classifier Ensembles , 2013, IEEE Transactions on Knowledge and Data Engineering.

[26]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[27]  Samia Boukir,et al.  Margin-based ordered aggregation for ensemble pruning , 2013, Pattern Recognit. Lett..

[28]  Ping Liu,et al.  Facial Expression Recognition via a Boosted Deep Belief Network , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Xun Gong,et al.  Expression Detection Based on a Novel Emotion Recognition Method , 2011, Int. J. Comput. Intell. Syst..

[30]  Christino Tamon,et al.  On the Boosting Pruning Problem , 2000, ECML.

[31]  Günther Palm,et al.  When classifier selection meets information theory: A unifying view , 2010, 2010 International Conference of Soft Computing and Pattern Recognition.

[32]  Daniel Hernández-Lobato,et al.  An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Chen Lin,et al.  LibD3C: Ensemble classifiers with a clustering and dynamic selection strategy , 2014, Neurocomputing.

[34]  Yang Yu,et al.  Diversity Regularized Ensemble Pruning , 2012, ECML/PKDD.

[35]  Fei Su,et al.  Facial expression recognition via Gabor wavelet and structured sparse representation , 2012, 2012 3rd IEEE International Conference on Network Infrastructure and Digital Content.

[36]  Chalavadi Krishna Mohan,et al.  Facial Expression Recognition Using Kinect Depth Sensor and Convolutional Neural Networks , 2014, 2014 13th International Conference on Machine Learning and Applications.

[37]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[38]  Qun Dai,et al.  ModEnPBT: A Modified Backtracking Ensemble Pruning algorithm , 2013, Appl. Soft Comput..

[39]  Yoshua Bengio,et al.  Challenges in representation learning: A report on three machine learning contests , 2013, Neural Networks.

[40]  Gonzalo Martínez-Muñoz,et al.  Pruning in ordered bagging ensembles , 2006, ICML.

[41]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[42]  Ke Chen,et al.  Ensemble Learning with Active Data Selection for Semi-Supervised Pattern Classification , 2007, 2007 International Joint Conference on Neural Networks.

[43]  Thiago J. M. Moura,et al.  Combining diversity measures for ensemble pruning , 2016, Pattern Recognit. Lett..

[44]  Manolis Tsiknakis,et al.  Stress and anxiety detection using facial cues from videos , 2017, Biomed. Signal Process. Control..

[45]  George D. C. Cavalcanti,et al.  On Meta-learning for Dynamic Ensemble Selection , 2014, 2014 22nd International Conference on Pattern Recognition.

[46]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[47]  Richard Bowden,et al.  Automatic Facial Expression Recognition Using Boosted Discriminatory Classifiers , 2007, AMFG.

[48]  Aizhong Mi,et al.  A clustering-based classifier selection method for network intrusion detection , 2010, 2010 5th International Conference on Computer Science & Education.

[49]  Yanhua Zhang,et al.  Multi-classifier Fusion Based Facial Expression Recognition Approach , 2014, KSII Trans. Internet Inf. Syst..