Person Recognition via Facial Expression Using ELM Classifier Based CNN Feature Maps

Extreme learning machine (ELM) and deep learning methods are well-known with their efficiency, accuracy, and speed. In this study, we focus on the application of ELM to a deep learning structure for person recognition with facial expressions. For this purpose, a new convolutional neural network (CNN) model containing Kernel ELM classifiers was constructed. In this model, ELM was not used only as a fully connected layer replacement and energy function was employed to generate feature maps for the ELM. There are two advantages of the proposed model. First, it is fast and successful in face recognition studies. Second, it can drastically improve the performance of a partially-trained CNN model. Consequently, the proposed model is very suitable for CNN models, where the learning process requires a lot of time and computational power. The model is tested with the Grimace data set and experimental results are presented in details.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Mark D. McDonnell,et al.  Deep extreme learning machines: supervised autoencoding architecture for classification , 2016, Neurocomputing.

[4]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[5]  Minho Lee,et al.  Deep learning with support vector data description , 2015, Neurocomputing.

[6]  Mohammad Saniee Abadeh,et al.  Extracting features from protein sequences to improve deep extreme learning machine for protein fold recognition. , 2017, Journal of theoretical biology.

[7]  Guang-Bin Huang,et al.  Face recognition based on extreme learning machine , 2011, Neurocomputing.

[8]  D TisseraMigel,et al.  Deep extreme learning machines , 2016 .

[9]  Wenzhong Guo,et al.  Land-Use Classification via Extreme Learning Classifier Based on Deep Convolutional Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Yan Liu,et al.  Deep object recognition across domains based on adaptive extreme learning machine , 2017, Neurocomputing.

[11]  Chunxia Zhang,et al.  Generalized extreme learning machine autoencoder and a new deep neural network , 2017, Neurocomputing.

[12]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[13]  Cüneyt Güzelis,et al.  A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering , 2014, Neural Computing and Applications.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Jin Chen,et al.  A hybrid convolutional neural networks with extreme learning machine for WCE image classification , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[17]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[18]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[19]  Hongming Zhou,et al.  Stacked Extreme Learning Machines , 2015, IEEE Transactions on Cybernetics.

[20]  Yong Dou,et al.  Classification of Hyperspectral Remote Sensing Image Using Hierarchical Local-Receptive-Field-Based Extreme Learning Machine , 2016, IEEE Geoscience and Remote Sensing Letters.

[21]  Jun Miao,et al.  Hierarchical Extreme Learning Machine for unsupervised representation learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[22]  Ayşegül Uçar,et al.  Efficient android electronic nose design for recognition and perception of fruit odors using Kernel Extreme Learning Machines , 2017 .

[23]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Neural Networks , 2013 .

[24]  David Zhang,et al.  Evolutionary Cost-Sensitive Extreme Learning Machine , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Xianzhong Long,et al.  Discriminative graph regularized extreme learning machine and its application to face recognition , 2015, Neurocomputing.

[26]  Q. M. Jonathan Wu,et al.  Human face recognition based on multidimensional PCA and extreme learning machine , 2011, Pattern Recognit..

[27]  Yoshua Bengio,et al.  Editorial introduction to the Neural Networks special issue on Deep Learning of Representations , 2015, Neural Networks.

[28]  Mark D. McDonnell,et al.  Enhancing deep extreme learning machines by error backpropagation , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).