Real-time ensemble based face recognition system for NAO humanoids using local binary pattern

NAO humanoid robots are being used in many human-robot interaction applications. One of the important existing challenges is developing an accurate real-time face recognition system which does not require to have high computational cost. In this research work a real-time face recognition system by using block processing of local binary patterns of the face images captured by NAO humanoid is proposed. Majority voting and best score ensemble approaches have been used in order to boost the recognition results obtained in different colour channels of YUV colour space, which is a default colour space provided by the camera of NAO humanoid. The proposed method has been adopted on NAO humanoid and tested under real-world conditions. The recognition results were boosted in the real-time scenario by employing majority voting on the intra-sequence decisions with window size of 5. The experimental results are showing that the proposed face recognition algorithm overcomes the conventional and state-of-the-art techniques.

[1]  Zhang Meng,et al.  CUDA-based real-time face recognition system , 2014, 2014 Fourth International Conference on Digital Information and Communication Technology and its Applications (DICTAP).

[2]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[3]  Radhey Shyam,et al.  Face recognition using augmented local binary pattern and Bray Curtis dissimilarity metric , 2015, 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN).

[4]  Dacheng Tao,et al.  A Comprehensive Survey on Pose-Invariant Face Recognition , 2015, ACM Trans. Intell. Syst. Technol..

[5]  Shamsudin Mohd. Amin,et al.  Comparison of Face Recognition Algorithms for Human-Robot Interactions , 2015 .

[6]  Gholamreza Anbarjafari,et al.  Edge information based object classification for NAO robots , 2016 .

[7]  Luc Van Gool,et al.  Real-time facial feature detection using conditional regression forests , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Claudio A. Perez,et al.  Face recognition under pose variation with active shape model to adjust Gabor filter kernels and to correct feature extraction location , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[9]  Marcelo H. Ang,et al.  A Survey on Perception Methods for Human–Robot Interaction in Social Robots , 2013, International Journal of Social Robotics.

[10]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[11]  Chiraz BenAbdelkader,et al.  A Local Region-based Approach to Gender Classi.cation From Face Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[12]  Paulo Menezes,et al.  Human-robot interaction based on Haar-like features and eigenfaces , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[13]  A Simplified Method for Preliminary Seismic Vulnerability Assessment of Existing Building in Kundasang, Sabah, Malaysia , 2015 .

[14]  Yang Xue,et al.  Recent development in analog computation: a brief overview , 2015, Analog Integrated Circuits and Signal Processing.

[15]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[16]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[17]  Bao-Liang Lu,et al.  Multi-view Gender Classification Using Local Binary Patterns and Support Vector Machines , 2006, ISNN.

[18]  Gholamreza Anbarjafari.  Face recognition using color local binary pattern from mutually independent color channels , 2013, EURASIP J. Image Video Process..

[19]  Yang Zhao,et al.  Completed robust local binary pattern for texture classification , 2013, Neurocomputing.

[20]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[21]  Changyin Sun,et al.  Gender Classification Based on Boosting Local Binary Pattern , 2006, ISNN.

[22]  Frank L. Lewis,et al.  Intelligent Human–Robot Interaction Systems Using Reinforcement Learning and Neural Networks , 2017 .

[23]  Ming-Hsuan Yang,et al.  Real-Time Exemplar-Based Face Sketch Synthesis , 2014, ECCV.

[24]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[25]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[27]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[28]  Gholamreza Anbarjafari,et al.  Vocal-based emotion recognition using random forests and decision tree , 2017, Int. J. Speech Technol..

[29]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[30]  Chunlan Yang,et al.  Structural MRI-based detection of Alzheimer's disease using feature ranking and classification error , 2016, Comput. Methods Programs Biomed..

[31]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Gholamreza Anbarjafari,et al.  Expression Recognition by Using Facial and Vocal Expressions , 2014, VL@COLING.

[33]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Trans. Image Process..

[34]  Wendi B. Heinzelman,et al.  Cloud-Vision: Real-time face recognition using a mobile-cloudlet-cloud acceleration architecture , 2012, 2012 IEEE Symposium on Computers and Communications (ISCC).

[35]  Allen Y. Yang,et al.  Sparse Illumination Learning and Transfer for Single-Sample Face Recognition with Image Corruption and Misalignment , 2014, International Journal of Computer Vision.

[36]  Laura Igual,et al.  Robust gait-based gender classification using depth cameras , 2013, EURASIP Journal on Image and Video Processing.

[37]  IV CyrilHöschl,et al.  Robust histogram-based image retrieval , 2016, Pattern Recognit. Lett..

[38]  Sergio Escalera,et al.  Convolutional Neural Network Super Resolution for Face Recognition in Surveillance Monitoring , 2016, AMDO.