Impact of Facial Expressions on the Accuracy of a CNN Performing Periocular Recognition

The biometric periocular trait refers to the face region in the vicinity of the eye, including the eyelids, eyelashes and eyebrows. The periocular region has emerged as a promising trait for unconstrained biometrics, due to recent advances of convolutional neural networks and the demand for robust face or iris recognition systems. The periocular region can offer global information about the eye shape, and about the texture of the iris, sclera and skin around the eyes. However, periocular biometrics is a relatively new area of research. Thus, it's important to understand the uniqueness and stability of this trait, taking into account the best accuracies obtained by deep learning methods applied on biometric image recognition. In this work, we investigate if changes in the periocular region, caused by facial expressions, affect the recognition accuracy. We apply an existing pretrained CNN architecture, called MobileNet, to the task of periocular recognition. The periocular images used in the experiments were extracted from the Extended Cohn-Kanade expression database. The best results were obtained when the network was tested with similar samples to those contained in the training set. We concluded that the CNN is sensitive to changes in the facial expressions and samples of all expressions are required for training aiming the best accuracy.

[1]  Sunita Sangwan,et al.  A Survey On Various Problems & Challenges In Face Recognition , 2013 .

[2]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[3]  Fernando Alonso-Fernandez,et al.  Periocular Recognition Using CNN Features Off-the-Shelf , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[4]  M. Boaventura,et al.  Face Recognition Using Local Mapped Pattern and Genetic Algorithms , 2018, PRAI 2018.

[5]  Arif Mahmood,et al.  Periocular region-based person identification in the visible, infrared and hyperspectral imagery , 2015, Neurocomputing.

[6]  Hugo Proença,et al.  Deep-PRWIS: Periocular Recognition Without the Iris and Sclera Using Deep Learning Frameworks , 2018, IEEE Transactions on Information Forensics and Security.

[7]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[8]  Karl Ricanek,et al.  LBP-based periocular recognition on challenging face datasets , 2013, EURASIP J. Image Video Process..

[9]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Nilanjan Dey,et al.  Pattern Mining Approaches Used in Sensor-Based Biometric Recognition: A Review , 2019, IEEE Sensors Journal.

[11]  Jaihie Kim,et al.  An empirical study on iris recognition in a mobile phone , 2016, Expert Syst. Appl..

[12]  Hugo Proença,et al.  Periocular recognition: how much facial expressions affect performance? , 2016, Pattern Analysis and Applications.

[13]  Kang Ryoung Park,et al.  Convolutional Neural Network-Based Periocular Recognition in Surveillance Environments , 2018, IEEE Access.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Munam Ali Shah,et al.  Iris recognition system in smartphones using light version (LV) recognition algorithm , 2017, 2017 23rd International Conference on Automation and Computing (ICAC).

[16]  John Daugman,et al.  Iris Recognition at Airports and Border-Crossings , 2009, Encyclopedia of Biometrics.

[17]  Zhang Rui,et al.  A Survey on Biometric Authentication: Toward Secure and Privacy-Preserving Identification , 2019, IEEE Access.

[18]  Arif Mahmood,et al.  Periocular biometric recognition using image sets , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[19]  Anil K. Jain,et al.  Periocular biometrics in the visible spectrum: A feasibility study , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[20]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[21]  Sridha Sridharan,et al.  Iris Recognition With Off-the-Shelf CNN Features: A Deep Learning Perspective , 2018, IEEE Access.

[22]  Richa Singh,et al.  Person identification at a distance via ocular biometrics , 2015, IEEE International Conference on Identity, Security and Behavior Analysis (ISBA 2015).

[23]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Shobhit Mittal,et al.  Real Time Multiple Face Recognition: A Deep Learning Approach , 2018, DMIP '18.

[25]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[26]  T. Aoki,et al.  Recent Advances in Biometric Recognition , 2017 .

[27]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..