Facial Image Quality Assessment using an Ensemble of Pre-Trained Deep Learning Models (EFQnet)

Facial recognition is a type of biometric that deals with the facial region of a human image. The low recognition accuracy of existing Facial Recognition Systems (FRS) is due to the low quality of captured images. The assessment of image quality, therefore, becomes a requirement to be taken before passing such an image through the FRS. This study presents a proposed Facial Image Quality Assessment (FIQA) model using an ensemble of pre-trained deep learning models (EFQnet). The system known as EFQnet is an ensemble of ResNet-50, DenseNet, and Inception-Net CNN pre-trained models. It utilizes a performance-based ground truth that forecasts a quality score for the input image between 0 to 1. The three models are ensemble using full fully connected Feedforward Neural Network and AMSGrad stochastic gradient Descent algorithm. When trained and fully implemented EFQnet will be evaluated on standard IQA databases and finally deployed in a Personal Identity Verification (PIV) scenario.

[1]  Mei Yu,et al.  Difference of Gaussian statistical features based blind image quality assessment: A deep learning approach , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[2]  Zhengfang Duanmu,et al.  End-to-End Blind Image Quality Assessment Using Deep Neural Networks , 2018, IEEE Transactions on Image Processing.

[3]  Arash Kamali,et al.  Automated image quality evaluation of structural brain MRI using an ensemble of deep learning networks , 2019, Journal of magnetic resonance imaging : JMRI.

[4]  Anil K. Jain,et al.  Automatic Face Image Quality Prediction , 2017, ArXiv.

[5]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[6]  A Abayomi-Ali,et al.  Enhanced E-banking system with match-on-card fingerprint authentication and multi-account ATM card , 2013 .

[7]  Sanjiv Kumar,et al.  On the Convergence of Adam and Beyond , 2018 .

[8]  Flavia Cristina Bernardini,et al.  A case of study about overfitting in multiclass classifiers using Convolutional Neural Networks , 2019 .

[9]  Jiachen Yang,et al.  No-reference image quality assessment focusing on human facial region , 2019, Signal Process. Image Commun..

[10]  Stephen O. Olabiyisi,et al.  Enhanced Face Verification and Image Quality Assessment Scheme Using Modified Optical Flow Technique , .

[11]  Vishal Agarwal.  Deep Face Quality Assessment , 2018, ArXiv.

[12]  E. O Omidiora,et al.  Adaptive Regression Splines Models for Predicting Facial Image Verification and Quality Assessment Scores , 2015 .

[13]  Bingbing Ni,et al.  Recognition Oriented Facial Image Quality Assessment via Deep Convolutional Neural Network , 2016, ICIMCS.

[14]  Alejandro F. Frangi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. , 2022 .

[15]  Javier Hernandez-Ortega,et al.  FaceQnet: Quality Assessment for Face Recognition based on Deep Learning , 2019, 2019 International Conference on Biometrics (ICB).

[16]  Omkar M. Parkhi,et al.  VGGFace2: A Dataset for Recognising Faces across Pose and Age , 2017, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[17]  Jie Gu,et al.  Blind image quality assessment via learnable attention-based pooling , 2019, Pattern Recognit..

[18]  Le Kang,et al.  A deep learning approach to document image quality assessment , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[19]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Lianwen Jin,et al.  High performance offline handwritten Chinese character recognition using GoogLeNet and directional feature maps , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[21]  Han Yin.  Multipurpose Image Quality Assessment for Both Human and Computer Vision Systems via Convolutional Neural Network , 2017 .

[22]  Zhou Wang,et al.  Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Krzysztof Okarma,et al.  Current Trends and Advances in Image Quality Assessment , 2019, Elektronika ir Elektrotechnika.

[24]  J. A. Ojo,et al.  BLACKFACE SURVEILLANCE CAMERA DATABASE FOR EVALUATING FACE RECOGNITION IN LOW QUALITY SCENARIOS , 2017 .

[25]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[26]  Decebal Constantin.  DEEP LEARNING FOR OBJECTIVE QUALITY ASSESSMENT OF 3D IMAGES , 2014 .

[27]  Olusola Abayomi-Alli,et al.  Facial Image Verification and Quality Assessment System -FaceIVQA , 2013 .