Evaluating the Performance of Eigenface, Fisherface, and Local Binary Pattern Histogram-Based Facial Recognition Methods under Various Weather Conditions

Facial recognition (FR) in unconstrained weather is still challenging and surprisingly ignored by many researchers and practitioners over the past few decades. Therefore, this paper aims to evaluate the performance of three existing popular facial recognition methods considering different weather conditions. As a result, a new face dataset (Lamar University database (LUDB)) was developed that contains face images captured under various weather conditions such as foggy, cloudy, rainy, and sunny. Three very popular FR methods—Eigenface (EF), Fisherface (FF), and Local binary pattern histogram (LBPH)—were evaluated considering two other face datasets, AT&T and 5_Celebrity, along with LUDB in term of accuracy, precision, recall, and F1 score with 95% confidence interval (CI). Computational results show a significant difference among the three FR techniques in terms of overall time complexity and accuracy. LBPH outperforms the other two FR algorithms on both LUDB and 5_Celebrity datasets by achieving 40% and 95% accuracy, respectively. On the other hand, with minimum execution time of 1.37, 1.37, and 1.44 s per image on AT&T,5_Celebrity, and LUDB, respectively, Fisherface achieved the best result.

[1]  Imen Jegham,et al.  Vision-based human action recognition: An overview and real world challenges , 2020, Digit. Investig..

[2]  C. S. Manikandababu,et al.  An Efficient Haze Removal Algorithm for Surveillance Video , 2016 .

[3]  Haidi Ibrahim,et al.  Custom Face Classification Model for Classroom Using Haar-Like and LBP Features with Their Performance Comparisons , 2021, Electronics.

[4]  Figen Özen,et al.  A Face Recognition System Based on Eigenfaces Method , 2012 .

[5]  Yan Yan,et al.  Face Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier , 2017 .

[6]  Liping Shen,et al.  Facial Expression Recognition Based on SVM in E-learning , 2012 .

[7]  Mustafa Zuhaer Nayef,et al.  Face Recognition System based on Wavelet, PCA-LDA and SVM , 2013 .

[8]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[9]  Anastasios Tefas,et al.  Face Detection Using Particle Swarm Optimization and Support Vector Machines , 2010, SETN.

[10]  Xianglong Tang,et al.  An effective and objective criterion for evaluating the performance of denoising filters , 2012, Pattern Recognit..

[11]  Ali Narin,et al.  Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks , 2020, Pattern Analysis and Applications.

[12]  C. Silambarasan,et al.  AN OPTIMIZED IMAGE ENHANCEMENT OF FOGGY IMAGES USING GAMMA ADJUSTMENT , 2014 .

[13]  Jérémie Bossu,et al.  Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks , 2011, International Journal of Computer Vision.

[14]  Shekhar Karanwal,et al.  Performance Analysis of Local Binary Pattern Features with PCA for Face Recognition , 2017 .

[15]  Ausif Mahmood,et al.  Enhanced Human Face Recognition Using LBPH Descriptor, Multi-KNN, and Back-Propagation Neural Network , 2018, IEEE Access.

[16]  Zanbo Zhu,et al.  Use a UAV System to Enhance Port Security in Unconstrained Environment , 2020 .

[17]  Jin Hyung Kim,et al.  Face Recognition using Support Vector Machines with Local Correlation Kernels , 2002, Int. J. Pattern Recognit. Artif. Intell..

[18]  Jun-Ho Huh,et al.  Face Recognition at a Distance for a Stand-Alone Access Control System † , 2020, Sensors.

[19]  Takeo Kanade,et al.  Analysis of Rain and Snow in Frequency Space , 2008, International Journal of Computer Vision.

[20]  Kishor Datta Gupta,et al.  Study of Different Deep Learning Approach with Explainable AI for Screening Patients with COVID-19 Symptoms: Using CT Scan and Chest X-ray Image Dataset , 2020, ArXiv.

[21]  Jing Zhang,et al.  Face Recognition in an Unconstrained and Real-Time Environment Using Novel BMC-LBPH Methods Incorporates with DJI Vision Sensor , 2020, J. Sens. Actuator Networks.

[22]  Abdelmalik Taleb-Ahmed,et al.  Past, Present, and Future of Face Recognition: A Review , 2020 .

[23]  Zahed Siddique,et al.  Detecting SARS-CoV-2 From Chest X-Ray Using Artificial Intelligence , 2021, IEEE Access.

[24]  Yu-Hsiang Fu,et al.  Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition , 2012, IEEE Transactions on Image Processing.

[25]  Kishor Datta Gupta,et al.  COVID-19 Symptoms Detection Based on NasNetMobile with Explainable AI Using Various Imaging Modalities , 2020, Mach. Learn. Knowl. Extr..

[26]  Yogadhar Pandey,et al.  Real Time Fog Removal Technique with Improved Quality through FFT , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[27]  Amir Benzaoui,et al.  Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition , 2021, Sensors.

[28]  Abdelmalik Taleb-Ahmed,et al.  Deep learning for real-time semantic segmentation: Application in ultrasound imaging , 2021, Pattern Recognit. Lett..

[29]  Patrizio Campisi,et al.  Reduced complexity rotation invariant texture classification using a blind deconvolution approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Javier Ruiz-del-Solar,et al.  Recognition of Faces in Unconstrained Environments: A Comparative Study , 2009, EURASIP J. Adv. Signal Process..

[31]  Wenli Zhang,et al.  An improved fog-removing method for the traffic monitoring image , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[32]  Javier Ruiz-del-Solar,et al.  A comparative study of thermal face recognition methods in unconstrained environments , 2012, Pattern Recognit..

[33]  Nianjun Liu,et al.  Using the Shape Characteristics of Rain to Identify and Remove Rain from Video , 2008, SSPR/SPR.

[34]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..