Ear Recognition Based on Deep Unsupervised Active Learning

Cooperative machine learning has many applications, such as data annotation, where an initial model trained with partially labeled data is used to predict labels for unseen data continuously. Predicted labels with a low confidence value are manually revised to allow the model to be retrained with the predicted and revised data. In this paper, we propose an alternative to this approach: an initial training process called Deep Unsupervised Active Learning. Using the proposed training scheme, a classification model can incrementally acquire new knowledge during the testing phase without manual guidance or correction of decision making. The training process consists of two stages: the first stage of supervised training using a classification model, and an unsupervised active learning stage during the test phase. The labels predicted during the test phase, with high confidence, are continuously used to extend the knowledge base of the model. To optimize the proposed method, the model must have a high initial recognition rate. To this end, we exploited the Visual Geometric Group (VGG16) pre-trained model applied to three datasets: Mathematical Image Analysis (AMI), University of Science and Technology Beijing (USTB2), and Annotated Web Ears (AWE). This approach achieved impressive performance that shows a significant improvement in the recognition rate of the USTB2 dataset by coloring its images using a Generative Adversarial Network (GAN). The obtained performances are interesting compared to the current methods: the recognition rates are 100.00%, 98.33%, and 51.25% for the USTB2, AMI, and AWE datasets, respectively.

[1]  Linga Reddy Cenkeramaddi,et al.  Deep Learning-Based Sign Language Digits Recognition From Thermal Images With Edge Computing System , 2021, IEEE Sensors Journal.

[2]  C. Gupta,et al.  XCOVNet: Chest X-ray Image Classification for COVID-19 Early Detection Using Convolutional Neural Networks , 2021, New Generation Computing.

[3]  Amir Benzaoui,et al.  Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition , 2021, Sensors.

[4]  Amir Benzaoui,et al.  Region of Interest Synthesis using Image-to-Image Translation for ear recognition , 2020, 2020 International Conference on Advanced Aspects of Software Engineering (ICAASE).

[5]  Ramar Ahila Priyadharshini,et al.  A deep learning approach for person identification using ear biometrics , 2020, Applied Intelligence.

[6]  Pedro Silva,et al.  COVID-19 detection in CT images with deep learning: A voting-based scheme and cross-datasets analysis , 2020, Informatics in Medicine Unlocked.

[7]  A. Taleb-Ahmed,et al.  Past, Present, and Future of Face Recognition: A Review , 2020, Electronics.

[8]  Xiuhua Guo,et al.  Fast automated detection of COVID-19 from medical images using convolutional neural networks , 2020, Communications Biology.

[9]  Amir Benzaoui,et al.  A new framework for grayscale ear images recognition using generative adversarial networks under unconstrained conditions , 2020, Evol. Syst..

[10]  Abdelmalik Taleb-Ahmed,et al.  OLIMP: A Heterogeneous Multimodal Dataset for Advanced Environment Perception , 2020, Electronics.

[11]  Thomas Martinetz,et al.  Handcrafted versus CNN Features for Ear Recognition , 2019, Symmetry.

[12]  Abdullah S. Alharthi,et al.  Deep Learning for Monitoring of Human Gait: A Review , 2019, IEEE Sensors Journal.

[13]  Hammam Alshazly,et al.  Ensembles of Deep Learning Models and Transfer Learning for Ear Recognition , 2019, Sensors.

[14]  Pedro Luis Galdámez,et al.  Ear Detection and Localization with Convolutional Neural Networks in Natural Images and Videos , 2019, Processes.

[15]  Christopher J. Gill,et al.  Ear biometrics for patient identification in global health: a field study to test the effectiveness of an image stabilization device in improving identification accuracy , 2019, BMC Medical Informatics and Decision Making.

[16]  Abdelmgeid A. Ali,et al.  Ear recognition using local binary patterns: A comparative experimental study , 2019, Expert Syst. Appl..

[17]  Fang Deng,et al.  Few-shot learning for ear recognition , 2019, Proceedings of the 2019 International Conference on Image, Video and Signal Processing - IVSP 2019.

[18]  Yi Zhang,et al.  Ear verification under uncontrolled conditions with convolutional neural networks , 2018, IET Biom..

[19]  Mehran Ebrahimi,et al.  Image Colorization Using Generative Adversarial Networks , 2018, AMDO.

[20]  Björn W. Schuller,et al.  Applying Cooperative Machine Learning to Speed Up the Annotation of Social Signals in Large Multi-modal Corpora , 2018, ArXiv.

[21]  Maurício Pamplona Segundo,et al.  Employing Fusion of Learned and Handcrafted Features for Unconstrained Ear Recognition , 2017, IET Biom..

[22]  Feng Li,et al.  A novel geometric feature extraction method for ear recognition , 2016, Expert Syst. Appl..

[23]  Peter Peer,et al.  Ear recognition: More than a survey , 2016, Neurocomputing.

[24]  Salim Chikhi,et al.  An ear biometric system based on artificial bees and the scale invariant feature transform , 2016, Expert Syst. Appl..

[25]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[26]  Zoubeida Messali,et al.  Nonparametric Denoising Methods Based on Contourlet Transform with Sharp Frequency Localization: Application to Low Exposure Time Electron Microscopy Images , 2015, Entropy.

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[29]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[31]  Latha Lakshmanan,et al.  Efficient person authentication based on multi-level fusion of ear scores , 2013, IET Biom..

[32]  Abdeldjalil Ouahabi,et al.  A review of wavelet denoising in medical imaging , 2013, 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA).

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  D. Vidhate,et al.  Cooperative Machine Learning with Information Fusion for Dynamic Decision Making in Diagnostic Applications , 2012, 2012 International Conference on Advances in Mobile Network, Communication and Its Applications.

[35]  Chenye Wu,et al.  Automated human identification using ear imaging , 2012, Pattern Recognit..

[36]  M. Usman Akram,et al.  Personal identification using computerized human ear recognition system , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[37]  Djeddi Meriem,et al.  Discrete wavelet for multifractal texture classification: application to medical ultrasound imaging , 2010, 2010 IEEE International Conference on Image Processing.

[38]  Patricia Melin,et al.  Modular neural network integrator for human recognition from ear images , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[39]  Abdeldjalil Ouahabi,et al.  Multifractal analysis for texture characterization: A new approach based on DWT , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[40]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Zhichun Mu,et al.  Compound Structure Classifier System for Ear Recognition , 2008, 2008 IEEE International Conference on Automation and Logistics.

[43]  Zhengguang Xu,et al.  Shape and Structural Feature Based Ear Recognition , 2004, SINOBIOMETRICS.

[44]  Zengqi Sun,et al.  On human machine cooperative learning control , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.

[45]  Abdelmalik Taleb-Ahmed,et al.  Deep learning for real-time semantic segmentation: Application in ultrasound imaging , 2021, Pattern Recognit. Lett..

[46]  Guodong Guo,et al.  On Applicability of Tunable Filter Bank Based Feature for Ear Biometrics: A Study from Constrained to Unconstrained , 2017, Journal of Medical Systems.

[47]  Ravindra Komte,et al.  A Review: Ear Biometrics , 2017 .

[48]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.