On Distinctiveness and Symmetry in Ear Biometrics

Previous works show that human ears can be used for identification, gender classification, and kinship verification and have investigated whether there is a symmetry between a person’s ears; however, the symmetry performances have been less than satisfactory. Our paper extends the analysis of gender classification on ear images and analyses bilateral symmetry of human ears, in both cases aiming to determine the ear parts from which recognition is derived. We use model-based analysis and deep learning methods to capitalize on structure and performance, respectively. We consider the rotation of ear images under an affine transformation, by modelling the ear as a flat plane attached to the head. We address the question as to whether it is possible that given an image of one ear, a person can then be recognized from their other ear. Such a symmetry-based strategy could reduce constraints on applications of ear biometrics. We show that it is possible to recognise the gender with a 90.9% success rate and that the ear rim (the upper helix and lobe) dominates performance. To investigate symmetry, we compare one ear with a mirrored version of the other ear and achieve 93.1% CCR, which is the current state-of-the-art, with important regions different from those determined for gender. To extend the analysis we construct two groups of images, one of which contains both ears from the same subject and the other contains two ears from different subjects. The 100% CCR confirms the existence of symmetry between a subject’s ears. By these approaches we show that there is actually a high chance that there exists symmetry between a person’s ears and that it would be prudent for recognition systems to concentrate on the inner ear rather than the outer ear.

[1]  Stefanos Zafeiriou,et al.  The unconstrained ear recognition challenge , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[2]  Mark S. Nixon,et al.  Feature extraction & image processing for computer vision , 2012 .

[3]  Peter Peer,et al.  Ear recognition: More than a survey , 2016, Neurocomputing.

[4]  Maurício Pamplona Segundo,et al.  Employing Fusion of Learned and Handcrafted Features for Unconstrained Ear Recognition , 2017, IET Biom..

[5]  Jiajia Lei,et al.  Gender classification using automatically detected and aligned 3D ear range data , 2013, 2013 International Conference on Biometrics (ICB).

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Banafshe Arbab-Zavar,et al.  On guided model-based analysis for ear biometrics , 2011, Comput. Vis. Image Underst..

[8]  Ping Yan,et al.  Empirical Evaluation of Advanced Ear Biometrics , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  P. Gnanasivam,et al.  Gender Classification Using Ear Biometrics , 2013 .

[10]  M.S. Nixon,et al.  On Model-Based Analysis of Ear Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[11]  Mark S. Nixon,et al.  On Shape-Mediated Enrolment in Ear Biometrics , 2007, ISVC.

[12]  Peter Peer,et al.  Training Convolutional Neural Networks with Limited Training Data for Ear Recognition in the Wild , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Stefanos Zafeiriou,et al.  Deformable Models of Ears in-the-Wild for Alignment and Recognition , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[15]  Di Meng,et al.  Gender and Kinship by Model-Based Ear Biometrics , 2019, 2019 International Conference of the Biometrics Special Interest Group (BIOSIG).

[16]  Amitava Chatterjee,et al.  Ear Recognition Using Force Field Transform and Collaborative Representation-Based Classification with Single Training Sample Per Class , 2015 .

[17]  Ali Abd Almisreb,et al.  Utilizing AlexNet Deep Transfer Learning for Ear Recognition , 2018, 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP).

[18]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Mohamed Abdel-Mottaleb,et al.  Gender classification using 2-D ear images and sparse representation , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[20]  Hazim Kemal Ekenel,et al.  Age and gender classification from ear images , 2018, 2018 International Workshop on Biometrics and Forensics (IWBF).

[21]  Sasan Mahmoodi,et al.  Which Ear Regions Contribute to Identification and to Gender Classification? , 2020, 2020 8th International Workshop on Biometrics and Forensics (IWBF).

[22]  Mark S. Nixon,et al.  A new force field transform for ear and face recognition , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[23]  M. Burge,et al.  Ear Biometrics , 1998 .

[24]  Syed Sadaf Ali,et al.  Geometric statistics-based descriptor for 3D ear recognition , 2018, The Visual Computer.

[25]  Shuigeng Zhou,et al.  A Novel Image Registration Algorithm for Remote Sensing Under Affine Transformation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  David J. Hurley,et al.  Force Field Feature Extraction for Ear Biometrics , 2005, Image Pattern Recognition.

[27]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.

[28]  S. Paulose,et al.  Assessment of age changes and gender differences based on anthropometric measurements of ear: A cross-sectional study , 2017 .

[29]  Önsen Toygar,et al.  Symmetric ear and profile face fusion for identical twins and non-twins recognition , 2018, Signal Image Video Process..

[30]  Alphonse Bertillon,et al.  La photographie judiciaire, avec un appendice sur la classification et l'identification anthropométriques , 1890 .

[31]  Tian Ying,et al.  Human ear recognition based on deep convolutional neural network , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[32]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[34]  Hazim Kemal Ekenel,et al.  Multimodal Age and Gender Classification Using Ear and Profile Face Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Thomas B. Moeslund,et al.  On soft biometrics , 2015, Pattern Recognit. Lett..

[36]  Arun Ross,et al.  Towards understanding the symmetry of human ears: A biometric perspective , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[37]  Arun Ross,et al.  A survey on ear biometrics , 2013, CSUR.

[38]  Pawan K. Ajmera,et al.  Convolutional Neural Network-Based Human Identification Using Outer Ear Images , 2018, SocProS.

[39]  Hazim Kemal Ekenel,et al.  Domain Adaptation for Ear Recognition Using Deep Convolutional Neural Networks , 2017, IET Biom..

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Ping Yan,et al.  Biometric Recognition Using 3D Ear Shape , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.