Ear biometrics: a survey of detection, feature extraction and recognition methods

The possibility of identifying people by the shape of their outer ear was first discovered by the French criminologist Bertillon, and refined by the American police officer Iannarelli, who proposed a first ear recognition system based on only seven features. The detailed structure of the ear is not only unique, but also permanent, as the appearance of the ear does not change over the course of a human life. Additionally, the acquisition of ear images does not necessarily require a person's cooperation but is nevertheless considered to be non-intrusive by most people. Owing to these qualities, the interest in ear recognition systems has grown significantly in recent years. In this survey, the authors categorise and summarise approaches to ear detection and recognition in 2D and 3D images. Then, they provide an outlook over possible future research in the field of ear recognition, in the context of smart surveillance and forensic image analysis, which they consider to be the most important application of ear recognition characteristic in the near future.

[1]  B. Moreno,et al.  On the use of outer ear images for personal identification in security applications , 1999, Proceedings IEEE 33rd Annual 1999 International Carnahan Conference on Security Technology (Cat. No.99CH36303).

[2]  Y. S. Moon,et al.  Recent advances in ear biometrics , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[3]  Michele Nappi,et al.  HERO: Human Ear Recognition against Occlusions , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Mohamed Abdel-Mottaleb,et al.  Human Ear Recognition from Face Profile Images , 2006, ICB.

[5]  Mohammad H. Mahoor,et al.  Multi-modal biometric modeling and recognition of the human face and ear , 2009, 2009 IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR 2009).

[6]  Ping Yan,et al.  A fast algorithm for ICP-based 3D shape biometrics , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[7]  Mark S. Nixon,et al.  Force Field Energy Functionals for Image Feature Extraction , 2002, BMVC.

[8]  Mohammed Bennamoun,et al.  Fast and Fully Automatic Ear Detection Using Cascaded AdaBoost , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[9]  Andrea F. Abate,et al.  Ear Recognition by means of a Rotation Invariant Descriptor , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Davide G. Tommasi,et al.  Age- and sex-related changes in the normal human ear. , 2009, Forensic science international.

[11]  Dariusz Frejlichowski,et al.  The West Pomeranian University of Technology Ear Database - A Tool for Testing Biometric Algorithms , 2010, ICIAR.

[12]  Patrick J. Flynn,et al.  Rotated Profile Signatures for robust 3D feature detection , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[13]  M. Choraś.  Perspective methods of human identification: Ear biometrics , 2007 .

[14]  Rerkchai Fooprateepsiri,et al.  An Efficient Features Ear Based Personal Identification Approach Forensic Science Tasks , 2011 .

[15]  P. Vanezis,et al.  Exploratory study on classification and individualisation of earprints. , 2004, Forensic science international.

[16]  Chian C. Ho,et al.  Ear Detection Based on Arc-Masking Extraction and AdaBoost Polling Verification , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[17]  Hui Zeng,et al.  Block-based and multi-resolution methods for ear recognition using wavelet transform and uniform local binary patterns , 2008, 2008 19th International Conference on Pattern Recognition.

[18]  David Zhang,et al.  Fast 3D point cloud ear identification by slice curve matching , 2011, 2011 3rd International Conference on Computer Research and Development.

[19]  Hui Zeng,et al.  Ear recognition based on 3D keypoint matching , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[20]  Mohammed Bennamoun,et al.  Sparse Representation for Ear Biometrics , 2008, ISVC.

[21]  Mahbubur Rahman,et al.  Person Identification Using Ear Biometrics , 2007 .

[22]  Mohammed Bennamoun,et al.  A Fully Automatic Approach for Human Recognition from Profile Images Using 2D and 3D Ear Data , 2008 .

[23]  Zhengguang Xu,et al.  Ear recognition using a new local matching approach , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  Yuan Weiqi,et al.  Human ear recognition based on block segmentation , 2009, 2009 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[25]  Zhengguang Xu,et al.  Shape and Structural Feature Based Ear Recognition , 2004, SINOBIOMETRICS.

[26]  Arun Ross,et al.  A survey on ear biometrics , 2013, CSUR.

[27]  Mohamed Abdel-Mottaleb,et al.  3D ear modeling and recognition from video sequences using shape from shading , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  M. Burge,et al.  Ear Biometrics , 1998 .

[29]  Sim Heng Ong,et al.  Image Analysis by Tchebichef Moments , 2001, IEEE Trans. Image Process..

[30]  Mark S. Nixon,et al.  On Shape-Mediated Enrolment in Ear Biometrics , 2007, ISVC.

[31]  Zhichun Mu,et al.  Multi-Pose Ear Recognition Based on Force Field Transformation , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[32]  Hui Chen,et al.  Shape Model-Based 3D Ear Detection from Side Face Range Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[33]  Zhi-qin Wang,et al.  Multi-scale feature extraction algorithm of ear image , 2011, 2011 International Conference on Electric Information and Control Engineering.

[34]  Jingyu Hou,et al.  A neural network based human identification framework using ear images , 2010, TENCON 2010 - 2010 IEEE Region 10 Conference.

[35]  R. Purkait,et al.  Observations of external ear--an Indian study. , 2009, Homo : internationale Zeitschrift fur die vergleichende Forschung am Menschen.

[36]  A J Hoogstrate,et al.  Ear identification based on surveillance camera images. , 2001, Science & justice : journal of the Forensic Science Society.

[37]  Tarek M. Sobh,et al.  Advances in Computer and Information Sciences and Engineering, Proceedings of the 2007 International Conference on Systems, Computing Sciences and Software Engineering (SCSS), part of the International Joint Conferences on Computer, Information, and Systems Sciences, and Engineering (CISSE 2007), Br , 2008, SCSS.

[38]  Weiqi Yuan,et al.  Gabor wavelets and General Discriminant analysis for ear recognition , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[39]  Yu Zhang,et al.  Ear Recognition using Improved Non-Negative Matrix Factorization , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[40]  Sudeep Sarkar,et al.  Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Jeges Ernő,et al.  Model-Based Human Ear Localization and Feature Extraction , 2007 .

[42]  Zhichun Mu,et al.  Compound Structure Classifier System for Ear Recognition , 2008, 2008 IEEE International Conference on Automation and Logistics.

[43]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[44]  W BowyerKevin,et al.  Biometric Recognition Using 3D Ear Shape , 2007 .

[45]  Heng Liu,et al.  Notice of RetractionImproving adaboost ear detection with skin-color model and multi-template matching , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[46]  Mohamed Abdel-Mottaleb,et al.  A computationally efficient approach to 3D ear recognition employing local and holistic features , 2011, CVPR 2011 WORKSHOPS.

[47]  Yunde Jia,et al.  Ear Recognition Based on Statistical Shape Model , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[48]  Mark S. Nixon,et al.  Robust log-Gabor filter for ear biometrics , 2008, 2008 19th International Conference on Pattern Recognition.

[49]  Ping Yan,et al.  Biometric Recognition Using 3D Ear Shape , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Phalguni Gupta,et al.  An efficient technique for ear detection in 3D: Invariant to rotation and scale , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[51]  Patricia Melin,et al.  Modular neural network integrator for human recognition from ear images , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[52]  Mark S. Nixon,et al.  The effect of time on ear biometrics , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[53]  Ioannis A. Kakadiaris,et al.  Towards fast 3D ear recognition for real-life biometric applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[54]  Hui Chen,et al.  Human Ear Recognition in 3D , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Mary Ann F. Harrison,et al.  Fast learning ear detection for real-time surveillance , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[56]  Hui Chen,et al.  Contour Matching for 3D Ear Recognition , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[57]  Arun Ross,et al.  Towards understanding the symmetry of human ears: A biometric perspective , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[58]  Sudeep Sarkar,et al.  An evaluation of face and ear biometrics , 2002, Object recognition supported by user interaction for service robots.

[59]  Mohammed Bennamoun,et al.  Biometric Approaches of 2D-3D Ear and Face: A Survey , 2007, SCSS.

[60]  Sharath Pankanti,et al.  Advances in Biometric Person Authentication, International Workshop on Biometric Recognition Systems, IWBRS2005, Beijing, China, October 22-23, 2005, Proceedings , 2005, IWBRS.

[61]  Phalguni Gupta,et al.  An efficient ear localization technique , 2012, Image Vis. Comput..

[62]  Mohammed Bennamoun,et al.  Efficient Detection and Recognition of 3D Ears , 2011, International Journal of Computer Vision.

[63]  Takaya Yuizono,et al.  Study on individual recognition for ear images by using genetic local search , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[64]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[65]  Shaun J. Canavan,et al.  A biometric database with rotating head videos and hand-drawn face sketches , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[66]  Loris Nanni,et al.  A multi-matcher for ear authentication , 2007, Pattern Recognit. Lett..

[67]  Michal Choras,et al.  Image Feature Extraction Methods for Ear Biometrics--A Survey , 2007, 6th International Conference on Computer Information Systems and Industrial Management Applications (CISIM'07).

[68]  Phalguni Gupta,et al.  An efficient ear recognition technique invariant to illumination and pose , 2013, Telecommun. Syst..

[69]  Mark S. Nixon,et al.  A novel ray analogy for enrolment of ear biometrics , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[70]  Phalguni Gupta,et al.  Ear Biometrics: A New Approach , 2006 .

[71]  Zhi-chun Mu,et al.  Ear Recognition based on 2D Images , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[72]  Zhichun Mu,et al.  Ear recognition using LLE and IDLLE algorithm , 2008, 2008 19th International Conference on Pattern Recognition.

[73]  Mohamed Abdel-Mottaleb,et al.  3-D Ear Modeling and Recognition From Video Sequences Using Shape From Shading , 2008, IEEE Transactions on Information Forensics and Security.

[74]  K. N. Rao,et al.  Pattern extraction methods for ear biometrics - A survey , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[75]  Heng Liu,et al.  Multi-view Ear Shape Feature Extraction and Reconstruction , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[76]  Lynn Meijerman,et al.  Cross‐Sectional Anthropometric Study of the External Ear , 2007, Journal of forensic sciences.

[77]  Xiu-qing Wang,et al.  The Research of Ear Identification Based On Improved Algorithm of Moment Invariant , 2010, 2010 Third International Conference on Information and Computing.

[78]  Hugo Proença,et al.  UBEAR: A dataset of ear images captured on-the-move in uncontrolled conditions , 2011, 2011 IEEE Workshop on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[79]  M.S. Nixon,et al.  On Model-Based Analysis of Ear Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[80]  Alphonse Bertillon,et al.  La photographie judiciaire, avec un appendice sur la classification et l'identification anthropométriques , 1890 .

[81]  Phalguni Gupta,et al.  SIFT-based ear recognition by fusion of detected keypoints from color similarity slice regions , 2009, 2009 International Conference on Advances in Computational Tools for Engineering Applications.

[82]  Mohamed S. Kamel,et al.  Image Analysis and Recognition , 2014, Lecture Notes in Computer Science.

[83]  Phalguni Gupta,et al.  Feature Level Fused Ear Biometric System , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[84]  Mohammed Bennamoun,et al.  A Fast and Fully Automatic Ear Recognition Approach Based on 3D Local Surface Features , 2008, ACIVS.

[85]  Mohamed Abdel-Mottaleb,et al.  Histograms of Categorized Shapes for 3D ear detection , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[86]  L. Mazorra,et al.  Fitting ear contour using an ovoid model , 2005, Proceedings 39th Annual 2005 International Carnahan Conference on Security Technology.

[87]  K. Faez,et al.  Ear recognition using features inspired by visual cortex and support vector machine technique , 2008, 2008 International Conference on Computer and Communication Engineering.

[88]  Chenye Wu,et al.  Automated human identification using ear imaging , 2012, Pattern Recognit..

[89]  Mark S. Nixon,et al.  Toward Unconstrained Ear Recognition From Two-Dimensional Images , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[90]  Zhi-Chun Mu,et al.  Ear Detection Based on Skin-Color and Contour Information , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[91]  I. Alberink,et al.  Performance of the FearID earprint identification system. , 2007, Forensic science international.

[92]  Madasu Hanmandlu,et al.  Automatic Ear Detection for Online Biometric Applications , 2011, 2011 Third National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics.

[93]  M. Choraś,et al.  Perspective methods of biometric human identification , 2008, New Trends in Audio and Video / Signal Processing Algorithms, Architectures, Arrangements, and Applications SPA 2008.

[94]  Stan Z. Li,et al.  Advances in Biometrics, International Conference, ICB 2007, Seoul, Korea, August 27-29, 2007, Proceedings , 2007, ICB.

[95]  Phalguni Gupta,et al.  Localization of Ear Using Outer Helix Curve of the Ear , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[96]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.

[97]  Karim Faez,et al.  A New Segmentation Approach for Ear Recognition , 2008, ACIVS.