Efficient Detection and Recognition of 3D Ears

The use of ear shape as a biometric trait is a recent trend in research. However, fast and accurate detection and recognition of the ear are very challenging because of its complex geometry. In this work, a very fast 2D AdaBoost detector is combined with fast 3D local feature matching and fine matching via an Iterative Closest Point (ICP) algorithm to obtain a complete, robust and fully automatic system with a good balance between speed and accuracy. Ear images are detected from 2D profile images using the proposed Cascaded AdaBoost detector. The corresponding 3D ear data is then extracted from the co-registered range image and represented with local 3D features. Unlike previous approaches, local features are used to construct a rejection classifier, to extract a minimal region with feature-rich data points and finally, to compute the initial transformation for matching with the ICP algorithm. The proposed system provides a detection rate of 99.9% and an identification rate of 95.4% on Collection F of the UND database. On a Core 2 Quad 9550, 2.83 GHz machine, it takes around 7.7 ms to detect an ear from a 640×480 image. Extracting features from an ear takes 22.2 sec and matching it with a gallery using only the local features takes 0.06 sec while using the full matching including ICP requires 2.28 sec on average.

[1]  Th. Nöldeke.  - und . , .

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[5]  D. B. Graham,et al.  Characterising Virtual Eigensignatures for General Purpose Face Recognition , 1998 .

[6]  Yann LeCun,et al.  Boxlets: A Fast Convolution Algorithm for Signal Processing and Neural Networks , 1998, NIPS.

[7]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[8]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[9]  Wilhelm Burger,et al.  Ear biometrics in computer vision , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  David J. Hurley,et al.  Force Field Feature Extraction for Ear Biometrics , 2005, Image Pattern Recognition.

[11]  Takaya Yuizono,et al.  Study on individual recognition for ear images by using genetic local search , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[12]  Luhong Liang,et al.  A detector tree of boosted classifiers for real-time object detection and tracking , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[13]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[14]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[15]  Sudeep Sarkar,et al.  Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Y. S. Moon,et al.  Recent advances in ear biometrics , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[17]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2004, CVPR Workshops.

[19]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  Arun Ross,et al.  Multimodal biometrics: An overview , 2004, 2004 12th European Signal Processing Conference.

[21]  Jeremy Kepner,et al.  MatlabMPI , 2004, J. Parallel Distributed Comput..

[22]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[23]  Hui Chen,et al.  Human ear detection from side face range images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[24]  Andreas Zell,et al.  Real-time object tracking for soccer-robots without color information , 2004, Robotics Auton. Syst..

[25]  Hui Chen,et al.  Contour Matching for 3D Ear Recognition , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[26]  Ping Yan,et al.  Empirical Evaluation of Advanced Ear Biometrics , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[27]  Ping Yan,et al.  Ear Biometrics Using 2D and 3D Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[28]  Hui Chen,et al.  Shape Model-Based 3D Ear Detection from Side Face Range Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[29]  Zhi-Chun Mu,et al.  A novel approach for ear recognition based on ICA and RBF network , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[30]  L. Mazorra,et al.  Fitting ear contour using an ovoid model , 2005, Proceedings 39th Annual 2005 International Carnahan Conference on Security Technology.

[31]  Wen Gao,et al.  2D Cascaded AdaBoost for Eye Localization , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[32]  Yunde Jia,et al.  Ear Recognition Based on Statistical Shape Model , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[33]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[34]  Sharath Pankanti,et al.  Biometrics: a tool for information security , 2006, IEEE Transactions on Information Forensics and Security.

[35]  Hui Chen,et al.  Human Ear Recognition in 3D , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Phalguni Gupta,et al.  Localization of Ear Using Outer Helix Curve of the Ear , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[37]  Mohammed Bennamoun,et al.  Biometric Approaches of 2D-3D Ear and Face: A Survey , 2007, SCSS.

[38]  Mohammed Bennamoun,et al.  Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition , 2007, International Journal of Computer Vision.

[39]  P. Peixoto,et al.  VISION-BASED PEDESTRIAN DETECTION USING HAAR-LIKE FEATURES , 2007 .

[40]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[41]  Mark S. Nixon,et al.  The ear as a biometric , 2007, 2007 15th European Signal Processing Conference.

[42]  S. Cadavid,et al.  Human Identification based on 3D Ear Models , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[43]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Ping Yan,et al.  Biometric Recognition Using 3D Ear Shape , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Michal Choras.  Image Pre-classification for Biometrics Identification Systems , 2007, Advances in Information Processing and Protection.

[46]  Mark S. Nixon,et al.  On Shape-Mediated Enrolment in Ear Biometrics , 2007, ISVC.

[47]  Ioannis A. Kakadiaris,et al.  Towards fast 3D ear recognition for real-life biometric applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[48]  Zhengguang Xu,et al.  Ear recognition using a new local matching approach , 2008, 2008 15th IEEE International Conference on Image Processing.

[49]  J.E. Gentile,et al.  Profile Face Detection: A Subset Multi-Biometric Approach , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[50]  Mohammed Bennamoun,et al.  A Fully Automatic Approach for Human Recognition from Profile Images Using 2D and 3D Ear Data , 2008 .

[51]  Mohammed Bennamoun,et al.  Fast and Fully Automatic Ear Detection Using Cascaded AdaBoost , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[52]  Mohammed Bennamoun,et al.  A Fast and Fully Automatic Ear Recognition Approach Based on 3D Local Surface Features , 2008, ACIVS.

[53]  Rowan Davies,et al.  Refining Local 3D Feature Matching through Geometric Consistency for Robust Biometric Recognition , 2009, 2009 Digital Image Computing: Techniques and Applications.

[54]  Michal Choras.  Ear Biometrics Based on Geometrical Feature Extraction , 2009, Progress in Computer Vision and Image Analysis.