An investigation of matching symmetry in the human pinnae with possible implications for 3D ear recognition and sound localization

The human external ears, or pinnae, have an intriguing shape and, like most parts of the human external body, bilateral symmetry is observed between left and right. It is a well‐known part of our auditory sensory system and mediates the spatial localization of incoming sounds in 3D from monaural cues due to its shape‐specific filtering as well as binaural cues due to the paired bilateral locations of the left and right ears. Another less broadly appreciated aspect of the human pinna shape is its uniqueness from one individual to another, which is on the level of what is seen in fingerprints and facial features. This makes pinnae very useful in human identification, which is of great interest in biometrics and forensics. Anatomically, the type of symmetry observed is known as matching symmetry, with structures present as separate mirror copies on both sides of the body, and in this work we report the first such investigation of the human pinna in 3D. Within the framework of geometric morphometrics, we started by partitioning ear shape, represented in a spatially dense way, into patterns of symmetry and asymmetry, following a two‐factor anova design. Matching symmetry was measured in all substructures of the pinna anatomy. However, substructures that ‘stick out’ such as the helix, tragus, and lobule also contained a fair degree of asymmetry. In contrast, substructures such as the conchae, antitragus, and antihelix expressed relatively stronger degrees of symmetric variation in relation to their levels of asymmetry. Insights gained from this study were injected into an accompanying identification setup exploiting matching symmetry where improved performance is demonstrated. Finally, possible implications of the results in the context of ear recognition as well as sound localization are discussed.

[1]  Marti J. Anderson,et al.  Distance‐Based Tests for Homogeneity of Multivariate Dispersions , 2006, Biometrics.

[2]  Paul Suetens,et al.  Modeling 3D Facial Shape from DNA , 2014, PLoS genetics.

[3]  Robert Baumgartner,et al.  Acoustic and non-acoustic factors in modeling listener-specific performance of sagittal-plane sound localization , 2014, Front. Psychol..

[4]  S. Lele,et al.  The promise of geometric morphometrics. , 2002, American journal of physical anthropology.

[5]  W. Krzanowski Between-Groups Comparison of Principal Components , 1979 .

[6]  A. Palmer Fluctuating asymmetry analyses: a primer , 1994 .

[7]  Paul Suetens,et al.  Development and comparison of non-rigid surface registration algorithms and extensions , 2014 .

[8]  F. Bookstein,et al.  Morphometric Tools for Landmark Data: Geometry and Biology , 1999 .

[9]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[10]  A. Meyer,et al.  SHAPE ANALYSIS OF SYMMETRIC STRUCTURES: QUANTIFYING VARIATION AMONG INDIVIDUALS AND ASYMMETRY , 2002, Evolution; international journal of organic evolution.

[11]  A. Yezzi,et al.  Local or Global Minima: Flexible Dual-Front Active Contours , 2007 .

[12]  Pavel Zahorik,et al.  Perceptual recalibration in human sound localization: learning to remediate front-back reversals. , 2006, The Journal of the Acoustical Society of America.

[13]  R. Norberg,et al.  Ocurrence and independent evolution of bilateral ear asymmetry in owls and implications on owl taxonomy , 1977 .

[14]  S. F. Volman Directional Hearing in Owls: Neurobiology, Behaviour and Evolution , 1994 .

[15]  Simon Carlile,et al.  Virtual Auditory Space: Generation and Applications , 2013, Neuroscience Intelligence Unit.

[16]  Ewan A. Macpherson,et al.  Sound localization in noise and sensitivity to spectral shape , 2013, Hearing Research.

[17]  Sources of variation in profile analysis. I. Individual differences and extended training. , 2001, The Journal of the Acoustical Society of America.

[18]  Makoto Otani,et al.  Fast calculation system specialized for head-related transfer function based on boundary element method. , 2006, The Journal of the Acoustical Society of America.

[19]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[20]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[21]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[22]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[24]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[25]  Arun Ross,et al.  Towards understanding the symmetry of human ears: A biometric perspective , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[26]  J. S. Beard,et al.  The Physiognomic Approach , 1978 .

[27]  David A Eddins,et al.  Spectral modulation detection as a function of modulation frequency, carrier bandwidth, and carrier frequency region. , 2007, The Journal of the Acoustical Society of America.

[28]  D. Vandermeulen,et al.  Spatially-dense 3D facial asymmetry assessment in both typical and disordered growth , 2011, Journal of anatomy.

[29]  Brian H. McArdle,et al.  FITTING MULTIVARIATE MODELS TO COMMUNITY DATA: A COMMENT ON DISTANCE‐BASED REDUNDANCY ANALYSIS , 2001 .

[30]  Arun Ross,et al.  A survey on ear biometrics , 2013, CSUR.

[31]  Ping Yan,et al.  Biometric Recognition Using 3D Ear Shape , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Anuj Srivastava,et al.  Statistical Shape Analysis , 2014, Computer Vision, A Reference Guide.

[33]  Hui Chen,et al.  Human Ear Recognition in 3D , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  F. Bookstein,et al.  Statistical assessment of bilateral symmetry of shapes , 2000 .

[35]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[36]  F. Rohlf,et al.  Extensions of the Procrustes Method for the Optimal Superimposition of Landmarks , 1990 .

[37]  J. Pohlmann,et al.  Parallel Analysis: a method for determining significant principal components , 1995 .

[38]  Craig T. Jin,et al.  An ideal-observer model of human sound localization , 2014, Biological Cybernetics.

[39]  Mario Baum,et al.  Handbook Of Biometrics , 2016 .

[40]  Sudeep Sarkar,et al.  An evaluation of face and ear biometrics , 2002, Object recognition supported by user interaction for service robots.

[41]  A. Richard Paime FLUCTUATING ASYMMETRY: Measurement, Analysis, Patterns , 1986 .

[42]  Christian Peter Klingenberg,et al.  GEOMETRIC MORPHOMETRICS OF DEVELOPMENTAL INSTABILITY: ANALYZING PATTERNS OF FLUCTUATING ASYMMETRY WITH PROCRUSTES METHODS , 1998, Evolution; international journal of organic evolution.

[43]  L. V. Valen,et al.  A STUDY OF FLUCTUATING ASYMMETRY , 1962 .

[44]  Merico E. Argentati,et al.  Principal Angles between Subspaces in an A-Based Scalar Product: Algorithms and Perturbation Estimates , 2001, SIAM J. Sci. Comput..

[45]  Marti J. Anderson,et al.  A new method for non-parametric multivariate analysis of variance in ecology , 2001 .

[46]  Sudeep Sarkar,et al.  Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  W BowyerKevin,et al.  Biometric Recognition Using 3D Ear Shape , 2007 .

[48]  Gavriel Salvendy,et al.  Individualization of Head-Related Transfer Function for Three-Dimensional Virtual Auditory Display: A Review , 2007, HCI.

[49]  R. Jantz,et al.  Secular Trends in Craniofacial Asymmetry Studied by Geometric Morphometry and Generalized Procrustes Methods , 2005 .

[50]  G. Verbeke,et al.  Sexual dimorphism in multiple aspects of 3D facial symmetry and asymmetry defined by spatially dense geometric morphometrics , 2012, Journal of anatomy.

[51]  R. Montgomerie,et al.  Facial attractiveness signals different aspects of "quality" in women and men. , 2001, Evolution and human behavior : official journal of the Human Behavior and Evolution Society.

[52]  Hiroshi Hamada,et al.  Establishment of vertebrate left–right asymmetry , 2002, Nature Reviews Genetics.

[53]  F L Wightman,et al.  Headphone simulation of free-field listening. I: Stimulus synthesis. , 1989, The Journal of the Acoustical Society of America.

[54]  Sven Kreiborg,et al.  Surface-bounded growth modeling applied to human mandibles , 2000, IEEE Transactions on Medical Imaging.

[55]  P. Claes,et al.  Improved facial outcome assessment using a 3D anthropometric mask. , 2012, International journal of oral and maxillofacial surgery.

[56]  K. Jones,et al.  Smith's Recognizable Patterns of Human Malformation , 1996 .

[57]  Terry T. Takahashi,et al.  How the owl tracks its prey – II , 2010, Journal of Experimental Biology.

[58]  Mohamed Abdel-Mottaleb,et al.  3-D Ear Modeling and Recognition From Video Sequences Using Shape From Shading , 2008, IEEE Transactions on Information Forensics and Security.

[59]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[60]  Sarah J. Hardcastle Relational Techniques that could be used alongside Content-based Behaviour Change Techniques to Maximise Effectiveness of Behaviour Change Interventions , 2016 .

[61]  Dirk Vandermeulen,et al.  Objective 3D face recognition: Evolution, approaches and challenges. , 2010, Forensic science international.

[62]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[63]  Ping Yan,et al.  Empirical Evaluation of Advanced Ear Biometrics , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[64]  Maks Ovsjanikov,et al.  Automatic Location of Landmarks used in Manual Anthropometry , 2014, 3DOR@Eurographics.

[65]  Paul Suetens,et al.  A Comparative Study of 3-D Face Recognition Under Expression Variations , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[66]  Kevin W. Bowyer,et al.  Ear biometrics in human identification , 2006 .

[67]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .