Hearing versus Seeing Identical Twins

Identical twins pose a great challenge to face recognition systems due to their similar appearance. Nevertheless, even though twins may look alike, we believe they speak differently. Hence we propose to use their voice patterns to distinguish between twins. Voice is a natural signal to produce, and it is a combination of physiological and behavioral biometrics, therefore it is suitable for twin verification. In this paper, we collect an audio-visual database from 39 pairs of identical twins. Three types of typical voice features are investigated, including Pitch, Linear Prediction Coefficients LPC and Mel Frequency Cepstral Coefficients MFCC. For each type of voice feature, we use Gaussian Mixture Model to model the voice spectral distribution of each subject, and then employ the likelihood ratio of the probe belonging to different classes for verification. The experimental results on this database demonstrate a significant improvement by using voice over facial appearance to distinguish between identical twins. Furthermore, we show that by fusion both types of biometrics, recognition accuracy can be improved.

[1]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[2]  Jiří Matas,et al.  Computer Vision - ECCV 2004 , 2004, Lecture Notes in Computer Science.

[3]  L. H. Anauer,et al.  Speech Analysis and Synthesis by Linear Prediction of the Speech Wave , 2000 .

[4]  J. Daugman,et al.  Epigenetic randomness, complexity and singularity of human iris patterns , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[5]  David Zhang,et al.  A study of identical twins' palmprints for personal verification , 2006, Pattern Recognit..

[6]  Beth Logan,et al.  Mel Frequency Cepstral Coefficients for Music Modeling , 2000, ISMIR.

[7]  Douglas A. Reynolds,et al.  Robust text-independent speaker identification using Gaussian mixture speaker models , 1995, IEEE Trans. Speech Audio Process..

[8]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[9]  Li Zhang,et al.  New hope for recognizing twins by using facial motion , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[10]  Bernard Guyer,et al.  Annual Summary of Vital Statistics: 2004 , 2006, Pediatrics.

[11]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Sridha Sridharan,et al.  Audio-visual speaker verification using continuous fused HMMs , 2006 .

[13]  D. Hoyert,et al.  Annual Summary of Vital Statistics: 2006 , 2008, Pediatrics.

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  M E Wegman,et al.  Annual summary of vital statistics--1973. , 1973, Pediatrics.

[16]  Alan C. Evans,et al.  Lateralization of phonetic and pitch discrimination in speech processing. , 1992, Science.

[17]  E. A. Flinn.  Comments on “Speech Analysis and Synthesis by Linear Prediction of the Speech Wave” [B. S. Atal and S. L. Hanauer, J. Acoust. Soc. Amer. 50, 637–655 (1971)] , 1972 .

[18]  M. S. Sinith,et al.  A novel method for Text-Independent speaker identification using MFCC and GMM , 2010, 2010 International Conference on Audio, Language and Image Processing.

[19]  Sharath Pankanti,et al.  On the similarity of identical twin fingerprints , 2002, Pattern Recognit..

[20]  Tieniu Tan,et al.  A study of multibiometric traits of identical twins , 2010, Defense + Commercial Sensing.

[21]  Juergen Luettin,et al.  Audio-Visual Speech Modeling for Continuous Speech Recognition , 2000, IEEE Trans. Multim..

[22]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[23]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[24]  Li Zhang,et al.  Wonder ears: Identification of identical twins from ear images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).