Multimodal Biometric Person Authentication using Speech, Signature and Handwriting Features

The objective of this work is to develop a multimodal biometric system using speech, signature and handwriting information. Unimodal biometric person authentication systems are initially developed for each of these biometric features. Methods are then explored for integrating them to obtain multimodal system. Apart from implementing state-of-the art systems, the major part of the work is on the new explorations at each level with the objective of improving performance and robustness. The latest research indicates multimodal person authentication system is more effective and more challenging. This work demonstrates that the fusion of multiple biometrics helps to minimize the system error rates. As a result, the identification performance is 100% and verification performances, False Acceptance Rate (FAR) is 0%, and False Rejection Rate (FRR) is 0%.

[1]  S. Ribaric,et al.  A biometric verification system based on the fusion of palmprint and face features , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[2]  Slobodan Ribarić,et al.  Multimodal biometric user-identification system for network-based applications , 2003 .

[3]  S. Furui,et al.  Cepstral analysis technique for automatic speaker verification , 1981 .

[4]  Douglas A. Reynolds,et al.  Speaker identification and verification using Gaussian mixture speaker models , 1995, Speech Commun..

[5]  Y. Meyer,et al.  Wavelets and Filter Banks , 1991 .

[6]  Nengheng Zheng,et al.  Integration of Complementary Acoustic Features for Speaker Recognition , 2007, IEEE Signal Processing Letters.

[7]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Chin-Hui Lee,et al.  A maximum-likelihood approach to stochastic matching for robust speech recognition , 1996, IEEE Trans. Speech Audio Process..

[9]  Tushar Patnaik,et al.  A Survey on Offline Signature Verification , 2013 .

[10]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Arun Ross,et al.  Learning user-specific parameters in a multibiometric system , 2002, Proceedings. International Conference on Image Processing.

[12]  Ralf Steinmetz,et al.  Biometric applications based on handwriting , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[13]  Chaur-Heh Hsieh,et al.  DCT-based codebook design for vector quantization of images , 1992, IEEE Trans. Circuits Syst. Video Technol..

[14]  JainAnil,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998 .

[15]  A.E. Rosenberg,et al.  Automatic speaker verification: A review , 1976, Proceedings of the IEEE.

[16]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[17]  Ioannis Pitas,et al.  Multimodal decision-level fusion for person authentication , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[20]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[21]  Stefan Fischer,et al.  Fusion of audio and video information for multi modal person authentication , 1997, Pattern Recognit. Lett..

[22]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[23]  Anders Eriksson,et al.  How flexible is the human voice? - a case study of mimicry , 1997, EUROSPEECH.

[24]  G. Aguilar,et al.  Multimodal biometric system using fingerprint , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[25]  Robert Frischholz,et al.  BioID: A Multimodal Biometric Identification System , 2000, Computer.

[26]  M. Wirotius,et al.  Writer identification from gray level distribution , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[27]  ImpedovoD.,et al.  Automatic Signature Verification , 2008 .

[28]  Teruo Fukumura,et al.  Structural description and classification of signature images , 1990, Pattern Recognit..

[29]  R. Manmatha,et al.  Word image matching using dynamic time warping , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  S. R. Mahadeva Prasanna,et al.  Extraction of speaker-specific excitation information from linear prediction residual of speech , 2006, Speech Commun..

[31]  Lambert Schomaker,et al.  Automatic writer identification using connected-component contours and edge-based features of uppercase Western script , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Jana Dittmann,et al.  Single-Semantic Multi-Instance Fusion of Handwriting Based Biometric Authentication Systems , 2007, 2007 IEEE International Conference on Image Processing.

[33]  B.S. Atal,et al.  Automatic recognition of speakers from their voices , 1976, Proceedings of the IEEE.

[34]  L. O'Gorman,et al.  Comparing passwords, tokens, and biometrics for user authentication , 2003, Proceedings of the IEEE.

[35]  Biing-Hwang Juang,et al.  A vector quantization approach to speaker recognition , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.