A New Approach on Multimodal Biometrics Based on Combining Neural Networks Using AdaBoost

In this paper, we propose a new approach in the field of multimodal biometrics, based on AdaBoost. AdaBoost has been used to overcome the prob-lem of limited number of training data in unimodal systems, by combining neu-ral networks as weak learners.The simplest possible neural network, i.e. only one neuron, plays the role of a weak learner in our system. We have conducted different experiments with different number of AdaBoost iterations (experts) and input features. We compared the results of our AdaBoost based multimodal system, using features of three different unimodal systems, with the results obtained separately from these unimodal systems, i.e. a GMM based speaker veri-fication, an HMM based face verification and a SVM based face verification. It has been shown that even the average FAR of the multimodal system (%0.058) is much less than the lowest FARs of each of the unimodal systems (%0.32 for SV, %4 for HMM based face verification and %1 for SVM based face verification systems), while the average FRR of the multimodal system is acceptable (%2.1).

[1]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[2]  Pramod K. Varshney,et al.  Improving personal identification accuracy using multisensor fusion for building access control applications , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[3]  Thomas Wagner,et al.  Multi-sensorial inputs for the identification of persons with synergetic computers , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Tsuhan Chen,et al.  Principle component analysis and its variants for biometrics , 2002, Proceedings. International Conference on Image Processing.

[5]  B. Ruiz-Mezcua,et al.  Biometrics verification in a real environment , 1999, Proceedings IEEE 33rd Annual 1999 International Carnahan Conference on Security Technology (Cat. No.99CH36303).

[6]  Arun Ross,et al.  Learning user-specific parameters in a multibiometric system , 2002, Proceedings. International Conference on Image Processing.

[7]  Josef Kittler,et al.  Fusion of multiple experts in multimodal biometric personal identity verification systems , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[8]  G. Abouelseoud,et al.  Identity verification using audio-visual features , 2000, Proceedings of the Seventeenth National Radio Science Conference. 17th NRSC'2000 (IEEE Cat. No.00EX396).

[9]  Farzin Deravi,et al.  Audio-visual person recognition: an evaluation of data fusion strategies , 1997 .

[10]  Bernhard Fröba,et al.  Evaluation of sensor calibration in a biometric person recognition framework based on sensor fusion , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Jiri Matas,et al.  Audio-visual person verification , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  Georg Meyer,et al.  Continuous audio-visual digit recognition using decision fusion , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  E. Mayoraz,et al.  Fusion of face and speech data for person identity verification , 1999, IEEE Trans. Neural Networks.

[14]  Thomas Wagner,et al.  Sensor-fusion for robust identification of persons: a field test , 1995, Proceedings., International Conference on Image Processing.

[15]  Ioannis Pitas,et al.  Multimodal decision-level fusion for person authentication , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Kuldip K. Paliwal,et al.  Noise compensation in a multi-modal verification system , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[17]  Kuldip K. Paliwal,et al.  Multi-modal person verification system based on face profiles and speech , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[18]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[19]  Julian Fiérrez,et al.  Multimodal biometric authentication using quality signals in mobile communications , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[20]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Sun-Yuan Kung,et al.  Probabilistic DBNN via expectation-maximization with multi-sensor classification applications , 1995, Proceedings., International Conference on Image Processing.

[22]  Philippe C. Cattin,et al.  Sensor fusion for a biometric system using gait , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[23]  Hervé Glotin,et al.  Large-vocabulary audio-visual speech recognition: a summary of the Johns Hopkins Summer 2000 Workshop , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[24]  Julian Fiérrez,et al.  Fusion strategies in multimodal biometric verification , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).