Person Identification Using Lip Motion Sequence

In this paper, we propose a new method based on lip motion sequence and the Unconstrained Minimum Average Correlation Energy (UMACE) filter as a classifier for person identification. UMACE filter has advantages in terms of their characteristics such as distortion-tolerant, shift-invariant and high discrimination ability. Therefore, executing UMACE filter provides an ideal application for person identification because we deal with the variations of the lip appearance in each frame sequence. The results obtained using a Digit Database show that the use of lip motion sequence and UMACE filter offer a good potential and can be an alternative technique for a person identification system.

[1]  B. V. K. Vijaya Kumar,et al.  Spatial frequency domain image processing for biometric recognition , 2002, Proceedings. International Conference on Image Processing.

[2]  Josef Bigün,et al.  Person Verification by Lip-Motion , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[3]  William M. Campbell,et al.  A SVM/HMM system for speaker recognition , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[4]  Richard B. Reilly,et al.  Robust multi-modal person identification with tolerance of facial expression , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[5]  B. V. K. Vijaya Kumar,et al.  Incremental updating of advanced correlation filters for biometric authentication systems , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[6]  Chalapathy Neti,et al.  Improved ROI and within frame discriminant features for lipreading , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  X. Zhang,et al.  Automatic speechreading with application to speaker verification , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  David Zhang,et al.  An adaptive model of person identification combining speech and image information , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[10]  Chalapathy Neti,et al.  Recent advances in the automatic recognition of audiovisual speech , 2003, Proc. IEEE.

[11]  B. V. K. Vijaya Kumar,et al.  Fingerprint Verification Using Correlation Filters , 2003, AVBPA.

[12]  Douglas A. Reynolds,et al.  An overview of automatic speaker recognition technology , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  S. Sridharan,et al.  A syntactic approach to automatic lip feature extraction for speaker identification , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[14]  Michael Wagner,et al.  Liveness Verification in Audio-Video Speaker Authentication , 2004 .

[15]  Kuldip K. Paliwal,et al.  Noise compensation in a multi-modal verification system , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[16]  Timothy F. Cootes,et al.  Extraction of Visual Features for Lipreading , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Sridha Sridharan,et al.  The use of speech and lip modalities for robust speaker verification under adverse conditions , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[18]  David G. Stork,et al.  Visionary Speech: Looking Ahead to Practical Speechreading Systems , 1996 .

[19]  B. V. K. Vijaya Kumar,et al.  Efficient design of advanced correlation filters for robust distortion-tolerant face recognition , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[20]  David G. Stork,et al.  Speechreading by Humans and Machines , 1996 .