A real time automatic access control system based on face and eye corners detection, face recognition and speaker identification

We have recently developed a real time automatic access control system suing both face and voice identification. We show that combining these two modalities achieves high recognition accuracy, especially in difficult recognition scenarios. Our system also supports online training of the user models, i.e., a person who has not been registered in the database can be added on the spot in real time. This system is composed of a face and eye corners detection module, a face recognition module, a speaker identification module, and a user interface module. We present the algorithm of each module with more emphasis on our information maximization based face and eye corners detection and user interface design. We discuss some issues related to the integration of components into the total system. We report the experimental results of the system performance together with comparison with those of some other systems.

[1]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[2]  Weicheng Shen,et al.  Prolog To Face Recognition: Eigenface, Elastic Matching, And Neural Nets , 1997 .

[3]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[4]  Ziyou Xiong,et al.  Improved information maximization based face and facial feature detection from real-time video and application in a multi-modal person identification system , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[5]  Douglas A. Reynolds,et al.  Robust text-independent speaker identification using Gaussian mixture speaker models , 1995, IEEE Trans. Speech Audio Process..

[6]  Thomas S. Huang,et al.  Face detection with information-based maximum discrimination , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[8]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[11]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[12]  J. Kruskal.  On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[13]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.