Recognition of human head orientation based on artificial neural networks

Humans easily recognize where another person is looking and often use this information for interspeaker coordination. We present a method based on three neural networks of the local linear map type which enables a computer to identify the head orientation of a user by learning from examples. One network is used for color segmentation, a second for localization of the face, and the third for the final recognition of the head orientation. The system works at a frame rate of one image per second on a common workstation, We analyze the accuracy achieved at different processing steps and discuss the usability of the approach in the context of a visual human-machine interface.

[1]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[2]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[3]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[4]  Michael I. Jordan,et al.  A Competitive Modular Connectionist Architecture , 1990, NIPS.

[5]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[6]  Helge Ritter,et al.  Learning 3D-shape perception with local linear maps , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[7]  Gilles Burel,et al.  Detection and localization of faces on digital images , 1994, Pattern Recognit. Lett..

[8]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[9]  Roberto Cipolla,et al.  Determining the gaze of faces in images , 1994, Image Vis. Comput..

[10]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[11]  George C. Stockman,et al.  Controlling a computer via facial aspect , 1995, IEEE Trans. Syst. Man Cybern..

[12]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[13]  Andrea Drees,et al.  Visuelle Erkennung von Handstellungen mit neuronalen Netzen , 1996, DISKI.

[14]  Helge J. Ritter,et al.  A neural 3-D object recognition architecture using optimized Gabor filters , 1996, Proceedings of 13th International Conference on Pattern Recognition.