A New Approach to Mouth Detection Using Neural Network

This paper proposes a new method to detect mouth in color image. Instead of segmenting images based on lip color (like other methods often do), we segment images based on skin. After that, we add some specific techniques to approach the mouth in color image efficiently to determine mouth candidates quickly and then classify mouth candidates by neural network. Therefore, the runtime of method is improved remarkably and the result is good (about 85.5%). Moreover, this method allows robust mouth detection under different light conditions and with any particular make-up.

[1]  Alice Caplier,et al.  New color transformation for lips segmentation , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[2]  A. Sheikholeslami,et al.  Real-time face detection and lip feature extraction using field-programmable gate arrays , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Thorsten Gernoth,et al.  Mouth center detection under active near infrared illumination , 2007 .

[4]  Walid Mahdi,et al.  Automatic Hybrid Approach for Lip POI Localization : Application for Lip-reading System , 2007 .

[5]  Juergen Luettin,et al.  Speechreading using shape and intensity information , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[6]  Maja Pantic,et al.  A hybrid approach to mouth features detection , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[7]  Conclusions , 1989 .

[8]  Jean-Philippe Thiran,et al.  Automatic Extraction of Geometric Lip Features with Application to Multi-Modal Speaker Identification , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  A. Murat Tekalp,et al.  Lip feature extraction based on audio-visual correlation , 2005, 2005 13th European Signal Processing Conference.

[10]  Michael Wagner,et al.  Liveness Verification in Audio-Video Speaker Authentication , 2004 .