Lip contour extraction scheme using morphological reconstruction based segmentation

In this paper, a two stage lip contour extraction scheme is proposed, where at the first stage, pixel intensity variation based information is used for obtaining a preliminary estimation of lip and in the second stage, morphological reconstruction based segmentation is employed to detect the final lip region. From a given video frame, first the mouth region is extracted by using block threshold based binary conversion and some morphological operation. Analysing the variation of RGB pixel intensity pattern, intensity ratio based lip region detection is performed, which provides an accurate estimate of lower lip region. However, because of critical shape of the upper lip, further processing is carried out by using morphological opening by reconstruction. Finally, polynomial curve fit is performed to obtain the lip contour. From extensive experimentation on several real-life images from audio-visual clips, it is found that the proposed method offers high level of accuracy in image.

[1]  Sridha Sridharan,et al.  Initialised eigenlip estimator for fast lip tracking using linear regression , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Kah Phooi Seng,et al.  Lips detection for audio-visual speech recognition system , 2009, 2008 International Symposium on Intelligent Signal Processing and Communications Systems.

[3]  Ulrich Canzler,et al.  Extraction of Non Manual Features for Videobased Sign Language Recognition , 2002, MVA.

[4]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[5]  Jagdish Lal Raheja,et al.  Facial Gesture Identification Using Lip Contours , 2010, 2010 Second International Conference on Machine Learning and Computing.

[6]  S. Yaacob,et al.  Japanese Face Emotions Classification Using LIP Features , 2007, Geometric Modeling and Imaging (GMAI '07).

[7]  Lip Contour Modeling Based on Active Shape Model , 2012, 2012 Fifth International Conference on Intelligent Networks and Intelligent Systems.

[8]  Tomaso Poggio,et al.  Synthesizing a color algorithm from examples , 1988 .

[9]  Nayoung Lee,et al.  Facial Landmark Extraction for Lip Tracking of Patients with Cleft Lip Using Active Appearance Model , 2011, HCI.

[10]  Vijay Laxmi,et al.  Speaker identification using optimal lip biometrics , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[11]  Narendra M Patel,et al.  DToLIP: Detection and tracking of lip contours from human facial images using Snake's method , 2011, 2011 International Conference on Image Information Processing.

[12]  Wen-Nung Lie,et al.  Lips detection by morphological image processing , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[13]  T. Poggio,et al.  Synthesizing a color algorithm from examples. , 1988, Science.

[14]  Dibyendu Ghoshal,et al.  Extraction of time invariant lips based on Morphological Operation and Corner Detection Method , 2012 .

[15]  Shu Hung Leung,et al.  Lip image segmentation using fuzzy clustering incorporating an elliptic shape function , 2004, IEEE Transactions on Image Processing.