Segmentation of lip pixels for lip tracker initialisation

We propose a novel image segmentation method for lip tracker initialisation which is based on a Gaussian mixture model of the pixel RGB values. The model is built using the predictive validation technique advocated by Kittler, Messer and Sadeghi (see Second International Conference on Advances in Pattern Recognition, Brazil, March 2001) which has been modified to allow modelling with full covariance matrices. A subsequent grouping of the mixture components provides the basis for a Bayesian rule labelling of the pixels as lip or non-lip. We test the proposed method on a database of 145 images and demonstrate that its accuracy is significantly better than the segmentation obtained by k-means clustering. Moreover, the proposed method does not require the number of segments to be specified a priori.