An automatic segmentation of color images by using a combination of mixture modelling and adaptive region information: a level set approach

In this paper, we propose a novel automatic framework for variational color image segmentation based on unifying adaptive region information and mixture modelling. We consider a formulation of the region information based on the posterior probability of a mixture of general Gaussian (GG) pdfs where each region is represented by a pdf. The segmentation is formulated by the minimization of an energy functional according to the region contours and all the mixture parameters respectively. Two main objectives are achieved by the approach. A scheme is provided to extend easily the adaptive segmentation to an arbitrary number of regions and to perform it in a fully automatic fashion. Moreover, the segmentation recovers an accurate and representative mixture of pdfs. In the approach, we couple the boundary and region information of the image to steer the segmentation. We validate the method on the segmentation of real world color images.

[1]  R. Deriche,et al.  A variational framework for active and adaptative segmentation of vector valued images , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[2]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[3]  Alex Waibel,et al.  A model-based gaze tracking system , 1996, Proceedings IEEE International Joint Symposia on Intelligence and Systems.

[4]  Hervé Glotin,et al.  Large-vocabulary audio-visual speech recognition: a summary of the Johns Hopkins Summer 2000 Workshop , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[5]  Alice Caplier,et al.  Accurate and quasi-automatic lip tracking , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Josef Kittler,et al.  Real Time Segmentation of Lip Pixels for Lip Tracker Initialization , 2001, CAIP.

[7]  H. Akaike.  A new look at the statistical model identification , 1974 .

[8]  Rachid Deriche,et al.  Unifying boundary and region-based information for geodesic active tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  J. Sethian.  Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[10]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[11]  Chalapathy Neti,et al.  Recent advances in the automatic recognition of audiovisual speech , 2003, Proc. IEEE.

[12]  P. M. Hillman,et al.  Improved lip fitting and tracking for model-based multimedia and coding , 2005 .

[13]  A SethianJames,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[14]  P. Grant,et al.  Global fitting of a facial model to facial features for model-based video coding , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[15]  Georgios Tziritas,et al.  Bayesian Level Sets for Image Segmentation , 2002, J. Vis. Commun. Image Represent..

[16]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[17]  C. Drewniok,et al.  Multi-spectral edge detection. Some experiments on data from Landsat-TM , 1994 .

[18]  Ron Kimmel,et al.  Fast Edge Integration , 2003 .

[19]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[20]  Mongi A. Abidi,et al.  Reliable Location and Regression Estimates with Application to Range Image Segmentation , 2004, Journal of Mathematical Imaging and Vision.

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.