Multilayer graph cuts based unsupervised color-texture image segmentation using multivariate mixed student's t-distribution and regional credibility merging

This paper proposes an unsupervised color-texture image segmentation method. In order to enhance the effects of segmentation, a new color-texture descriptor is designed by integrating the compact multi-scale structure tensor (MSST), total variation (TV) flow, and the color information. Due to the fact that MSST does not work well for separating regions with large-scale texture, the total variation flow is used to auxiliarily describe the texture feature by extracting local scale information. To segment the color-texture image in an unsupervised and multi-label way, the multivariate mixed student's t-distribution (MMST) is chosen for probability distribution modeling, as MMST can describe the distribution of color-texture features accurately. Since the valid class number is hard to adaptively determine in advance, a component-wise expectation-maximization for MMST (CEM^3ST) algorithm is proposed, which can effectively initialize the valid class number. Then, we can build up the energy functional according to the valid class number, and optimize it by multilayer graph cuts method. However, the problem of over/error-segmentation often happens. To overcome this problem, a strategy of regional credibility merging (RCM) is presented by integrating the regional adjacency relationship, region size, common edge between regions, and regional color-texture dissimilarity. In order to terminate the whole segmentation process, an adaptive iteration convergence criterion is designed, which combines the negative logarithm of probability of all color-texture features with the Kullback-Leibler (KL) divergence for MMST. Experiments using a large number of synthesis color-texture images and real natural scene images demonstrate the superiority of our proposed method, such as the effective over/error-segmentation reduction, high segmentation accuracy, and outperforming visual entirety/consistency.

[1]  Jie Yang,et al.  Color Texture Segmentation Using Quaternion-Gabor Filters , 2006, 2006 International Conference on Image Processing.

[2]  Paul F. Whelan,et al.  Image segmentation based on the integration of colour-texture descriptors - A review , 2011, Pattern Recognit..

[3]  Rama Chellappa,et al.  Probabilistic Distance Measures in Reproducing Kernel Hibert Space , 2004 .

[4]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[6]  Shy Shoham,et al.  Robust, automatic spike sorting using mixtures of multivariate t-distributions , 2003, Journal of Neuroscience Methods.

[7]  Max Mignotte,et al.  MDS-Based Multiresolution Nonlinear Dimensionality Reduction Model for Color Image Segmentation , 2011, IEEE Transactions on Neural Networks.

[8]  Xiaoqiang Li,et al.  Graph Cuts based image segmentation using local color and texture , 2011, 2011 4th International Congress on Image and Signal Processing.

[9]  E. A. Dinic.  Algorithm for solution of a problem of maximal flow in a network with power estimation , 1970 .

[10]  Paul F. Whelan,et al.  A generic framework for colour texture segmentation , 2010 .

[11]  Wenbing Tao,et al.  Image segmentation by iterative optimization of multiphase multiple piecewise constant model and Four-Color relabeling , 2011, Pattern Recognit..

[12]  M.J. Ferreira,et al.  Texture Segmentation Based On Fuzzy Grammar for Cork Parquet Quality Control , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[13]  Wenbing Tao,et al.  Image Segmentation Based on GrabCut Framework Integrating Multiscale Nonlinear Structure Tensor , 2009, IEEE Transactions on Image Processing.

[14]  Rachid Deriche,et al.  DTI segmentation by statistical surface evolution , 2006, IEEE Transactions on Medical Imaging.

[15]  Paul F. Whelan,et al.  CTex-An Adaptive Unsupervised Segmentation Algorithm based on Colour-Texture Coherence , 2022 .

[16]  T. Lonnestad.  A new set of texture features based on the Haar transform , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol. III. Conference C: Image, Speech and Signal Analysis,.

[17]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Arnold W. M. Smeulders,et al.  Color texture measurement and segmentation , 2005, Signal Process..

[19]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[20]  Hans M. Aus,et al.  Combined local color and texture analysis of stained cells , 1986, Comput. Vis. Graph. Image Process..

[21]  Ioannis Pitas,et al.  Color Texture Segmentation Based on the Modal Energy of Deformable Surfaces , 2009, IEEE Transactions on Image Processing.

[22]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Liangliang Cao,et al.  Image Segmentation by MAP-ML Estimations , 2010, IEEE Transactions on Image Processing.

[24]  André Ricardo Backes,et al.  Color texture analysis based on fractal descriptors , 2012, Pattern Recognit..

[25]  Shimon Even,et al.  Graph Algorithms: Flow in Networks , 2011 .

[26]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[27]  A. McNeil.  Multivariate t Distributions and Their Applications , 2006 .

[28]  Rama Chellappa,et al.  From sample similarity to ensemble similarity: probabilistic distance measures in reproducing kernel Hilbert space , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Mark Q. Shaw,et al.  Automatic Image Segmentation by Dynamic Region Growth and Multiresolution Merging , 2009, IEEE Transactions on Image Processing.

[31]  Jean-Marc Boucher,et al.  Multisource classification using ICM and Dempster-Shafer theory , 2002, IEEE Trans. Instrum. Meas..

[32]  Geoffrey J. McLachlan,et al.  Gene expression Segmentation and intensity estimation of microarray images using a gamma-t mixture model , 2007 .

[33]  Liangliang Cao,et al.  Iterative MAP and ML Estimations for Image Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Jong-Sen Lee,et al.  Target Detection and Texture Segmentation in Polarimetric SAR Images Using a Wavelet Frame: Theoretical Aspects , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Michal Strzelecki,et al.  Texture Analysis Methods - A Review , 1998 .

[36]  R. B. Potts.  Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[37]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[38]  Isabelle Bloch.  Information combination operators for data fusion: a comparative review with classification , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[39]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[40]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Rachid Deriche,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Colour, Texture, and Motion in Level Set Based Segmentation and Tracking Colour, Texture, and Motion in Level Set Based Segmentation and Tracking , 2022 .

[42]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[43]  Ki-Sang Hong,et al.  Color-texture segmentation using unsupervised graph cuts , 2009, Pattern Recognit..

[44]  Wenbing Tao,et al.  Interactively multiphase image segmentation based on variational formulation and graph cuts , 2010, Pattern Recognit..

[45]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Nasir M. Rajpoot,et al.  Local discriminant wavelet packet basis for texture classification , 2003, SPIE Optics + Photonics.

[47]  Wenbing Tao,et al.  Texture segmentation using independent-scale component-wise Riemannian-covariance Gaussian mixture model in KL measure based multi-scale nonlinear structure tensor space , 2011, Pattern Recognit..

[48]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Anil K. Jain,et al.  Multisource classification of remotely sensed data: fusion of Landsat TM and SAR images , 1994, IEEE Trans. Geosci. Remote. Sens..

[51]  Metin Nafi Gürcan,et al.  Content-Based Microscopic Image Retrieval System for Multi-Image Queries , 2012, IEEE Transactions on Information Technology in Biomedicine.

[52]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[53]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[54]  Andreas Uhl,et al.  Image similarity measurement by Kullback-Leibler divergences between complex wavelet subband statistics for texture retrieval , 2008, 2008 15th IEEE International Conference on Image Processing.

[55]  Martial Hebert,et al.  Measures of Similarity , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[56]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[57]  Patrick Lambert,et al.  Improved Cut Detection for the Segmentation of Animation Movies , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[58]  Trygve Randen,et al.  Filtering for Texture Classification: A Comparative Study , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Joost van de Weijer,et al.  Describing Reflectances for Color Segmentation Robust to Shadows, Highlights, and Textures , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Haim H. Permuter,et al.  A study of Gaussian mixture models of color and texture features for image classification and segmentation , 2006, Pattern Recognit..

[61]  Max Mignotte,et al.  A hierarchical graph-based markovian clustering approach for the unsupervised segmentation of textured color images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[62]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[63]  Samuel Kotz,et al.  Estimation Methods for the Multivariate t Distribution , 2008 .

[64]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[65]  C. C. Reyes-Aldasoroa,et al.  The Bhattacharyya space for feature selection and its application to texture segmentation , 2006 .

[66]  Thomas Brox,et al.  A TV Flow Based Local Scale Measure for Texture Discrimination , 2004, ECCV.

[67]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[68]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Luis Mateus Rocha,et al.  Singular value decomposition and principal component analysis , 2003 .

[70]  Wang Hui,et al.  Color Texture Segmentation Using Quaternion-Gabor Filters , 2006 .

[71]  Josef Kittler,et al.  Defect detection in random colour textures , 1996, Image Vis. Comput..

[72]  Catherine Garbay,et al.  Image Structure Representation and Processing: A Discussion of Some Segmentation Methods in Cytology , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[74]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[76]  Wenbing Tao.  Iterative Narrowband-Based Graph Cuts Optimization for Geodesic Active Contours With Region Forces (GACWRF) , 2012, IEEE Transactions on Image Processing.

[77]  Jing'ai Wang,et al.  A composed statistical pattern recognition and geosciences analysis approach for segmentation-based remotely sensed imagery classification , 2011, 2011 19th International Conference on Geoinformatics.

[78]  Edward Jones,et al.  Shadow identification for digital imagery using colour and texture cues , 2012 .

[79]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[80]  Lance M. Kaplan,et al.  Texture Segmentation via Haar Fractal Feature Estimation , 1995, J. Vis. Commun. Image Represent..

[81]  Lilong Shi,et al.  Quaternion color texture segmentation , 2007, Comput. Vis. Image Underst..

[82]  Mohand Saïd Allili,et al.  Wavelet Modeling Using Finite Mixtures of Generalized Gaussian Distributions: Application to Texture Discrimination and Retrieval , 2012, IEEE Transactions on Image Processing.

[83]  DeLiang Wang,et al.  Scene analysis by integrating primitive segmentation and associative memory , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[84]  Josef Kittler,et al.  Automatic watershed segmentation of randomly textured color images , 1997, IEEE Trans. Image Process..

[85]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[86]  Xavier Lladó,et al.  Colour Texture Segmentation by Region-Boundary Cooperation , 2004, ECCV.