Factorization-Based Texture Segmentation

This paper introduces a factorization-based approach that efficiently segments textured images. We use local spectral histograms as features, and construct an M × N feature matrix using M-dimensional feature vectors in an N-pixel image. Based on the observation that each feature can be approximated by a linear combination of several representative features, we factor the feature matrix into two matrices-one consisting of the representative features and the other containing the weights of representative features at each pixel used for linear combination. The factorization method is based on singular value decomposition and nonnegative matrix factorization. The method uses local spectral histograms to discriminate region appearances in a computationally efficient way and at the same time accurately localizes region boundaries. The experiments conducted on public segmentation data sets show the promise of this simple yet powerful approach.

[1]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[2]  Josiane Zerubia,et al.  Hierarchical Multiple Markov Chain Model for Unsupervised Texture Segmentation , 2009, IEEE Transactions on Image Processing.

[3]  DeLiang Wang,et al.  Image segmentation using local spectral histograms and linear regression , 2012, Pattern Recognit. Lett..

[4]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[6]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[7]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[8]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[9]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[12]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Oscar C. Au,et al.  Bag of textons for image segmentation via soft clustering and convex shift , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[15]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[16]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Georgios Tziritas,et al.  Natural Image Segmentation Based on Tree Equipartition, Bayesian Flooding and Region Merging , 2011, IEEE Transactions on Image Processing.

[18]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[19]  Lewis D. Griffin,et al.  Using Basic Image Features for Texture Classification , 2010, International Journal of Computer Vision.

[20]  Tae Jin Kang,et al.  Texture classification and segmentation using wavelet packet frame and Gaussian mixture model , 2007, Pattern Recognit..

[21]  Ronen Basri,et al.  Texture segmentation by multiscale aggregation of filter responses and shape elements , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Paul W. Fieguth,et al.  Texture Classification from Random Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Michael Lindenbaum,et al.  Nonnegative Matrix Factorization with Earth Mover's Distance Metric for Image Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Yong Xu,et al.  Wavelet Domain Multifractal Analysis for Static and Dynamic Texture Classification , 2013, IEEE Transactions on Image Processing.

[25]  Michal Haindl,et al.  Model-Based Texture Segmentation , 2004, ICIAR.

[26]  C. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[27]  Amy Nicole Langville,et al.  Algorithms, Initializations, and Convergence for the Nonnegative Matrix Factorization , 2014, ArXiv.

[28]  Michal Haindl,et al.  Unsupervised Texture Segmentation Using Multispectral Modelling Approach , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[29]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[30]  Deliang Wang,et al.  A spectral histogram model for texton modeling and texture discrimination , 2002, Vision Research.

[31]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[32]  Jitendra Malik,et al.  Contour and Texture Analysis for Image Segmentation , 2001, International Journal of Computer Vision.

[33]  Dustin G. Mixon,et al.  Images as Occlusions of Textures: A Framework for Segmentation , 2014, IEEE Transactions on Image Processing.

[34]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[35]  Hossein Mobahi,et al.  Segmentation of Natural Images by Texture and Boundary Compression , 2011, International Journal of Computer Vision.

[36]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[37]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[38]  Narendra Ahuja,et al.  Texel-based texture segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[40]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[42]  D. Wang,et al.  Image and Texture Segmentation Using Local Spectral Histograms , 2006, IEEE Transactions on Image Processing.

[43]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[44]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Michal Haindl,et al.  Texture segmentation benchmark , 2008, 2008 19th International Conference on Pattern Recognition.