Images as Occlusions of Textures: A Framework for Segmentation

We propose a new mathematical and algorithmic framework for unsupervised image segmentation, which is a critical step in a wide variety of image processing applications. We have found that most existing segmentation methods are not successful on histopathology images, which prompted us to investigate segmentation of a broader class of images, namely those without clear edges between the regions to be segmented. We model these images as occlusions of random images, which we call textures, and show that local histograms are a useful tool for segmenting them. Based on our theoretical results, we describe a flexible segmentation framework that draws on existing work on nonnegative matrix factorization and image deconvolution. Results on synthetic texture mosaics and real histology images show the promise of the method.

[1]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[3]  Alessandro Sarti,et al.  Cells Segmentation From 3-D Confocal Images of Early Zebrafish Embryogenesis , 2010, IEEE Transactions on Image Processing.

[4]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[5]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[6]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  R. Courant Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[8]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Yogesh Rathi,et al.  Image Segmentation Using Active Contours Driven by the Bhattacharyya Gradient Flow , 2007, IEEE Transactions on Image Processing.

[10]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[11]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Peter Meer,et al.  Synergism in low level vision , 2002, Object recognition supported by user interaction for service robots.

[13]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Marshall L. Fisher,et al.  An Applications Oriented Guide to Lagrangian Relaxation , 1985 .

[15]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jelena Kovacevic,et al.  Adaptive active-mask image segmentation for quantitative characterization of mitochondrial morphology , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  Michal Haindl,et al.  Texture segmentation benchmark , 2008, 2008 19th International Conference on Pattern Recognition.

[18]  Marina Meila,et al.  Comparing Clusterings by the Variation of Information , 2003, COLT.

[19]  Paul F. Whelan,et al.  Image segmentation based on the integration of colour-texture descriptors - A review , 2011, Pattern Recognit..

[20]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Jorge S. Marques,et al.  Robust Shape Tracking With Multiple Models in Ultrasound Images , 2008, IEEE Transactions on Image Processing.

[22]  Jelena Kovačević,et al.  Local histograms and image occlusion models. , 2011, Applied and computational harmonic analysis.

[23]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[24]  Gustavo K. Rohde,et al.  A General System for Automatic Biomedical Image Segmentation Using Intensity Neighborhoods , 2011, Int. J. Biomed. Imaging.

[25]  Ali Mohammad-Djafari,et al.  Joint NDT Image Restoration and Segmentation Using Gauss–Markov–Potts Prior Models and Variational Bayesian Computation , 2009, IEEE Transactions on Image Processing.

[26]  Cenk Sokmensuer,et al.  Multilevel Segmentation of Histopathological Images Using Cooccurrence of Tissue Objects , 2012, IEEE Transactions on Biomedical Engineering.

[27]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[29]  J. Kiefer,et al.  Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator , 1956 .

[30]  David Mumford,et al.  Occlusion Models for Natural Images: A Statistical Study of a Scale-Invariant Dead Leaves Model , 2004, International Journal of Computer Vision.

[31]  J. Ozolek,et al.  Teratomas Derived from Embryonic Stem Cells as Models for Embryonic Development, Disease, and Tumorigenesis , 2011 .

[32]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[33]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[34]  Jelena Kovacevic,et al.  Active Mask Segmentation of Fluorescence Microscope Images , 2009, IEEE Transactions on Image Processing.

[35]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[37]  H. Derin,et al.  Segmentation of textured images using Gibbs random fields , 1986 .

[38]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[39]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[40]  Paul F. Whelan,et al.  CTex-An Adaptive Unsupervised Segmentation Algorithm based on Colour-Texture Coherence , 2022 .

[41]  Louis K. Scheffer,et al.  Semi-automated reconstruction of neural circuits using electron microscopy , 2010, Current Opinion in Neurobiology.

[42]  A. Nehorai,et al.  Deconvolution methods for 3-D fluorescence microscopy images , 2006, IEEE Signal Processing Magazine.

[43]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[44]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[45]  Truong Q. Nguyen,et al.  A Novel Approach to FRUC Using Discriminant Saliency and Frame Segmentation , 2010, IEEE Transactions on Image Processing.

[46]  Ken Masamune,et al.  A Variational Method for Geometric Regularization of Vascular Segmentation in Medical Images , 2008, IEEE Transactions on Image Processing.

[47]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.