Multiscale gradient watersheds of color images

We present a new framework for the hierarchical segmentation of color images. The proposed scheme comprises a nonlinear scale-space with vector-valued gradient watersheds. Our aim is to produce a meaningful hierarchy among the objects in the image using three image components of distinct perceptual significance for a human observer, namely strong edges, smooth segments and detailed segments. The scale-space is based on a vector-valued diffusion that uses the Additive Operator Splitting numerical scheme. Furthermore, we introduce the principle of the dynamics of contours in scale-space that combines scale and contrast information. The performance of the proposed segmentation scheme is presented via experimental results obtained with a wide range of images including natural and artificial scenes.

[1]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  Jon Sporring,et al.  Segmenting by Compression Using Linear Scale-Space and Watersheds , 1999, Scale-Space.

[3]  Antonin Chambolle,et al.  Partial differential equations and image processing , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Ioannis Pratikakis,et al.  Automatic Watershed Segmentation of Color Images , 2000, ISMM.

[5]  Philippe Salembier,et al.  Morphological tools for segmentation : connected filters and watersheds , 1997, Ann. des Télécommunications.

[6]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[7]  Fernand Meyer,et al.  Hierarchies of Partitions and Morphological Segmentation , 2001, Scale-Space.

[8]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jenq-Neng Hwang,et al.  Nonparametric multivariate density estimation: a comparative study , 1994, IEEE Trans. Signal Process..

[10]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[11]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[12]  Joachim Weickert.  Fast Segmentation Methods Based on Partial Differential Equations and the Watershed Transformation , 1998, DAGM-Symposium.

[13]  Guido Gerig,et al.  Vector-Valued Diffusion , 1994, Geometry-Driven Diffusion in Computer Vision.

[14]  Laurent Najman,et al.  Geodesic Saliency of Watershed Contours and Hierarchical Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Michael Kerckhove,et al.  Scale-Space and Morphology in Computer Vision , 2001, Lecture Notes in Computer Science 2106.

[16]  Yee-Hong Yang,et al.  Multiresolution Color Image Segmentation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Mads Nielsen,et al.  Multiscale Gradient Magnitude Watershed Segmentation , 1997, ICIAP.

[18]  John M. Gauch,et al.  Image segmentation and analysis via multiscale gradient watershed hierarchies , 1999, IEEE Trans. Image Process..

[19]  Moshe Israeli,et al.  An Accurate Operator Splitting Scheme for Nonlinear Diffusion Filtering , 2001, Scale-Space.

[20]  Majid Mirmehdi,et al.  Segmentation of Color Textures , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Paul T. Jackway,et al.  Gradient watersheds in morphological scale-space , 1996, IEEE Trans. Image Process..

[22]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[23]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[24]  Michel Grimaud,et al.  New measure of contrast: the dynamics , 1992, Optics & Photonics.

[25]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[26]  José Crespo,et al.  The Flat Zone Approach and Color Images , 1994, ISMM.

[27]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  John M. Gauch,et al.  Multiresolution Analysis of Ridges and Valleys in Grey-Scale Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Josef Kittler,et al.  Automatic watershed segmentation of randomly textured color images , 1997, IEEE Trans. Image Process..

[30]  Zhouchen Lin,et al.  An anisotropic diffusion PDE for noise reduction and thin edge preservation , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[31]  Hichem Sahli,et al.  Scale space segmentation of color images using watersheds and fuzzy region merging , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[32]  Hichem Sahli,et al.  Hierarchical Segmentation Using Dynamics of Multiscale Color Gradient Watersheds , 2001, Scale-Space.

[33]  Danny De Vleeschauwer,et al.  Activity driven nonlinear diffusion for color image watershed segmentation , 1999, J. Electronic Imaging.

[34]  Ron Kimmel,et al.  Geometry Motivated Variational Segmentation for Color Images , 2001, Scale-Space.

[35]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[36]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[37]  Serge Beucher,et al.  Watershed, Hierarchical Segmentation and Waterfall Algorithm , 1994, ISMM.

[38]  Guillermo Sapiro,et al.  Anisotropic diffusion of multivalued images with applications to color filtering , 1996, IEEE Trans. Image Process..

[39]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[40]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[41]  Scott T. Acton,et al.  Automated segmentation of surface soil moisture from Landsat TM data , 1998, 1998 IEEE Southwest Symposium on Image Analysis and Interpretation (Cat. No.98EX165).

[42]  L. Lucchese,et al.  Color Segmentation Based on Separate Anisotropic Diffusion of Chromatic and Achromatic Channels , 2001 .

[43]  Philippe Salembier,et al.  Flat zones filtering, connected operators, and filters by reconstruction , 1995, IEEE Trans. Image Process..

[44]  Max A. Viergever,et al.  Probabilistic Multiscale Image Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Arnold W. M. Smeulders,et al.  PicToSeek: combining color and shape invariant features for image retrieval , 2000, IEEE Trans. Image Process..

[46]  Serge Beucher.  Segmentation d'images et morphologie mathématique , 1990 .

[47]  Scott T. Acton,et al.  Watershed pyramids for edge detection , 1997, Proceedings of International Conference on Image Processing.