Advances in Variational Image Segmentation Using AM-FM Models: Regularized Demodulation and Probabilistic Cue Integration

Current state-of-the-art methods in variational image segmentation using level set methods are able to robustly segment complex textured images in an unsupervised manner. In recent work, [18,19] we have explored the potential of AM-FM features for driving the unsupervised segmentation of a wide variety of textured images. Our first contribution in this work is at the feature extraction level, where we introduce a regularized approach to the demodulation of the AM-FM -modelled signals. By replacing the cascade of multiband filtering and subsequent differentiation with analytically derived equivalent filtering operations, increased noise-robustness can be achieved, while discretization problems in the implementation of the demodulation algorithm are alleviated. Our second contribution is based on a generative model we have recently proposed [18,20] that offers a measure related to the local prominence of a specific class of features, like edges and textures. The introduction of these measures as weighting terms in the evolution equations facilitates the fusion of different cues in a simple and efficient manner. Our systematic evaluation on the Berkeley segmentation benchmark demonstrates that this fusion method offers improved results when compared to our previous work as well as current state-of-the-art methods.

[1]  Nir Sochen,et al.  Texture segmentation via a diffusion-segmentation scheme in the Gabor feature space , 2004 .

[2]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[3]  Alfredo Restrepo,et al.  Localized measurement of emergent image frequencies by Gabor wavelets , 1992, IEEE Trans. Inf. Theory.

[4]  Thomas S. Huang,et al.  Image processing , 1971 .

[5]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[6]  Jitendra Malik,et al.  An empirical approach to grouping and segmentation , 2002 .

[7]  Petros Maragos,et al.  Image demodulation using multidimensional energy separation , 1995 .

[8]  Thomas Brox,et al.  A TV Flow Based Local Scale Measure for Texture Discrimination , 2004, ECCV.

[9]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[10]  I. Kokkinos,et al.  A Detection-Theoretic Approach to Texture and Edge Discrimination , 2005 .

[11]  Rachid Deriche,et al.  Geodesic Active Regions: A New Framework to Deal with Frame Partition Problems in Computer Vision , 2002, J. Vis. Commun. Image Represent..

[12]  Taein Lee,et al.  Active contour models , 2005 .

[13]  E. Gumbel,et al.  The Circular Normal Distribution: Theory and Tables , 1953 .

[14]  Anthony J. Yezzi,et al.  A statistical approach to snakes for bimodal and trimodal imagery , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Christoph Schnörr,et al.  Natural Image Statistics for Natural Image Segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[18]  Rachid Deriche,et al.  Active unsupervised texture segmentation on a diffusion based feature space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[20]  Alan C. Bovik,et al.  Reconstruction from the multi-component AM-FM image representation , 1995, Proceedings., International Conference on Image Processing.

[21]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[22]  Rachid Deriche,et al.  Geodesic active regions for supervised texture segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Tony F. Chan,et al.  A Level-Set and Gabor-based Active Contour Algorithm for Segmenting Textured Images , 2002 .

[24]  D CohenLaurent On active contour models and balloons , 1991 .

[25]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[27]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Stanley Osher,et al.  Level Set Methods , 2003 .

[29]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[30]  Tai Sing Lee,et al.  Texture Segmentation by Minimizing Vector-Valued Energy Functionals: The Coupled-Membrane Model , 1992, ECCV.

[31]  Iasonas Kokkinos,et al.  Modulation-feature based textured image segmentation using curve evolution , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[32]  Alan C. Bovik,et al.  Multidimensional quasi-eigenfunction approximations and multicomponent AM-FM models , 2000, IEEE Trans. Image Process..

[33]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[35]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[36]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[37]  John W. Fisher,et al.  Nonparametric methods for image segmentation using information theory and curve evolution , 2002, Proceedings. International Conference on Image Processing.

[38]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[39]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Petros Maragos,et al.  Robust energy demodulation based on continuous models with application to speech recognition , 2003, INTERSPEECH.

[41]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[42]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[43]  Petros Maragos,et al.  A comparison of the energy operator and the Hilbert transform approach to signal and speech demodulation , 1994, Signal Process..

[44]  Marios S. Pattichis,et al.  Active contour segmentation guided by AM-FM dominant component analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[45]  Rachid Deriche,et al.  Geodesic active contours for supervised texture segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[46]  Alan L. Yuille,et al.  A regularized solution to edge detection , 1985, J. Complex..

[47]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[48]  Iasonas Kokkinos,et al.  Advances in texture analysis: energy dominant component & multiple hypothesis testing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[49]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[50]  Petros Maragos,et al.  AM-FM energy detection and separation in noise using multiband energy operators , 1993, IEEE Trans. Signal Process..

[51]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..