Convex-Relaxed Kernel Mapping for Image Segmentation

This paper investigates a convex-relaxed kernel mapping formulation of image segmentation. We optimize, under some partition constraints, a functional containing two characteristic terms: 1) a data term, which maps the observation space to a higher (possibly infinite) dimensional feature space via a kernel function, thereby evaluating nonlinear distances between the observations and segments parameters and 2) a total-variation term, which favors smooth segment surfaces (or boundaries). The algorithm iterates two steps: 1) a convex-relaxation optimization with respect to the segments by solving an equivalent constrained problem via the augmented Lagrange multiplier method and 2) a convergent fixed-point optimization with respect to the segments parameters. The proposed algorithm can bear with a variety of image types without the need for complex and application-specific statistical modeling, while having the computational benefits of convex relaxation. Our solution is amenable to parallelized implementations on graphics processing units (GPUs) and extends easily to high dimensions. We evaluated the proposed algorithm with several sets of comprehensive experiments and comparisons, including: 1) computational evaluations over 3D medical-imaging examples and high-resolution large-size color photographs, which demonstrate that a parallelized implementation of the proposed method run on a GPU can bring a significant speed-up and 2) accuracy evaluations against five state-of-the-art methods over the Berkeley color-image database and a multimodel synthetic data set, which demonstrates competitive performances of the algorithm.

[1]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[4]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[5]  Rachid Deriche,et al.  DTI segmentation by statistical surface evolution , 2006, IEEE Transactions on Medical Imaging.

[6]  Song-Chun Zhu,et al.  Statistical Modeling and Conceptualization of Visual Patterns , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[8]  Zhigang Luo,et al.  Non-Negative Patch Alignment Framework , 2011, IEEE Transactions on Neural Networks.

[9]  John K. Tsotsos,et al.  Efficient and generalizable statistical models of shape and appearance for analysis of cardiac MRI , 2008, Medical Image Anal..

[10]  Allen Y. Yang,et al.  Unsupervised segmentation of natural images via lossy data compression , 2008, Comput. Vis. Image Underst..

[11]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[12]  Tong Fang,et al.  Statistical region-based segmentation of ultrasound images. , 2009, Ultrasound in medicine & biology.

[13]  Xavier Bresson,et al.  Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction , 2010, J. Sci. Comput..

[14]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[15]  Vladimir Kolmogorov,et al.  What metrics can be approximated by geo-cuts, or global optimization of length/area and flux , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Xue-Cheng Tai,et al.  A Continuous Max-Flow Approach to Potts Model , 2010, ECCV.

[18]  Xue-Cheng Tai,et al.  A study on continuous max-flow and min-cut approaches , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  John Shawe-Taylor,et al.  MahNMF: Manhattan Non-negative Matrix Factorization , 2012, ArXiv.

[20]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[22]  Ghassan Hamarneh,et al.  Mammography Segmentation with Maximum Likelihood Active Contours , 2022 .

[23]  J. Nobre,et al.  SAR Image Segmentation Based on Level Set Approach and {\cal G}_A^0 Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  E. Giusti Minimal surfaces and functions of bounded variation , 1977 .

[25]  Yusen Dong,et al.  Comparison of radar image segmentation by Gaussian- and Gamma-Markov random field models , 2003 .

[26]  Maurizio di Bisceglie,et al.  CFAR detection of extended objects in high-resolution SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Patrick Pérez,et al.  Sonar image segmentation using an unsupervised hierarchical MRF model , 2000, IEEE Trans. Image Process..

[28]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[29]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[30]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  R. Tyrrell Rockafellar,et al.  Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming , 1976, Math. Oper. Res..

[32]  Martial Hebert,et al.  A Measure for Objective Evaluation of Image Segmentation Algorithms , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[33]  Amar Mitiche,et al.  Effective Level Set Image Segmentation With a Kernel Induced Data Term , 2010, IEEE Transactions on Image Processing.

[34]  Amar Mitiche,et al.  Multiregion level-set partitioning of synthetic aperture radar images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Amar Mitiche,et al.  Variational and Level Set Methods in Image Segmentation , 2010 .

[37]  Z. Wang,et al.  Convex relaxation for image segmentation by kernel mapping , 2012, 2012 19th IEEE International Conference on Image Processing.

[38]  R. Rockafellar The multiplier method of Hestenes and Powell applied to convex programming , 1973 .

[39]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[40]  Josiane Zerubia,et al.  A Level Set Model for Image Classification , 1999, International Journal of Computer Vision.

[41]  Philippe Réfrégier,et al.  Influence of the noise model on level set active contour segmentation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[43]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[45]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[46]  Amar Mitiche,et al.  Multiregion Image Segmentation by Parametric Kernel Graph Cuts , 2011, IEEE Transactions on Image Processing.

[47]  Daniel Cremers,et al.  An Experimental Comparison of Discrete and Continuous Shape Optimization Methods , 2008, ECCV.

[48]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Rick Archibald,et al.  Improving the accuracy of volumetric segmentation using pre-processing boundary detection and image reconstruction , 2004, IEEE Transactions on Image Processing.

[50]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .