Color Image Labelling Using Linear Programming

This paper describes a linear programming (LP) algorithm for labelling (segmenting) a color image into multiple regions. Compared with the recently-proposed semi-definite programming (SDP) relaxation based algorithm, our algorithm has a simpler mathematical formulation, and a much lower computational complexity. In particular, to segment an image of M × N pixels into k classes, our algorithm requires only O((M N k)m) complexity--a sharp contrast to the complexity of O((M N k)2n ) offered by the SDP algorithm, where m and n are the polynomial degrees-of- complexity of the corresponding LP solver and SDP solver, respectively (in general we have m n). Moreover, LP has a significantly better scalability than SDP generally. This dramatic reduction in complexity enables our algorithm to process color images of reasonable sizes. For example, while the existing SDP relaxation algorithm is only able to segment a toy-size image of e.g. 10 × 10 30 × 30 pixels in a few hours, our algorithm can process larger color image of, say, 100 × 100 500 × 500 image in a much shorter time.

[1]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Hongdong Li,et al.  The 3D-3D Registration Problem Revisited , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Hongdong Li,et al.  Object-Respecting Color Image Segmentation , 2007, 2007 IEEE International Conference on Image Processing.

[5]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[6]  Jens Keuchel Multiclass Image Labeling with Semidefinite Programming , 2006, ECCV.

[7]  Hongdong Li,et al.  Two-View Motion Segmentation from Linear Programming Relaxation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[10]  Éva Tardos,et al.  Approximation algorithms for classification problems with pairwise relationships: metric labeling and Markov random fields , 2002, JACM.

[11]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[12]  Daniel Cremers,et al.  Binary Partitioning, Perceptual Grouping, and Restoration with Semidefinite Programming , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Gunnar Rätsch,et al.  Image reconstruction by linear programming , 2003, IEEE Transactions on Image Processing.

[14]  Patrick Pérez,et al.  Interactive Image Segmentation Using an Adaptive GMMRF Model , 2004, ECCV.

[15]  Christoph Schnörr,et al.  Hierarchical Image Segmentation Based on Semidefinite Programming , 2004, DAGM-Symposium.

[16]  Ilan Shimshoni,et al.  Mean shift based clustering in high dimensions: a texture classification example , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.