Improved Optimization Based on Graph Cuts for Discrete Energy Minimization

Discrete energy optimization is a NP hard problem. Recent years, the graph cuts based algorithms especially the a-expansion and αβ-swap, become more and more popular. Both the a-expansion and αβ-swap have been widely used in many applications, and they perform extremely well for the Potts energies. However, since all pixels only have a choice of two labels in one move, both the expansion and swap algorithm get approximate solution by a series of iterations and they do not perform well for more general energies, such as the truncated convex energies [1]. In this paper, we analyze the problems of both the expansion and swap algorithms. The expansion algorithm usually encourages more pixels to get the label fα, since all pixels are only allowed to change their current labels to fα. In contrast, the swap move sometimes cannot swap the labels of pixels reasonably. Based on the analysis, we propose the Interleaved Expansion-Swap Algorithm (IESA) by combining the expansion and swap moves effectively. To prove the effectiveness of the algorithm, we test it on both image restoration and stereo correspondence. The experimental evaluations show that our algorithm gets better optimization compared with both α-expansion and αβ-swap.

[1]  Vladimir Kolmogorov,et al.  Optimizing Binary MRFs via Extended Roof Duality , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[3]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Olga Veksler Multi-label Moves for MRFs with Truncated Convex Priors , 2009, EMMCVPR.

[6]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[7]  Philip H. S. Torr,et al.  Improved Moves for Truncated Convex Models , 2008, J. Mach. Learn. Res..

[8]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[9]  Olga Veksler,et al.  Markov random fields with efficient approximations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Yuri Boykov,et al.  Globally optimal segmentation of multi-region objects , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Tieniu Tan,et al.  Deformable Object Matching via Deformation Decomposition Based 2D Label MRF , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Václav Hlavác,et al.  Efficient MRF Deformation Model for Non-Rigid Image Matching , 2007, CVPR.

[15]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Olga Veksler Graph Cut Based Optimization for MRFs with Truncated Convex Priors , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Vladimir Kolmogorov,et al.  Multi-camera Scene Reconstruction via Graph Cuts , 2002, ECCV.

[18]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[19]  Sebastian Nowozin,et al.  A Comparative Study of Modern Inference Techniques for Discrete Energy Minimization Problems , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Pierre Hansen,et al.  Roof duality, complementation and persistency in quadratic 0–1 optimization , 1984, Math. Program..

[21]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..