Smoothed Analysis of Local Search for the Maximum-Cut Problem

Even though local search heuristics are the method of choice in practice for many well-studied optimization problems, most of them behave poorly in the worst case. This is, in particular, the case for the Maximum-Cut Problem, for which local search can take an exponential number of steps to terminate and the problem of computing a local optimum is PLS-complete. To narrow the gap between theory and practice, we study local search for the Maximum-Cut Problem in the framework of smoothed analysis in which inputs are subject to a small amount of random noise. We show that the smoothed number of iterations is quasi-polynomial, that is, it is bounded from above by a polynomial in nlog n and φ, where n denotes the number of nodes and φ denotes the perturbation parameter. This shows that worst-case instances are fragile, and it is a first step in explaining why they are rarely observed in practice.

[1]  Shang-Hua Teng,et al.  Smoothed analysis: an attempt to explain the behavior of algorithms in practice , 2009, CACM.

[2]  Sanjeev Khanna,et al.  Approximating pure nash equilibrium in cut, party affiliation, and satisfiability games , 2010, EC '10.

[3]  Mihalis Yannakakis,et al.  Simple Local Search Problems That are Hard to Solve , 1991, SIAM J. Comput..

[4]  Robert Elsässer,et al.  Settling the Complexity of Local Max-Cut (Almost) Completely , 2010, ICALP.

[5]  Christos H. Papadimitriou,et al.  The complexity of pure Nash equilibria , 2004, STOC '04.

[6]  Shang-Hua Teng,et al.  Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time , 2001, STOC '01.

[7]  Berthold Vöcking,et al.  Worst Case and Probabilistic Analysis of the 2-Opt Algorithm for the TSP , 2007, SODA '07.

[8]  Bodo Manthey,et al.  Smoothed Analysis: Analysis of Algorithms Beyond Worst Case , 2011, it Inf. Technol..

[9]  Berthold Vöcking,et al.  The complexity of Nash Equilibria, Local Optima, and Pareto-Optimal solutions , 2008 .

[10]  Vahab S. Mirrokni,et al.  Convergence and approximation in potential games , 2006, Theor. Comput. Sci..

[11]  Berthold Vöcking,et al.  On the Impact of Combinatorial Structure on Congestion Games , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[12]  Sergei Vassilvitskii,et al.  Worst-case and Smoothed Analysis of the ICP Algorithm, with an Application to the k-means Method , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[13]  Christos H. Papadimitriou,et al.  On the Complexity of the Parity Argument and Other Inefficient Proofs of Existence , 1994, J. Comput. Syst. Sci..

[14]  Pavel Berkhin,et al.  A Survey of Clustering Data Mining Techniques , 2006, Grouping Multidimensional Data.

[15]  Heiko Röglin,et al.  Smoothed Analysis of the Squared Euclidean Maximum-Cut Problem , 2015, ESA.

[16]  Éva Tardos,et al.  Algorithm design , 2005 .

[17]  David S. Johnson,et al.  The Traveling Salesman Problem: A Case Study in Local Optimization , 2008 .

[18]  Yossi Azar,et al.  Fast convergence to nearly optimal solutions in potential games , 2008, EC '08.

[19]  Andrea Vattani,et al.  k-means Requires Exponentially Many Iterations Even in the Plane , 2008, SCG '09.

[20]  Bodo Manthey,et al.  Worst-Case and Smoothed Analysis of k-Means Clustering with Bregman Divergences , 2013, J. Comput. Geom..

[21]  Bodo Manthey,et al.  Smoothed Analysis of the k-Means Method , 2011, JACM.