A message-passing algorithm with damping

We propose a modified belief propagation algorithm, with over-relaxed dynamics. Such an algorithm turns out to be generally more stable and faster than ordinary belief propagation. We characterize the performance of the algorithm, employed as a tool for combinatorial optimization, on the random satisfiability problem. Moreover, we trace a connection with a recently proposed double-loop algorithm for minimizing Bethe and Kikuchi free energies.

[1]  H. Bethe.  Statistical Theory of Superlattices , 1935 .

[2]  R. Kikuchi.  A Theory of Cooperative Phenomena , 1951 .

[3]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[4]  S. Edwards,et al.  Theory of spin glasses , 1975 .

[5]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[6]  Guozhong An.  A note on the cluster variation method , 1988 .

[7]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[8]  S Kirkpatrick,et al.  Critical Behavior in the Satisfiability of Random Boolean Expressions , 1994, Science.

[9]  T. Morita.  Formal Structure of the Cluster Variation Method , 1994 .

[10]  Monasson,et al.  Entropy of the K-satisfiability problem. , 1996, Physical review letters.

[11]  Padhraic Smyth,et al.  Belief networks, hidden Markov models, and Markov random fields: A unifying view , 1997, Pattern Recognit. Lett..

[12]  Alan L. Yuille,et al.  CCCP Algorithms to Minimize the Bethe and Kikuchi Free Energies: Convergent Alternatives to Belief Propagation , 2002, Neural Computation.

[13]  M. Mézard,et al.  Random K-satisfiability problem: from an analytic solution to an efficient algorithm. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  M. Mézard,et al.  Analytic and Algorithmic Solution of Random Satisfiability Problems , 2002, Science.

[15]  M. Pretti,et al.  Stable propagation algorithm for the minimization of the Bethe free energy , 2003 .

[16]  Riccardo Zecchina,et al.  Minimizing energy below the glass thresholds. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.