A Structured View on Weighted Counting with Relations to Counting, Quantum Computation and Applications

Weighted counting problems are a natural generalization of counting problems where a weight is associated with every computational path of polynomial-time non-deterministic Turing machines and the goal is to compute the sum of the weights of all paths (instead of just computing the number of accepting paths). Useful closure properties and plenty of applications make weighted counting problems interesting. The general definition of these problems captures even undecidable problems, but it turns out that obtaining an exponentially small additive approximation is just as hard as solving conventional counting problems. In many cases such an approximation is sufficient and working with weighted counting problems tends to be very convenient. We present a structured view on weighted counting by defining classes that depend on the range of the function that assigns weights to paths and by showing the relationships between these different classes. These classes constitute generalizations of the usual counting problems. Weighted counting allows us to easily cast a number of famous results of computational complexity in its terms, especially regarding counting and quantum computation. Moreover, these classes are flexible enough and capture the complexity of various problems in fields such as probabilistic graphical models and stochastic combinatorial optimization. Using the weighted counting terminology and our results, we are able to simplify and answer some open questions in those fields.

[1]  Lance Fortnow,et al.  PP is Closed Under Truth-Table Reductions , 1996, Inf. Comput..

[2]  Phokion G. Kolaitis,et al.  Subtractive Reductions and Complete Problems for Counting Complexity Classes , 2000, MFCS.

[3]  Lane A. Hemaspaandra,et al.  The Complexity of Computing the Size of an Interval , 2007, SIAM J. Comput..

[4]  Tomás Feder,et al.  The Computational Structure of Monotone Monadic SNP and Constraint Satisfaction: A Study through Datalog and Group Theory , 1999, SIAM J. Comput..

[5]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[6]  J. Rosser,et al.  Approximate formulas for some functions of prime numbers , 1962 .

[7]  Dieter van Melkebeek,et al.  Time-Space Efficient Simulations of Quantum Computations , 2012, Theory Comput..

[8]  Aris Pagourtzis,et al.  The Complexity of Counting Functions with Easy Decision Version , 2006, MFCS.

[9]  Piotr Faliszewski,et al.  The complexity of power-index comparison , 2009, Theor. Comput. Sci..

[10]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[11]  Roberto Montemanni,et al.  Hardness Results for the Probabilistic Traveling Salesman Problem with Deadlines , 2012, ISCO.

[12]  Todd A. Brun,et al.  Quantum Computing , 2011, Computer Science, The Hardware, Software and Heart of It.

[13]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[14]  Richard Beigel Closure properties of GapP and #P , 1997, Proceedings of the Fifth Israeli Symposium on Theory of Computing and Systems.

[15]  Martin E. Dyer,et al.  The complexity of weighted and unweighted #CSP , 2010, J. Comput. Syst. Sci..

[16]  Adnan Darwiche,et al.  Modeling and Reasoning with Bayesian Networks , 2009 .

[17]  Denis Deratani Mauá,et al.  Probabilistic Graphical Models Specified by Probabilistic Logic Programs: Semantics and Complexity , 2016, Probabilistic Graphical Models.

[18]  Seinosuke Toda,et al.  PP is as Hard as the Polynomial-Time Hierarchy , 1991, SIAM J. Comput..

[19]  Thomas Schwentick,et al.  On the Power of One Bit of a P Function , 1992 .

[20]  John E. Hershey,et al.  Computation , 1991, Digit. Signal Process..

[21]  Osamu Watanabe,et al.  Polynomial Time 1-Turing Reductions from #PH to #P , 1992, Theor. Comput. Sci..

[22]  Martin E. Dyer,et al.  The Complexity of Weighted Boolean #CSP , 2009, SIAM J. Comput..

[23]  Denis Deratani Mauá,et al.  The Structure and Complexity of Credal Semantics , 2016, PLP@ILP.

[24]  Jin-Yi Cai,et al.  The complexity of complex weighted Boolean #CSP , 2014, J. Comput. Syst. Sci..

[25]  Leslie G. Valiant,et al.  The Complexity of Computing the Permanent , 1979, Theor. Comput. Sci..

[26]  Andrei A. Bulatov,et al.  Towards a dichotomy theorem for the counting constraint satisfaction problem , 2007, Inf. Comput..

[27]  Thomas Schwentick,et al.  The Power of the Middle Bit of a #P Function , 1995, J. Comput. Syst. Sci..

[28]  Jin-Yi Cai,et al.  Computational Complexity of Holant Problems , 2011, SIAM J. Comput..

[29]  Jin-Yi Cai,et al.  Non-negatively Weighted #CSP: An Effective Complexity Dichotomy , 2010, 2011 IEEE 26th Annual Conference on Computational Complexity.

[30]  Isaac L. Chuang,et al.  Quantum Computation and Quantum Information (10th Anniversary edition) , 2011 .

[31]  Scott Aaronson,et al.  Quantum Computing since Democritus , 2013 .

[32]  Tomoyuki Yamakami,et al.  Analysis Of Quantum Functions , 1999, Int. J. Found. Comput. Sci..

[33]  Martin E. Dyer,et al.  Computational complexity of stochastic programming problems , 2006, Math. Program..

[34]  Toniann Pitassi,et al.  Stochastic Boolean Satisfiability , 2001, Journal of Automated Reasoning.

[35]  Stuart A. Kurtz,et al.  Gap-Definable Counting Classes , 1994, J. Comput. Syst. Sci..

[36]  E. T. An Introduction to the Theory of Numbers , 1946, Nature.

[37]  Sanjeev Arora,et al.  Computational Complexity: A Modern Approach , 2009 .

[38]  Andrew Chi-Chih Yao,et al.  NQPC = co-C=P , 1999, Inf. Process. Lett..

[39]  Scott Aaronson,et al.  Quantum computing, postselection, and probabilistic polynomial-time , 2004, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[40]  Andrei A. Bulatov,et al.  A Dichotomy Theorem for Nonuniform CSPs , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[41]  Leslie Ann Goldberg,et al.  Inapproximability of the Tutte polynomial , 2006, STOC '07.

[42]  Xi Chen,et al.  Complexity of Counting CSP with Complex Weights , 2011, J. ACM.

[43]  Daniel A. Spielman,et al.  PP is closed under intersection , 1991, STOC '91.

[44]  D. Welsh,et al.  On the computational complexity of the Jones and Tutte polynomials , 1990, Mathematical Proceedings of the Cambridge Philosophical Society.

[45]  Tomoyuki Yamakami A dichotomy theorem for the approximate counting of complex-weighted bounded-degree Boolean CSPs , 2012, Theor. Comput. Sci..

[46]  Tomás Feder,et al.  Dichotomy for Digraph Homomorphism Problems , 2017, ArXiv.

[47]  Markus Bläser,et al.  Weighted Counting of k-Matchings Is #W[1]-Hard , 2012, IPEC.

[48]  Leonard M. Adleman,et al.  Quantum Computability , 1997, SIAM J. Comput..

[49]  Linda C. van der Gaag,et al.  Probabilistic Graphical Models , 2014, Lecture Notes in Computer Science.

[50]  D. Newman Rational approximation to | x , 1964 .

[51]  Lance Fortnow,et al.  Complexity limitations on quantum computation , 1999, J. Comput. Syst. Sci..

[52]  Lance Fortnow,et al.  Gap-Definability as a Closure Property , 1993, STACS.

[53]  Michael L. Littman,et al.  The Computational Complexity of Probabilistic Planning , 1998, J. Artif. Intell. Res..

[54]  K. V. Subrahmanyam,et al.  Descriptive Complexity of #P Functions , 1995, J. Comput. Syst. Sci..

[55]  Martin E. Dyer,et al.  On the relative complexity of approximate counting problems , 2000, APPROX.

[56]  Lance Fortnow,et al.  Arithmetization: A new method in structural complexity theory , 2005, computational complexity.

[57]  Leen Stougie,et al.  Approximation in Stochastic integer programming , 2003 .

[58]  Jin-Yi Cai,et al.  Nonnegative Weighted #CSP: An Effective Complexity Dichotomy , 2016, SIAM J. Comput..

[59]  Martin E. Dyer,et al.  The Relative Complexity of Approximate Counting Problems , 2000, Algorithmica.

[60]  Cassio Polpo de Campos,et al.  The Computational Complexity of Stochastic Optimization , 2014, ISCO.

[61]  Stephen A. Fenner PP-Lowness and a Simple Definition of AWPP , 2002, Theory of Computing Systems.

[62]  Denis Deratani Mauá,et al.  The Complexity of Bayesian Networks Specified by Propositional and Relational Languages , 2016, Artif. Intell..

[63]  John T. Gill,et al.  Computational complexity of probabilistic Turing machines , 1974, STOC '74.

[64]  Dan Roth,et al.  On the Hardness of Approximate Reasoning , 1993, IJCAI.

[65]  Dmitriy Zhuk,et al.  A Proof of CSP Dichotomy Conjecture , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[66]  Dennis Weyland On the computational complexity of the Probabilistic Traveling Salesman Problem with Deadlines , 2014, Theor. Comput. Sci..

[67]  Tomoyuki Yamakami Approximate Counting for Complex-Weighted Boolean Constraint Satisfaction Problems , 2010, WAOA.

[68]  Mitsunori Ogihara,et al.  Counting Classes are at Least as Hard as the Polynomial-Time Hierarchy , 1992, SIAM J. Comput..

[69]  Piotr Faliszewski,et al.  The complexity of power-index comparison , 2008, Theor. Comput. Sci..

[70]  Leslie G. Valiant,et al.  The Complexity of Enumeration and Reliability Problems , 1979, SIAM J. Comput..

[71]  Umesh V. Vazirani,et al.  Quantum complexity theory , 1993, STOC.

[72]  Shai Halevi,et al.  Zero-one permanent is not=P-complete, a simpler proof , 1993, [1993] The 2nd Israel Symposium on Theory and Computing Systems.