Absolute Versus Probabilistic Classification in a Logical Setting

Given a set $\mathcal{W}$of logical structures, or possible worlds, a set $\mathcal{D}$of logical formulas, or possible data, and a logical formula ϕ, we consider the classification problem of determining in the limit and almost always correctly whether a possible world $\mathcal{M}$satisfies ϕ, from a complete enumeration of the possible data that are true in $\mathcal{M}$. One interpretation of almost always correctly is that the classification might be wrong on a set of possible worlds of measure 0, w.r.t. some natural probability distribution over the set of possible worlds. Another interpretation is that the classifier is only required to classify a set $\mathcal{W}'$of possible worlds of measure 1, without having to produce any claim in the limit on the truth of ϕ in the members of the complement of $\mathcal{W}'$in $\mathcal{W}$. We compare these notions with absolute classification of $\mathcal{W}$w.r.t. a formula that is almost always equivalent to ϕ in $\mathcal{W}$, hence investigate whether the set of possible worlds on which the classification is correct is definable. Finally, in the spirit of the kind of computations considered in Logic programming, we address the issue of computing almost correctly in the limit witnesses to leading existentially quantified variables in existential formulas.

[1]  Carl H. Smith,et al.  The Power of Pluralism for Automatic Program Synthesis , 1982, JACM.

[2]  J. R. Büchi On a Decision Method in Restricted Second Order Arithmetic , 1990 .

[3]  Shai Ben-David,et al.  Can Finite Samples Detect Singularities of Real-Valued Functions? , 1992, STOC '92.

[4]  Arun Sharma,et al.  Learning, Logic, and Topology in a Common Framework , 2002, ALT.

[5]  Izumi Takeuti The measure of an omega regular language is rational (Algebraic Semigroups, Formal Languages and Computation) , 2001 .

[6]  Frank Stephan,et al.  Urban Classification Using Full Spectral Information of Landsat ETM Imagery in Marion County , Indiana , 2005 .

[7]  Léa Meyer,et al.  Probabilistic Language Learning Under Monotonicity Constraints , 1995, Theor. Comput. Sci..

[8]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[9]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[10]  Carl H. Smith,et al.  Probability and Plurality for Aggregations of Learning Machines , 1988, Inf. Comput..

[11]  Carl H. Smith,et al.  Learning Formulae from Elementary Facts , 1997, EuroCOLT.

[12]  Andris Ambainis,et al.  Probabilistic inductive inference: a survey , 1999, Theor. Comput. Sci..

[13]  Leonard Pitt,et al.  Probabilistic inductive inference , 1989, JACM.

[14]  Patrick Caldon,et al.  Limiting Resolution: From Foundations to Implementation , 2004, ICLP.

[15]  Robert P. Daley Inductive inference hierarchies: probabilistic vs pluralistic strategies , 1985, Mathematical Methods of Specification and Synthesis of Software Systems.

[16]  Andrei Voronkov,et al.  Logic Programming with Bounded Quantifiers , 1990, RCLP.