Probabilistic reasoning in a classical logic

We offer a view on how probability is related to logic. Specifically, we argue against the widely held belief that standard classical logics have no direct way of modelling the certainty of assumptions in theories and no direct way of stating the certainty of theorems proved from these (uncertain) assumptions. The argument rests on the observation that probability densities, being functions, can be represented and reasoned with naturally and directly in (classical) higher-order logic.

[1]  Peter B. Andrews.  An introduction to mathematical logic and type theory - to truth through proof , 1986, Computer science and applied mathematics.

[2]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[3]  Nils J. Nilsson,et al.  Probabilistic Logic * , 2022 .

[4]  David Poole,et al.  Logic, Knowledge Representation, and Bayesian Decision Theory , 2000, Computational Logic.

[5]  Luc De Raedt,et al.  Probabilistic logic learning , 2003, SKDD.

[6]  Keith L. Clark,et al.  Negation as Failure , 1987, Logic and Data Bases.

[7]  John W. Lloyd,et al.  Probabilistic and Logical Beliefs , 2008, LADS.

[8]  Alonzo Church,et al.  A formulation of the simple theory of types , 1940, Journal of Symbolic Logic.

[9]  Dov M. Gabbay,et al.  Handbook of logic in artificial intelligence and logic programming (vol. 1) , 1993 .

[10]  J. W. Lloyd,et al.  Logic for Learning , 2003, Cognitive Technologies.

[11]  John F. Sowa,et al.  Knowledge Representation and Reasoning , 2000 .

[12]  Michael Gelfond,et al.  Classical negation in logic programs and disjunctive databases , 1991, New Generation Computing.

[13]  John W. Lloyd,et al.  Personalisation for user agents , 2005, AAMAS '05.

[14]  Wray L. Buntine,et al.  A theory of learning classification rules , 1990 .

[15]  V. S. Subrahmanian,et al.  Hybrid Probabilistic Programs , 2000, J. Log. Program..

[16]  Patrick Billingsley,et al.  Probability and Measure. , 1986 .

[17]  Daniel Leivant,et al.  Higher order logic , 1994, Handbook of Logic in Artificial Intelligence and Logic Programming.

[18]  De Raedt,et al.  Advances in Inductive Logic Programming , 1996 .

[19]  Peter A. Flach,et al.  Combining Bayesian Networks with Higher-Order Data Representations , 2005, Probabilistic, Logical and Relational Learning.

[20]  S. Muggleton.  Stochastic Logic Programs , 1996 .

[21]  J. Nelson Rushton,et al.  Probabilistic reasoning with answer sets , 2004, Theory and Practice of Logic Programming.

[22]  Ronald Fagin,et al.  Reasoning about knowledge and probability , 1988, JACM.

[23]  John W. Lloyd,et al.  Programming in an Integrated Functional and Logic Language , 1999, J. Funct. Log. Program..

[24]  Joseph Y. Halpern.  Reasoning about uncertainty , 2003 .

[25]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[26]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[27]  V. S. Subrahmanian,et al.  Probabilistic Logic Programming , 1992, Inf. Comput..

[28]  Luc De Raedt,et al.  Bayesian Logic Programming: Theory and Tool , 2007 .

[29]  Joseph Y. Halpern.  An Analysis of First-Order Logics of Probability , 1989, IJCAI.

[30]  Stuart J. Russell,et al.  First-Order Probabilistic Languages: Into the Unknown , 2007, ILP.

[31]  Alex M. Andrew,et al.  Logic for Learning: Learning Comprehensible Theories from Structured Data , 2004 .

[32]  Ben Taskar,et al.  Introduction to statistical relational learning , 2007 .

[33]  L. Goble.  The Blackwell guide to philosophical logic , 2001 .

[34]  K. Tanaka.  The Blackwell Guide to Philosophical Logic , 2002 .

[35]  Theodore Hailperin,et al.  Probability logic , 1984, Notre Dame J. Formal Log..

[36]  John W. Lloyd,et al.  Knowledge Representation, Computation, and Learning in Higher-order Logic , 2002 .

[37]  Stuart J. Russell,et al.  BLOG: Probabilistic Models with Unknown Objects , 2005, IJCAI.

[38]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[39]  Laks V. S. Lakshmanan,et al.  Modeling Uncertainty in Deductive Databases , 1994, DEXA.

[40]  Simon Thompson,et al.  Type theory and functional programming , 1991, International computer science series.

[41]  Stuart J. Russell,et al.  Probabilistic models with unknown objects , 2006 .

[42]  Lloyd Allison,et al.  Models for machine learning and data mining in functional programming , 2004, Journal of Functional Programming.

[43]  P. Billingsley,et al.  Probability and Measure , 1980 .

[44]  Robert J. McEliece,et al.  The generalized distributive law , 2000, IEEE Trans. Inf. Theory.

[45]  Kee Siong Ng,et al.  Learning Comprehensible Theories from Structured Data , 2005 .

[46]  John W. Lloyd,et al.  Learning Modal Theories , 2007, ILP.

[47]  Dov M. Gabbay,et al.  Handbook of Philosophical Logic Vol. 10 , 2001 .

[48]  Dudley,et al.  Real Analysis and Probability: Measurability: Borel Isomorphism and Analytic Sets , 2002 .

[49]  Johann Eder,et al.  Logic and Databases , 1992, Advanced Topics in Artificial Intelligence.

[50]  Eyal Amir,et al.  Probabilistic Modal Logic , 2007, AAAI.

[51]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[52]  Norman Ramsey,et al.  Stochastic lambda calculus and monads of probability distributions , 2002, POPL '02.

[53]  J. Benthem,et al.  Higher-Order Logic , 2001 .

[54]  Sebastian Thrun,et al.  A probabilistic language based upon sampling functions , 2005, POPL '05.

[55]  X. Jin.  Factor graphs and the Sum-Product Algorithm , 2002 .