Toward Question-Asking Machines: The Logic of Questions and the Inquiry Calculus

For over a century, the study of logic has focused on the algebra of logical statements. This work, first performed by George Boole, has led to the development of modern computers, and was shown by Richard T. Cox to be the foundation of Bayesian inference. Meanwhile the logic of questions has been much neglected. For our computing machines to be truly intelligent, they need to be able to ask relevant questions. In this paper I will show how the Boolean lattice of logical statements gives rise to the free distributive lattice of questions thus defining their algebra. Furthermore, there exists a quantity analogous to probability, called relevance ,w hich quantifies the degree to which one question answers another. I will show that relevance is not only a natural generalization of information theory, but also forms its foundation.

[1]  R. T. Cox,et al.  The Algebra of Probable Inference , 1962 .

[2]  J. Pierce,et al.  A New Look at the Relation between Information Theory and Search Theory , 1978 .

[3]  P. McMullen INTRODUCTION TO GEOMETRIC PROBABILITY , 1999 .

[4]  Kevin H. Knuth,et al.  Lattice duality: The origin of probability and entropy , 2013, Neurocomputing.

[5]  A. J. Bell THE CO-INFORMATION LATTICE , 2003 .

[6]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[7]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[8]  Robert L. Fry The engineering of cybernetic systems , 2002 .

[9]  K. Knuth Measuring Questions: Relevance and its Relation to Entropy , 2004, physics/0409084.

[10]  George Boole,et al.  An Investigation of the Laws of Thought: Frontmatter , 2009 .

[11]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[12]  Kevin H. Knuth,et al.  Intelligent machines in the 21 st century : foundations of inference and inquiry , 2003 .

[13]  William J. McGill Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[14]  R. T. Cox The Algebra of Probable Inference , 1962 .

[15]  Peter Sollich,et al.  AIP CONF PROC , 2001 .

[16]  Ariel Caticha Questions, relevance and relative entropy , 2004 .

[17]  Brian A. Davey,et al.  An Introduction to Lattices and Order , 1989 .

[18]  J. Aczel,et al.  WHY THE SHANNON AND HARTLEY ENTROPIES ARE 'NATURAL' , 1974 .

[19]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[20]  R. T. Cox Probability, frequency and reasonable expectation , 1990 .

[21]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[22]  Robert L. Fry,et al.  Observer-participant models of neural processing , 1995, IEEE Trans. Neural Networks.

[23]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[24]  K. Knuth Intelligent machines in the twenty-first century: foundations of inference and inquiry , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[25]  T. Loredo Bayesian Adaptive Exploration , 2004, astro-ph/0409386.

[26]  Yoel Tikochinsky Consistency, amplitudes and probabilities in quantum theory , 2000 .