Subjectivity in Inductive Inference

This paper examines circumstances under which subjectivity enhances the effectiveness of inductive reasoning. We consider a game in which Fate chooses a data generating process and agents are characterized by inference rules that may be purely objective (or data-based) or may incorporate subjective considerations. The basic intuition is that agents who invoke no subjective considerations are doomed to "overfit" the data and therefore engage in ineffective learning. The analysis places no computational or memory limitations on the agents -- the role for subjectivity emerges in the presence of unlimited reasoning powers.

[1]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[2]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[3]  Itzhak Gilboa,et al.  Simplicity and likelihood: An axiomatic approach , 2010, J. Econ. Theory.

[4]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[5]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[6]  L. Wittgenstein.  Tractatus Logico-Philosophicus , 2021, Nordic Wittgenstein Review.

[7]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[8]  B. Russell.  History of Western philosophy , 1949 .

[9]  Andrei N. Kolmogorov,et al.  On Tables of Random Numbers (Reprinted from "Sankhya: The Indian Journal of Statistics", Series A, Vol. 25 Part 4, 1963) , 1998, Theor. Comput. Sci..

[10]  T. Kuhn.  The Structure of Scientific Revolutions 2nd edition , 1970 .

[11]  Vladimir Vapnik,et al.  Chervonenkis: On the uniform convergence of relative frequencies of events to their probabilities , 1971 .

[12]  Peter Grünwald,et al.  Invited review of the book Statistical and Inductive Inference by Minimum Message Length , 2006 .

[13]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[14]  David L. Dowe,et al.  Minimum Message Length and Kolmogorov Complexity , 1999, Comput. J..

[15]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[16]  H. Akaike.  A new look at the statistical model identification , 1974 .

[17]  T. Kuhn.  The structure of scientific revolutions, 3rd ed. , 1996 .

[18]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[19]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[20]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[21]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[22]  Nabil I. Al-Najjar.  Decision Makers as Statisticians: Diversity, Ambiguity, and Learning , 2009 .

[23]  N. Goodman.  Fact, Fiction, and Forecast , 1955 .

[24]  Gabrielle Gayer,et al.  Perception of probabilities in situations of risk: A case based approach , 2010, Games Econ. Behav..