LT^2C^2: A language of thought with Turing-computable Kolmogorov complexity

In this paper, we present a theoretical effort to connect the theory of program size to psychology by implementing a concrete language of thought with Turing-computable Kolmogorov complexity (LT^2C^2) satisfying the following requirements: 1) to be simple enough so that the complexity of any given finite binary sequence can be computed, 2) to be based on tangible operations of human reasoning (printing, repeating,...), 3) to be sufficiently powerful to generate all possible sequences but not too powerful as to identify regularities which would be invisible to humans. We first formalize LT^2C^2, giving its syntax and semantics and defining an adequate notion of program size. Our setting leads to a Kolmogorov complexity function relative to LT^2C^2 which is computable in polynomial time, and it also induces a prediction algorithm in the spirit of Solomonoff's inductive inference theory. We then prove the efficacy of this language by investigating regularities in strings produced by participants attempting to generate random strings. Participants had a profound understanding of randomness and hence avoided typical misconceptions such as exaggerating the number of alternations. We reasoned that remaining regularities would express the algorithmic nature of human thoughts, revealed in the form of specific patterns. Kolmogorov complexity relative to LT^2C^2 passed three expected tests examined here: 1) human sequences were less complex than control PRNG sequences, 2) human sequences were not stationary, showing decreasing values of complexity resulting from fatigue, 3) each individual showed traces of algorithmic stability since fitting of partial sequences was more effective to predict subsequent sequences than average fits. This work extends on previous efforts to combine notions of Kolmogorov complexity theory and algorithmic information theory to psychology, by explicitly ...

[1]  Mariano Sigman,et al.  Parsing a Perceptual Decision into a Sequence of Moments of Thought , 2011, Front. Integr. Neurosci..

[2]  N. Chater The Search for Simplicity: A Fundamental Cognitive Principle? , 1999 .

[3]  D. Champernowne The Construction of Decimals Normal in the Scale of Ten , 1933 .

[4]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[5]  Mariano Sigman,et al.  Looking at Breakout: Urgency and predictability direct eye events , 2011, Vision Research.

[6]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[7]  J ChaitinGregory A Theory of Program Size Formally Identical to Information Theory , 1975 .

[8]  Willem A. Wagenaar,et al.  Chance and luck are not the same , 1988 .

[9]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences: statistical considerations , 1969, JACM.

[10]  Thomas Gilovich,et al.  The “Hot Hand”: Statistical Reality or Cognitive Illusion? , 1989 .

[11]  R. Weiss On Producing Random Responses , 1964 .

[12]  S. Carey The Origin of Concepts , 2000 .

[13]  Jacob Feldman,et al.  Minimization of Boolean complexity in human concept learning , 2000, Nature.

[14]  L. M. M.-T. Theory of Probability , 1929, Nature.

[15]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[16]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[17]  Joseph B. Kadane,et al.  It's Okay to Believe in the “Hot Hand” , 1989 .

[18]  Harold Pashler,et al.  Effects of practice on task architecture: Combined evidence from interference experiments and random-walk models of decision making , 2011, Cognition.

[19]  Mariano Sigman,et al.  From a single decision to a multi-step algorithm , 2012, Current Opinion in Neurobiology.

[20]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[21]  M. Sigman,et al.  The human Turing machine: a neural framework for mental programs , 2011, Trends in Cognitive Sciences.

[22]  G. Boole An Investigation of the Laws of Thought: On which are founded the mathematical theories of logic and probabilities , 2007 .

[23]  A D Baddeley,et al.  The Capacity for Generating Information by Randomization , 1966, The Quarterly journal of experimental psychology.

[24]  Gregory J. Chaitin,et al.  A recent technical report , 1974, SIGA.

[25]  Mariano Sigman,et al.  Global organization of the Wordnet lexicon , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Paul M. B. Vitányi,et al.  Clustering by compression , 2003, IEEE Transactions on Information Theory.

[27]  A. Rapoport,et al.  Generation of random series in two-person strictly competitive games , 1992 .

[28]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[29]  O. Kinouchi,et al.  Speech Graphs Provide a Quantitative Measure of Thought Disorder in Psychosis , 2012, PloS one.

[30]  Max L. Warshauer,et al.  Lecture Notes in Mathematics , 2001 .

[31]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[32]  G. S. Tune RESPONSE PREFERENCES: A REVIEW OF SOME RELEVANT LITERATURE. , 1964, Psychological bulletin.

[33]  Willem A. Wagenaar,et al.  Randomness and randomizers: Maybe the problem is not so big , 1991 .

[34]  Pieter R. Roelfsema,et al.  The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain , 2010, PLoS Comput. Biol..

[35]  Mariano Sigman,et al.  Scale-Invariant Transition Probabilities in Free Word Association Trajectories , 2009, Front. Integr. Neurosci..

[36]  Mariano Sigman,et al.  Frontiers in Computational Neuroscience Computational Neuroscience Neurophysiological Bases of Exponential Sensory Decay and Top-down Memory Retrieval: a Model , 2022 .

[37]  F. Bartlett Fatigue Following Highly Skilled Work , 1941, Nature.

[38]  J. Tenenbaum,et al.  Probability, algorithmic complexity, and subjective randomness , 2003 .

[39]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[40]  Clifford Konold,et al.  Making Sense of Randomness " Implicit Encoding as a Basis for Judgment , 1997 .

[41]  A. T. Welford,et al.  Symposium on fatigue and Symposium on human factors in equipment design , 1977 .

[42]  M. Kac,et al.  WHAT IS RANDOM , 1983 .

[43]  L. Levin,et al.  THE COMPLEXITY OF FINITE OBJECTS AND THE DEVELOPMENT OF THE CONCEPTS OF INFORMATION AND RANDOMNESS BY MEANS OF THE THEORY OF ALGORITHMS , 1970 .

[44]  C. Schnorr Zufälligkeit und Wahrscheinlichkeit , 1971 .

[45]  Mariano Sigman,et al.  A small world of weak ties provides optimal global integration of self-similar modules in functional brain networks , 2011, Proceedings of the National Academy of Sciences.

[46]  Claus-Peter Schnorr,et al.  A unified approach to the definition of random sequences , 1971, Mathematical systems theory.

[47]  Mariano Sigman,et al.  The Conundrum of Functional Brain Networks: Small-World Efficiency or Fractal Modularity , 2012, Front. Physio..

[48]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[49]  W. Wagenaar,et al.  The perception of randomness , 1991 .

[50]  Ariel Zylberberg,et al.  The construction of confidence in a perceptual decision , 2012, Front. Integr. Neurosci..

[51]  A. Rapoport,et al.  Subjective randomization in one-and two-person games , 1994 .

[52]  D E Broadbent,et al.  Is a fatigue test now possible? , 1979, Ergonomics.