The Search for Simplicity: A Fundamental Cognitive Principle?

It is proposed that the cognitive system imposes patterns on the world according to a simplicity principle: Choose the pattern that provides the briefest representation of the available information. The simplicity principle is normatively justified—patterns that support simple representations provide good explanations and predictions on the basis of which the agent can make decisions and actions. Moreover, the simplicity principle appears to be consistent with empirical data from many psychological domains, including perception, similarity, learning, memory, and reasoning. Thus, the simplicity principle promises to serve as the starting point for the rational analysis of a wide range of cognitive processes, in Anderson's (1990, 1991a) sense. The simplicity principle also provides a framework for integrating a wide range of existing psychological proposals.

[1]  Ernst Mach,et al.  The Science of Mechanics , 1961, The Mathematical Gazette.

[2]  Ernst Mach,et al.  The analysis of sensations and the relation of the physical to the psychical , 1914, The Mathematical Gazette.

[3]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[4]  J. Hochberg,et al.  A quantitative approach to figural "goodness". , 1953, Journal of experimental psychology.

[5]  John G. Kemeny,et al.  The Use of Simplicity in Induction , 1953 .

[6]  M. Wertheimer,et al.  Some determinants of phenomenal overlapping. , 1957, The American journal of psychology.

[7]  W. R. Garner Applications of Information Theory to Psychology , 1959 .

[8]  F. Alberoni,et al.  Contribution to the study of subjective probability. I. , 1962, The Journal of general psychology.

[9]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[10]  H A SIMON,et al.  HUMAN ACQUISITION OF CONCEPTS FOR SEQUENTIAL PATTERNS. , 1963, Psychological review.

[11]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[12]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[13]  G. Harman The Inference to the Best Explanation , 1965 .

[14]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[15]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[16]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[17]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[18]  L. Glass Moiré Effect from Random Dots , 1969, Nature.

[19]  F. Attneave,et al.  The determination of perceived tridimensional orientation by minimum criteria , 1969 .

[20]  Paul C. Vitz,et al.  A coded element model of the perceptual processing of sequential stimuli. , 1969 .

[21]  E. Leeuwenberg Quantitative specification of information in sequential patterns. , 1969, Psychological review.

[22]  Frank Restle,et al.  Theory of Serial Pattern Learning: Structural Trees. , 1970 .

[23]  E. Leeuwenberg A perceptual coding language for visual and auditory patterns. , 1971, The American journal of psychology.

[24]  Herbert A. Simon,et al.  Complexity and the representation of patterned sequences of symbols. , 1972 .

[25]  R. Pérez,et al.  Perception of Random Dot Interference Patterns , 1973, Nature.

[26]  WILLIAM MARSLEN-WILSON,et al.  Linguistic Structure and Speech Shadowing at Very Short Latencies , 1973, Nature.

[27]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[28]  W. R. Garner The Processing of Information and Structure , 1974 .

[29]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[30]  W. R. Garner Uncertainty and structure as psychological concepts , 1975 .

[31]  I. Rock,et al.  An introduction to perception , 1975 .

[32]  J. Fodor,et al.  The Language of Thought , 1980 .

[33]  J. G. Wolff FREQUENCY, CONCEPTUAL STRUCTURE AND PATTERN RECOGNITION , 1976 .

[34]  A. Tversky Features of Similarity , 1977 .

[35]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[36]  Lyn Frazier,et al.  ON COMPREHENDING SENTENCES: SYNTACTIC PARSING STRATEGIES. , 1979 .

[37]  F. Restle Coding theory of the perception of motion configurations. , 1979, Psychological review.

[38]  E. Leeuwenberg,et al.  Coding theory of visual pattern completion. , 1981, Journal of experimental psychology. Human perception and performance.

[39]  Noam Chomsky,et al.  Rules and representations , 1980, Behavioral and Brain Sciences.

[40]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[41]  Walter Gerbino,et al.  Amodal completion: Seeing or thinking? , 1982 .

[42]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[43]  S. Palmer The Psychology of Perceptual Organization: A Transformational Approach , 1983 .

[44]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[45]  N. Perrin,et al.  Varieties of perceptual independence. , 1986, Psychological review.

[46]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[47]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[48]  C. S. Wallace,et al.  Estimation and Inference by Compact Coding , 1987 .

[49]  G. Gigerenzer,et al.  Cognition as Intuitive Statistics , 1987 .

[50]  David V. Budescu,et al.  A Markov model for generation of random binary sequences. , 1987 .

[51]  Lola L. Lopes,et al.  Distinguishing between random and nonrandom events. , 1987 .

[52]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[53]  F Boselie,et al.  Against the likelihood principle in visual form perception. , 1988, Psychological review.

[54]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[55]  Gerd Gigerenzer,et al.  Presentation and content: The use of base rates as a continuous variable. , 1988 .

[56]  H. B. Barlow,et al.  Finding Minimum Entropy Codes , 1989, Neural Computation.

[57]  Ronald L. Rivest,et al.  Inferring Decision Trees Using the Minimum Description Length Principle , 1989, Inf. Comput..

[58]  Mark T. Keane,et al.  Cognitive Psychology: A Student's Handbook , 1990 .

[59]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[60]  N. Chater,et al.  Autonomy, implementation and cognitive architecture: A reply to Fodor and Pylyshyn , 1990, Cognition.

[61]  John R. Anderson The Adaptive Character of Thought , 1990 .

[62]  N. Chater,et al.  Against Logicist Cognitive Science , 1991 .

[63]  John R. Anderson Is human cognition adaptive? , 1991, Behavioral and Brain Sciences.

[64]  Colin Blakemore,et al.  Vision: Coding and Efficiency , 1991 .

[65]  W. Wagenaar,et al.  The perception of randomness , 1991 .

[66]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[67]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[68]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[69]  N. Chater,et al.  Bounded Rationality in Taking Risks and Drawing Inferences , 1992 .

[70]  E. Leeuwenberg,et al.  Serial pattern complexity: irregularity and hierarchy , 1992, Perception.

[71]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[72]  M. Golubitsky,et al.  Fearful Symmetry: Is God a Geometer? , 1992 .

[73]  Radford M. Neal Bayesian Learning via Stochastic Dynamics , 1992, NIPS.

[74]  N. Chater,et al.  Logicism, Mental Models and Everyday Reasoning : Reply to Garnham , 1993 .

[75]  Keith Stenning,et al.  Reasoning theories and bounded rationality , 1993 .

[76]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[77]  D. Gentner,et al.  Respects for similarity , 1993 .

[78]  A. Norman Redlich,et al.  Redundancy Reduction as a Strategy for Unsupervised Learning , 1993, Neural Computation.

[79]  R van Lier,et al.  Integrating Global and Local Aspects of Visual Occlusion , 1994, Perception.

[80]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[81]  Umesh V. Vazirani,et al.  An Introduction to Computational Learning Theory , 1994 .

[82]  Nick Chater,et al.  A rational analysis of the selection task as optimal data selection. , 1994 .

[83]  Nick Chater,et al.  Information gain explains relevance which explains the selection task , 1995, Cognition.

[84]  Peter Grünwald,et al.  A minimum description length approach to grammar inference , 1995, Learning for Natural Language Processing.

[85]  E. Leeuwenberg,et al.  Competing global and local completions in visual occlusion. , 1995 .

[86]  Nick Chater,et al.  Theories of reasoning and the computational explanation of everyday inference , 1995 .

[87]  Jonathan Evans,et al.  Rationality in the selection task: Epistemic utility versus uncertainty reduction. , 1996 .

[88]  T. A. Cartwright,et al.  Distributional regularity and phonotactic constraints are useful for segmentation , 1996, Cognition.

[89]  S. Sloman,et al.  Is Deontic Reasoning Special ? , 1996 .

[90]  N. Chater,et al.  RATIONAL EXPLANATION OF THE SELECTION TASK , 1996 .

[91]  Jonathan Evans,et al.  Rationality and reasoning , 1996 .

[92]  D. Mumford Pattern theory: a unifying perspective , 1996 .

[93]  Nick Chater,et al.  Reconciling simplicity and likelihood principles in perceptual organization. , 1996, Psychological review.

[94]  D. Laming On the analysis of irrational data selection: A critique of Oaksford and Chater (1994). , 1996 .

[95]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[96]  N. Chater,et al.  Concepts and Similarity , 1997 .

[97]  T. A. Cartwright,et al.  Syntactic categorization in early language acquisition: formalizing the role of distributional analysis , 1997, Cognition.

[98]  N. Chater,et al.  Optimal data selection in the reduced array selection task (RAST) , 1997 .

[99]  Nick Chater,et al.  Simplicity and the mind , 1997 .

[100]  Clifford Konold,et al.  Making Sense of Randomness " Implicit Encoding as a Basis for Judgment , 1997 .

[101]  Péter Gács,et al.  Information Distance , 1998, IEEE Trans. Inf. Theory.

[102]  N. Chater,et al.  Similarity and rules: distinct? exhaustive? empirically distinguishable? , 1998, Cognition.

[103]  Nick Chater,et al.  Connectionist and Statistical Approaches to Language Acquisition: A Distributional Perspective. , 1998 .

[104]  N. Chater,et al.  The Probability Heuristics Model of Syllogistic Reasoning , 1999, Cognitive Psychology.

[105]  N. Chater,et al.  Rational models of cognition , 1998 .