The Simplicity Principle in Human Concept Learning

How do we learn concepts and categories from examples? Part of the answer might be that we induce the simplest category consistent with a given set of example objects. This seemingly obvious idea, akin to simplicity principles in many fields, plays surprisingly little role in contemporary theories of concept learning, which are mostly based on the storage of exemplars, and avoid summarization or overt abstraction of any kind. This article reviews some evidence that complexity minimization does indeed play a central role in human concept learning. The chief finding is that subjects' ability to learn concepts depends heavily on the concepts' intrinsic complexity; more complex concepts are more difficult to learn. This pervasive effect suggests, contrary to exemplar theories, that concept learning critically involves the extraction of a simplified or abstracted generalization from examples.

[1]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[2]  U. Neisser,et al.  Hierarchies in concept attainment. , 1962, Journal of experimental psychology.

[3]  L. E. Bourne Knowing and Using Concepts. , 1970 .

[4]  R. Blacher,et al.  The language of the heart. , 1976, JAMA.

[5]  Ryszard S. Michalski,et al.  Constraints and Preferences in Inductive Learning: An Experimental Study of Human and Machine Performance , 1987, Cogn. Sci..

[6]  R. Nosofsky Exemplar-Based Accounts of Relations Between Classification, Recognition, and Typicality , 1988 .

[7]  Victor Pambuccian,et al.  Simplicity , 1988, Notre Dame J. Formal Log..

[8]  J. Siegel,et al.  Stressful life events and use of physician services among the elderly: the moderating role of pet ownership. , 1990, Journal of personality and social psychology.

[9]  J. Tomaka,et al.  Presence of human friends and pet dogs as moderators of autonomic responses to stress in women. , 1991, Journal of personality and social psychology.

[10]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[11]  C. Reid,et al.  Pet ownership and risk factors for cardiovascular disease. , 1992, The Medical journal of Australia.

[12]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[13]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[14]  W. Jänig Hyperalgesia and Allodynia , 1993 .

[15]  S. Murphy,et al.  The possible role of glia in nociceptive processing and hyperalgesia in the spinal cord of the rat , 1994, Neuropharmacology.

[16]  J. Stamford Descending control of pain. , 1995, British journal of anaesthesia.

[17]  E. Friedmann,et al.  Pet ownership, social support, and one-year survival after acute myocardial infarction in the Cardiac Arrhythmia Suppression Trial (CAST). , 1995, The American journal of cardiology.

[18]  J. Cacioppo,et al.  The relationship between social support and physiological processes: a review with emphasis on underlying mechanisms and implications for health. , 1996, Psychological bulletin.

[19]  D. Turner,et al.  Companion Animals in Human Health , 1997 .

[20]  R A Waugh,et al.  Effects of mental stress on myocardial ischemia during daily life. , 1997, JAMA.

[21]  Feldman,et al.  The Structure of Perceptual Categories , 1997, Journal of mathematical psychology.

[22]  S. Lepore Problems and prospects for the social support-reactivity hypothesis , 1998, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[23]  N. Chater,et al.  Similarity and rules: distinct? exhaustive? empirically distinguishable? , 1998, Cognition.

[24]  R. Detels,et al.  AIDS diagnosis and depression in the Multicenter AIDS Cohort Study: the ameliorating impact of pet ownership. , 1999, AIDS care.

[25]  A. Araque,et al.  Tripartite synapses: glia, the unacknowledged partner , 1999, Trends in Neurosciences.

[26]  S. Maier,et al.  Thermal hyperalgesia and mechanical allodynia produced by intrathecal administration of the human immunodeficiency virus-1 (HIV-1) envelope glycoprotein, gp120 , 2000, Brain Research.

[27]  Jacob Feldman,et al.  Minimization of Boolean complexity in human concept learning , 2000, Nature.

[28]  J. D. Smith,et al.  Thirty categorization results in search of a model. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[29]  C. Woolf,et al.  Neuronal plasticity: increasing the gain in pain. , 2000, Science.

[30]  A. Reeve,et al.  Intrathecally administered endotoxin or cytokines produce allodynia, hyperalgesia and changes in spinal cord neuronal responses to nociceptive stimuli in the rat , 2000, European journal of pain.

[31]  J. Odendaal Animal-assisted therapy - magic or medicine? , 2000, Journal of psychosomatic research.

[32]  S. Maier,et al.  The Immune System as a Sensory System , 2000 .

[33]  S. Maier,et al.  Intrathecal HIV-1 Envelope Glycoprotein gp120 Induces Enhanced Pain States Mediated by Spinal Cord Proinflammatory Cytokines , 2001, The Journal of Neuroscience.

[34]  U. Hahn,et al.  Similarity and categorization , 2001 .

[35]  J. Deleo,et al.  Intrathecal interleukin-1 receptor antagonist in combination with soluble tumor necrosis factor receptor exhibits an anti-allodynic action in a rat model of neuropathic pain , 2001, Neuroscience.

[36]  Steven F. Maier,et al.  Glial activation: a driving force for pathological pain , 2001, Trends in Neurosciences.

[37]  Joseph L. Izzo,et al.  Pet Ownership, but Not ACE Inhibitor Therapy, Blunts Home Blood Pressure Responses to Mental Stress , 2001, Hypertension.

[38]  N Chater,et al.  Categorization by simplicity: a minimum description length approach to unsupervised clustering , 2001, Similarity and Categorization.

[39]  Linda R Watkins,et al.  Beyond neurons: evidence that immune and glial cells contribute to pathological pain states. , 2002, Physiological reviews.

[40]  Jacob Feldman,et al.  Categorization Under Complexity: A Unified MDL Account of Human Learning of Regular and Irregular Categories , 2002, NIPS.

[41]  Jim Blascovich,et al.  Cardiovascular Reactivity and the Presence of Pets, Friends, and Spouses: The Truth About Cats and Dogs , 2002, Psychosomatic medicine.

[42]  J. Feldman A catalog of Boolean concepts , 2003 .

[43]  N. Chater,et al.  Simplicity: a unifying principle in cognitive science? , 2003, Trends in Cognitive Sciences.