Words and the World

Can what we know change what we see? Does language affect cognition and perception? The last few years have seen increased attention to these seemingly disparate questions, but with little theoretical advance. We argue that substantial clarity can be gained by considering these questions through the lens of predictive processing, a framework in which mental representations—from the perceptual to the cognitive—reflect an interplay between downward-flowing predictions and upward-flowing sensory signals. This framework provides a parsimonious account of how (and when) what we know ought to change what we see and helps us understand how a putatively high-level trait such as language can impact putatively low-level processes such as perception. Within this framework, language begins to take on a surprisingly central role in cognition by providing a uniquely focused and flexible means of constructing predictions against which sensory signals can be evaluated. Predictive processing thus provides a plausible mechanism for many of the reported effects of language on perception, thought, and action, and new insights on how and when speakers of different languages construct the same “reality” in alternate ways.

[1]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[2]  L. Gleitman,et al.  [Language and thought]. , 1991, La Revue du praticien.

[3]  S. Pinker The Language Instinct , 1994 .

[4]  K. Stanovich,et al.  Early reading acquisition and its relation to reading experience and ability 10 years later. , 1997, Developmental psychology.

[5]  Z. Pylyshyn Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. , 1999, The Behavioral and brain sciences.

[6]  Lila R. Gleitman,et al.  Why It Is Hard to Label Our Concepts. , 2004 .

[7]  Gary Lupyan,et al.  LABELS FACILITATE LEARNING OF NOVEL CATEGORIES , 2006 .

[8]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[9]  Karl J. Friston,et al.  Free-energy and the brain , 2007, Synthese.

[10]  D. Casasanto,et al.  Who's Afraid of the Big Bad Whorf? Crosslinguistic Differences in Temporal Language and Thought , 2008 .

[11]  J. Elman On the Meaning of Words and Dinosaur Bones: Lexical Knowledge Without a Lexicon , 2009, Cogn. Sci..

[12]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[13]  J. Baldo,et al.  Is relational reasoning dependent on language? A voxel-based lesion symptom mapping study , 2010, Brain and Language.

[14]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[15]  Britt Anderson,et al.  There is no Such Thing as Attention , 2011, Front. Psychology.

[16]  Michael J. Spivey,et al.  The Cambridge Handbook of Psycholinguistics , 2012 .

[17]  S. Thompson-Schill,et al.  The evocative power of words: activation of concepts by verbal and nonverbal means. , 2012, Journal of experimental psychology. General.

[18]  Karl J. Friston,et al.  Free-Energy and Illusions: The Cornsweet Effect , 2011, Front. Psychology.

[19]  G. Lupyan Chapter Seven – What Do Words Do? Toward a Theory of Language-Augmented Thought , 2012 .

[20]  Floris P. de Lange,et al.  How Prediction Errors Shape Perception, Attention, and Motivation , 2012, Front. Psychology.

[21]  The Cambridge Handbook of Psycholinguistics: How the Languages We Speak Shape the Ways We Think , 2012 .

[22]  C. Frith,et al.  Mechanisms of social cognition. , 2012, Annual review of psychology.

[23]  Alexander G. Huth,et al.  Attention During Natural Vision Warps Semantic Representation Across the Human Brain , 2013, Nature Neuroscience.

[24]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[25]  J. Hohwy The Predictive Mind , 2013 .

[26]  Gary Lupyan,et al.  Language can boost otherwise unseen objects into visual awareness , 2013, Proceedings of the National Academy of Sciences.

[27]  James L. McClelland Integrating probabilistic models of perception and interactive neural networks: a historical and tutorial review , 2013, Front. Psychol..

[28]  James L. McClelland,et al.  Interactive Activation and Mutual Constraint Satisfaction in Perception and Cognition , 2014, Cogn. Sci..

[29]  H. Helmholtz Handbuch der physiologischen Optik , 2015 .

[30]  S. Siegel,et al.  Cognitive Penetrability of Perception in the Age of Prediction: Predictive Systems are Penetrable Systems , 2015 .

[31]  G. Lupyan,et al.  Words jump-start vision: a label advantage in object recognition. , 2015, Journal of vision.

[32]  Mutsumi Imai,et al.  Where are the concepts? What words can and can’t reveal , 2015 .

[33]  Gary Lupyan,et al.  Cognitive Penetrability of Perception in the Age of Prediction: Predictive Systems are Penetrable Systems , 2015 .

[34]  Gary Lupyan,et al.  How Language Programs the Mind , 2016, Top. Cogn. Sci..