Simulating Speed in Language: Contributions from vision, audition and action

Embodied theories propose that understanding meaning in language requires the mental simulation of entities being referred to. These mental simulations would make use of the same modality-specific systems involved in perceiving and acting upon such entities in the world, grounding language in the real world. However, embodied theories are currently underspecified in terms of how much information from an event is contained in mental simulations, and what features of experience are included. The thesis addresses comprehension of language that describes speed of events. Investigating speed allows embodied theories to be extended to a more complex feature of events. Further, speed is a fine-grained feature and thus testing an embodied theory of speed will reveal whether or not mental simulations include the fine details of real-world experience. Within the thesis four main methods of investigation were used, assessing simulation of speed with different types of speed language under different conditions: behavioural testing combining speed in language with speed in perception and action, eye-tracking investigating whether eye-movements to a visual scene are affected by speed in sentences, a psychophysics paradigm assessing whether speed in language affects visual perception processes, and finally, as a crucial test of embodiment, whether or not Parkinson’s patients, who have difficulty moving speedily, also have problems with comprehension of speed language. The main findings of the thesis are that: (1) speed, a fine-grained and abstract dimension, is simulated during comprehension, (2) simulations are dynamic and context-dependent, and (3) simulations of speed are specific to biological motion and can encode specific effectors used in an action. These results help to specify current embodied theories in terms of what the nature of simulations are and what factors they are sensitive to, in addition to broadly providing support for the sharing of cognitive/neural processes between language, action and perception.

[1]  Kensy Cooperrider,et al.  The tangle of space and time in human cognition , 2013, Trends in Cognitive Sciences.

[2]  Harold Bekkering,et al.  How specifically are action verbs represented in the neural motor system: An fMRI study , 2010, NeuroImage.

[3]  G. Altmann,et al.  The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing , 2007 .

[4]  Á. Pascual-Leone,et al.  Repetitive TMS over posterior STS disrupts perception of biological motion , 2005, Vision Research.

[5]  P. Dixon,et al.  Semantics affect the planning but not control of grasping , 2002, Experimental Brain Research.

[6]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[7]  A. Glenberg,et al.  Processing Abstract Language Modulates Motor System Activity , 2008, Quarterly journal of experimental psychology.

[8]  A. Glenberg,et al.  Action-based language: A theory of language acquisition, comprehension, and production , 2012, Cortex.

[9]  Roel M. Willems,et al.  Body-specific representations of action verbs: Neural evidence from right- and left-handers , 2009, NeuroImage.

[10]  Alison Davies,et al.  Divided Attention to Ear and Eye1 , 2012 .

[11]  Nicholas J. Priebe,et al.  The Neural Representation of Speed in Macaque Area MT/V5 , 2003, The Journal of Neuroscience.

[12]  Arthur C. Graesser,et al.  Differences in interconcept organization between nouns and verbs , 1987 .

[13]  Louise Connell,et al.  I see/hear what you mean: semantic activation in visual word recognition depends on perceptual attention. , 2014, Journal of experimental psychology. General.

[14]  T. Pasternak,et al.  Transient and permanent deficits in motion perception after lesions of cortical areas MT and MST in the macaque monkey. , 1999, Cerebral cortex.

[15]  Gabriella Vigliocco,et al.  Integrating experiential and distributional data to learn semantic representations. , 2009, Psychological review.

[16]  Daniel C. Richardson,et al.  On the spatial and image-schematic underpinnings of real-time language processing. , 2005 .

[17]  F. Colavita Human sensory dominance , 1974 .

[18]  Stephan P. Swinnen,et al.  Interaction of sound and sight during action perception: Evidence for shared modality-dependent action representations , 2009, Neuropsychologia.

[19]  G. Recanzone Auditory influences on visual temporal rate perception. , 2003, Journal of neurophysiology.

[20]  A. Damasio,et al.  Nouns and verbs are retrieved with differently distributed neural systems. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[21]  W. Newsome,et al.  Microstimulation in visual area MT: effects on direction discrimination performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  E. Shoben,et al.  Differential Context Effects in the Comprehension of Abstract and Concrete Verbal Materials , 1983 .

[23]  Susan T. Dumais,et al.  The latent semantic analysis theory of knowledge , 1997 .

[24]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[25]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[26]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[27]  Nicholas J. Priebe,et al.  Estimating Target Speed from the Population Response in Visual Area MT , 2004, The Journal of Neuroscience.

[28]  Marc W Howard,et al.  When Does Semantic Similarity Help Episodic Retrieval , 2002 .

[29]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[30]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[31]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[32]  Uta Noppeney,et al.  Retrieval of abstract semantics , 2004, NeuroImage.

[33]  Angela D. Friederici,et al.  Comprehending Prehending: Neural Correlates of Processing Verbs with Motor Stems , 2007, Journal of Cognitive Neuroscience.

[34]  John R. Anderson Arguments concerning representations for mental imagery. , 1978 .

[35]  Mark S. Seidenberg,et al.  Double Dissociation of Semantic Categories in Alzheimer's Disease , 1997, Brain and Language.

[36]  Maarten Casteren,et al.  Match: A program to assist in matching the conditions of factorial experiments , 2007, Behavior research methods.

[37]  J. Kable,et al.  Neural Substrates of Action Event Knowledge , 2002, Journal of Cognitive Neuroscience.

[38]  Roger Ratcliff,et al.  Methods for Dealing With Reaction Time Outliers , 1992 .

[39]  Rolf A. Zwaan Embodiment and language comprehension: reframing the discussion , 2014, Trends in Cognitive Sciences.

[40]  G. Rizzolatti,et al.  Congruent Embodied Representations for Visually Presented Actions and Linguistic Phrases Describing Actions , 2006, Current Biology.

[41]  Elizabeth Bates,et al.  Separate neural systems for processing action- or non-action-related sounds , 2005, NeuroImage.

[42]  G. Vigliocco,et al.  The representation of abstract words: why emotion matters. , 2011, Journal of experimental psychology. General.

[43]  Guy Dove Beyond perceptual symbols: A call for representational pluralism , 2009, Cognition.

[44]  S. Aglioti,et al.  Representing actions through their sound , 2010, Experimental Brain Research.

[45]  Lawrence W. Barsalou,et al.  Language and simulation in conceptual processing , 2008 .

[46]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[47]  L. Boroditsky Metaphoric structuring: understanding time through spatial metaphors , 2000, Cognition.

[48]  G. Altmann Language can mediate eye movement control within 100 milliseconds, regardless of whether there is anything to move the eyes to , 2011, Acta psychologica.

[49]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[50]  Bahador Bahrami,et al.  Visual motion interferes with lexical decision on motion words , 2008, Current Biology.

[51]  Stevan Harnad The Symbol Grounding Problem , 1999, ArXiv.

[52]  M. Louwerse,et al.  The linguistic and embodied nature of conceptual processing , 2010, Cognition.

[53]  Zhijie Zhang,et al.  Time changes with feeling of speed: an embodied perspective , 2013, Front. Neurorobot..

[54]  S. Cappa,et al.  Nouns and verbs in the brain: A review of behavioural, electrophysiological, neuropsychological and imaging studies , 2011, Neuroscience & Biobehavioral Reviews.

[55]  Peter Hagoort,et al.  The Behavioral and Neural Effects of Language on Motion Perception , 2015, Journal of Cognitive Neuroscience.

[56]  A. Damasio,et al.  Cortical systems for retrieval of concrete knowledge: The convergence zone framework , 1994 .

[57]  E. Thelen,et al.  The dynamics of embodiment: A field theory of infant perseverative reaching , 2001, Behavioral and Brain Sciences.

[58]  Luigi Cattaneo,et al.  Use-induced motor plasticity affects the processing of abstract and concrete language , 2008, Current Biology.

[59]  Lotte Meteyard Motion seen and understood: interactions between language comprehension and visual perception. , 2008 .

[60]  Friedemann Pulvermüller,et al.  Reading cinnamon activates olfactory brain regions , 2006, NeuroImage.

[61]  L. Barsalou,et al.  Verifying Different-Modality Properties for Concepts Produces Switching Costs , 2003, Psychological science.

[62]  Karl G. D. Bailey,et al.  Good-Enough Representations in Language Comprehension , 2002 .

[63]  Stefano F. Cappa,et al.  Category-specific Naming Impairment for Artefacts: A New Case , 1998 .

[64]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[65]  F. Pulvermüller,et al.  Reading salt activates gustatory brain regions: fMRI evidence for semantic grounding in a novel sensory modality. , 2012, Cerebral cortex.

[66]  A. Siderowf,et al.  Validity of the MoCA and MMSE in the detection of MCI and dementia in Parkinson disease , 2009, Neurology.

[67]  Anne H. Anderson,et al.  The Accessibility of Pronominal Antecedents as a Function of Episode Shifts in Narrative Text , 1983 .

[68]  Louise Connell,et al.  Flexible and fast: Linguistic shortcut affects both shallow and deep conceptual processing , 2013, Psychonomic bulletin & review.

[69]  Michael P. Kaschak,et al.  Constructing Meaning: The Role of Affordances and Grammatical Constructions in Sentence Comprehension , 2000 .

[70]  T. Schenk,et al.  Visual motion perception after brain damage: I. Deficits in global motion perception , 1997, Neuropsychologia.

[71]  F Pulvermüller,et al.  Nouns and verbs in the intact brain: evidence from event-related potentials and high-frequency cortical responses. , 1999, Cerebral cortex.

[72]  Tim Shallice,et al.  EFFECTS OF WORD ABSTRACTNESS IN A CONNECTIONIST MODEL OF DEEP DYSLEXIA , 1991 .

[73]  Bahador Bahrami,et al.  Slow to anger: Emergence of emotionally loaded words and faces from interocular suppression , 2011, CogSci.

[74]  G. Murphy,et al.  The Big Book of Concepts , 2002 .

[75]  Ludovica Labruna,et al.  A Functional Role for the Motor System in Language Understanding , 2011, Psychological science.

[76]  Paul D. Allopenna,et al.  Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models , 1998 .

[77]  Nicu Sebe,et al.  Distributional semantics with eyes: using image analysis to improve computational representations of word meaning , 2012, ACM Multimedia.

[78]  S. Cappa,et al.  The breakdown of semantic knowledge: Insights from a statistical model of meaning representation , 2003, Brain and Language.

[79]  Sian L. Beilock,et al.  The role of personal experience in the neural processing of action-related language , 2010, Brain and Language.

[80]  M. Bradley,et al.  Affective Normsfor English Words (ANEW): Stimuli, instruction manual and affective ratings (Tech Report C-1) , 1999 .

[81]  Dennis J. Delprato,et al.  Mind and Its Evolution: A Dual Coding Theoretical Approach , 2009 .

[82]  G. Orban,et al.  Human velocity and direction discrimination measured with random dot patterns , 1988, Vision Research.

[83]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[84]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[85]  Marshall R. Mayberry,et al.  Situated sentence processing: The coordinated interplay account and a neurobehavioral model , 2010, Brain and Language.

[86]  D. McDermott LANGUAGE OF THOUGHT , 2012 .

[87]  Teenie Matlock,et al.  On the path to understanding on-line processing of grammatical aspect , 2008 .

[88]  L. Barsalou,et al.  Situating Abstract Concepts , 2004 .

[89]  Rolf A. Zwaan,et al.  Motor Resonance and Linguistic Focus , 2008, Quarterly journal of experimental psychology.

[90]  R. Ilmoniemi,et al.  Functional links between motor and language systems , 2005, The European journal of neuroscience.

[91]  J R Hodges,et al.  Selective impairment of verb processing associated with pathological changes in Brodmann areas 44 and 45 in the motor neurone disease-dementia-aphasia syndrome. , 2001, Brain : a journal of neurology.

[92]  Lawrence W. Barsalou,et al.  Language comprehension: Archival memory or preparation for situated action? , 1999 .

[93]  Janellen Huttenlocher,et al.  The semantic organization of some simple nouns and verbs , 1979 .

[94]  Cross-talk between language processes and overt motor behavior in the first 200 ms of processing , 2009 .

[95]  A. Paivio Imagery and verbal processes , 1972 .

[96]  Gemma Boleda,et al.  Distributional Semantics in Technicolor , 2012, ACL.

[97]  K. McRae,et al.  Automatic semantic similarity priming. , 1998 .

[98]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[99]  F. Pulvermüller,et al.  Category-specific conceptual processing of color and form in left fronto-temporal cortex. , 2006, Cerebral cortex.

[100]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[101]  Lawrence W. Barsalou,et al.  Are Automatic Conceptual Cores the Gold Standard of Semantic Processing? The Context-Dependence of Spatial Meaning in Grounded Congruency Effects , 2015, Cogn. Sci..

[102]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[103]  Roel M. Willems,et al.  Body-Specific Motor Imagery of Hand Actions: Neural Evidence from Right- and Left-Handers , 2009, Front. Hum. Neurosci..

[104]  Daniel C. Richardson,et al.  Spatial language, visual attention, and perceptual simulation , 2010, Brain and Language.

[105]  L. Barsalou,et al.  Head Up, Foot Down , 2008, Psychological science.

[106]  Michael P. Kaschak,et al.  Perception of Auditory Motion Affects Language Processing , 2006, Cogn. Sci..

[107]  Pasquale A. Della Rosa,et al.  The impact of semantic reference on word class: An fMRI study of action and object naming , 2006, NeuroImage.

[108]  Mark J. Huff,et al.  An Abundance of Riches: Cross-Task Comparisons of Semantic Richness Effects in Visual Word Recognition , 2012, Front. Hum. Neurosci..

[109]  Lawrence W. Barsalou,et al.  Property generation reflects word association and situated simulation , 2011, Language and Cognition.

[110]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[111]  B. L. Whorf Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf , 1956 .

[112]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[113]  D. Slobin From “thought and language” to “thinking for speaking” , 1996 .

[114]  Rich Hall,et al.  Sniglets (snig'lit) : any word that doesn't appear in the dictionary, but should , 1984 .

[115]  G. Buccino,et al.  Fine tuned modulation of the motor system by adjectives expressing positive and negative properties , 2013, Brain and Language.

[116]  Harold Bekkering,et al.  Flexibility in embodied lexical‐semantic representations , 2012, Human brain mapping.

[117]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[118]  Srini Narayanan,et al.  Spatial and Linguistic Aspects of Visual Imagery in Sentence Comprehension , 2007, Cogn. Sci..

[119]  Michael P. Kaschak,et al.  Processing time shifts affects the execution of motor responses , 2011, Brain and Language.

[120]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[121]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[122]  Ludovica Labruna,et al.  Modulation of the motor system during visual and auditory language processing , 2011, Experimental Brain Research.

[123]  M. Jeannerod,et al.  Subliminal display of action words interferes with motor planning: A combined EEG and kinematic study , 2008, Journal of Physiology-Paris.

[124]  S. Vereza Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[125]  Matthew H. Davis,et al.  Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging , 2008, The European journal of neuroscience.

[126]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[127]  Sergio E. Chaigneau,et al.  THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS , 2003, Cognitive neuropsychology.

[128]  Xiaoping P. Hu,et al.  fMRI evidence for word association and situated simulation in conceptual processing , 2008, Journal of Physiology-Paris.

[129]  M. Louwerse,et al.  Stormy Seas and Cloudy Skies: Conceptual Processing is (Still) Linguistic and Perceptual , 2011, Front. Psychology.

[130]  P. Niedenthal,et al.  Embodying Emotional Disorders: New Hypotheses about Possible Emotional Consequences of Motor Disorders in Parkinson's Disease and Tourette's Syndrome , 2011, ISRN Neurology.

[131]  P. Kay,et al.  What is the Sapir-Whorf hypothesis? , 1983 .

[132]  D. O'Neill,et al.  A step at a time: Preliterate children’s simulation of narrative movement during story comprehension , 2010, Cognition.

[133]  R. Ivry,et al.  Impaired Velocity Perception in Patients with Lesions of the Cerebellum , 1991, Journal of Cognitive Neuroscience.

[134]  Suzanne Corkin,et al.  Impaired problem solving in Parkinson's disease: Impact of a set-shifting deficit , 1994, Neuropsychologia.

[135]  Rolf A. Zwaan,et al.  Rapid Communication: Readers Routinely Represent Implied Object Rotation: The Role of Visual Experience , 2010, Quarterly journal of experimental psychology.

[136]  John J. Foxe,et al.  Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness , 2011, NeuroImage.

[137]  Arthur M. Glenberg,et al.  Indexical understanding of instructions , 1999 .

[138]  M. Ibbotson,et al.  Influence of adapting speed on speed and contrast coding in the primary visual cortex of the cat , 2007, The Journal of physiology.

[139]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[140]  Rolf A. Zwaan The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[141]  Markus Kiefer,et al.  Conceptual Flexibility in the Human Brain: Dynamic Recruitment of Semantic Maps from Visual, Motor, and Motion-related Areas , 2008, Journal of Cognitive Neuroscience.

[142]  Juha Silvanto,et al.  The causal role of category-specific neuronal representations in the left ventral premotor cortex (PMv) in semantic processing , 2010, NeuroImage.

[143]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[144]  Silvia P. Gennari Representing Motion in Language Comprehension: Lessons From Neuroimaging , 2012, Lang. Linguistics Compass.

[145]  R. Ivry,et al.  The neural representation of time , 2004, Current Opinion in Neurobiology.

[146]  Mark S. Seidenberg,et al.  Category-Specific Semantic Deficits in Focal and Widespread Brain Damage: A Computational Account , 1998, Journal of Cognitive Neuroscience.

[147]  V. Hömberg,et al.  Cerebral visual motion blindness: transitory akinetopsia induced by transcranial magnetic stimulation of human area V5 , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[148]  Benjamin Naumann,et al.  Mental Representations A Dual Coding Approach , 2016 .

[149]  Giosuè Baggio,et al.  Motion words selectively modulate direction discrimination sensitivity for threshold motion , 2013, Front. Hum. Neurosci..

[150]  Louise Connell,et al.  When does perception facilitate or interfere with conceptual processing? The effect of attentional modulation , 2012, Front. Psychology.

[151]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[152]  Wei Ji Ma,et al.  Lip-Reading Aids Word Recognition Most in Moderate Noise: A Bayesian Explanation Using High-Dimensional Feature Space , 2009, PloS one.

[153]  A. Caramazza,et al.  Typical neural representations of action verbs develop without vision. , 2012, Cerebral cortex.

[154]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[155]  Alfonso Caramazza,et al.  All Talk and No Action: A Transcranial Magnetic Stimulation Study of Motor Cortex Activation during Action Word Production , 2004, Journal of Cognitive Neuroscience.

[156]  Sian L. Beilock,et al.  Sports experience changes the neural processing of action language , 2008, Proceedings of the National Academy of Sciences.

[157]  Rolf A. Zwaan Processing Narrative Time Shifts , 1996 .

[158]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[159]  R. Klein,et al.  Evidence for semantic satiation : Repeating a category slows subsequent semantic processing , 1990 .

[160]  F Pulvermüller,et al.  The Right Hemisphere’s Role in Action Word Processing: a Double Case Study. , 2001, Neurocase.

[161]  Bahador Bahrami,et al.  Motion Detection and Motion Verbs Affects Low-Level Visual Perception , 2007 .

[162]  Marco Tettamanti,et al.  Training of Manual Actions Improves Language Understanding of Semantically Related Action Sentences , 2012, Front. Psychology.

[163]  Harold Bekkering,et al.  Body schematics: On the role of the body schema in embodied lexical–semantic representations , 2010, Neuropsychologia.

[164]  Tad T. Brunyé,et al.  Moving through imagined space: Mentally simulating locomotion during spatial description reading. , 2010, Acta psychologica.

[165]  M. Morgan,et al.  Observers can voluntarily shift their psychometric functions without losing sensitivity , 2012 .

[166]  Carla H. Lagorio,et al.  Psychology , 1929, Nature.

[167]  F. Manes,et al.  Applauding with Closed Hands: Neural Signature of Action-Sentence Compatibility Effects , 2010, PloS one.

[168]  Alexia Toskos Dils,et al.  A Motion Aftereffect from Literal and Metaphorical Motion Language: Individual Differences , 2010 .

[169]  Mario A. Pei,et al.  Language, Thought and Reality: Selected Writings of Benjamin Lee Whorf , 1957 .

[170]  D. Rosenbaum,et al.  Grasping the meaning of words , 2003, Experimental Brain Research.

[171]  Benjamin K. Bergen,et al.  Language comprehenders represent object distance both visually and auditorily , 2012, Language and Cognition.

[172]  Arthur M. Glenberg,et al.  How reading comprehension is embodied and why that matters , 2011 .

[173]  T. Shallice,et al.  Category specific semantic impairments , 1984 .

[174]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[175]  Teenie Matlock,et al.  The Role of Grammatical Aspect in the Dynamics of Spatial Descriptions , 2010, Spatial Cognition.

[176]  S. Small,et al.  TMS-induced modulation of action sentence priming in the ventral premotor cortex , 2012, Neuropsychologia.

[177]  A Johnston,et al.  Concurrent measurement of perceived speed and speed discrimination threshold using the method of single stimuli , 1999, Vision Research.

[178]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[179]  M. Louwerse,et al.  How fundamental is embodiment to language comprehension? Constraints on embodied cognition , 2008 .

[180]  N. P. Erber Interaction of audition and vision in the recognition of oral speech stimuli. , 1969, Journal of speech and hearing research.

[181]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[182]  P. Johnson-Laird,et al.  Only connections: A critique of semantic networks. , 1984 .

[183]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[184]  Alex Martin,et al.  Representation of Manipulable Man-Made Objects in the Dorsal Stream , 2000, NeuroImage.

[185]  Dermot Lynott,et al.  Strength of perceptual experience predicts word processing performance better than concreteness or imageability , 2012, Cognition.

[186]  Jeremy W. Grabbe,et al.  Evidence for an activation locus of the word-frequency effect in lexical decision. , 2005, Journal of experimental psychology. Human perception and performance.

[187]  A. Sanford Defining embodiment in understanding , 2008 .

[188]  Yuki Kamide,et al.  Now you see it, now you don't: mediating the mapping between language and the visual world , 2004 .

[189]  Fernando Marmolejo-Ramos,et al.  On the mental representations originating during the interaction between language and vision , 2010, Cognitive Processing.

[190]  M. Garrett,et al.  Representing the meanings of object and action words: The featural and unitary semantic space hypothesis , 2004, Cognitive Psychology.

[191]  J. Fadili,et al.  The neural representation of nouns and verbs: PET studies. , 2001, Brain : a journal of neurology.

[192]  B. Bergen,et al.  Grammatical aspect and mental simulation , 2010, Brain and Language.

[193]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[194]  D. Casasanto,et al.  of Experimental Psychology , 2022 .

[195]  Daniel C. Richardson,et al.  Spatial representations activated during real-time comprehension of verbs , 2003, Cogn. Sci..

[196]  Barbara Kaup,et al.  Motion in Vision and Language: Seeing Visual Motion can influence Processing of Motion Verbs , 2013, CogSci.

[197]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[198]  A. Caramazza,et al.  Concepts Are More than Percepts: The Case of Action Verbs , 2008, The Journal of Neuroscience.

[199]  Rutvik H. Desai,et al.  Parkinson’s disease disrupts both automatic and controlled processing of action verbs , 2013, Brain and Language.

[200]  Christoph Scheepers,et al.  To Dash or to Dawdle: Verb-Associated Speed of Motion Influences Eye Movements during Spoken Sentence Comprehension , 2013, PloS one.

[201]  Andrew P. Duchon,et al.  The human visual system averages speed information , 1992, Vision Research.

[202]  D. Aarsland,et al.  Nonlinear decline of mini‐mental state examination in Parkinson's disease , 2011, Movement disorders : official journal of the Movement Disorder Society.

[203]  L. Boroditsky Does Language Shape Thought?: Mandarin and English Speakers' Conceptions of Time , 2001, Cognitive Psychology.

[204]  D. Burr,et al.  Combining visual and auditory information. , 2006, Progress in brain research.

[205]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of curved lines. , 1933 .

[206]  F. Pulvermüller,et al.  The time course of action and action-word comprehension in the human brain as revealed by neurophysiology , 2008, Journal of Physiology-Paris.

[207]  T. Anderson,et al.  The MoCA , 2010, Neurology.

[208]  S. Scott,et al.  The role of semantics and grammatical class in the neural representation of words. , 2006, Cerebral cortex.

[209]  Franco Lepore,et al.  Positional, directional and speed selectivities in the primary auditory cortex of the cat , 1997, Hearing Research.

[210]  Daniel C. Richardson,et al.  Representation, space and Hollywood Squares: looking at things that aren't there anymore , 2000, Cognition.

[211]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[212]  F. Pulvermüller,et al.  Effects of word length and frequency on the human event-related potential , 2004, Clinical Neurophysiology.

[213]  Stavroula Kousta,et al.  Toward a theory of semantic representation , 2009, Language and Cognition.

[214]  M. Kiefer,et al.  The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems , 2008, The Journal of Neuroscience.

[215]  Bruce Luber,et al.  Transcranial magnetic stimulation differentially affects speed and direction judgments , 2001, Experimental Brain Research.

[216]  J. Adelman,et al.  Automatic vigilance for negative words in lexical decision and naming: comment on Larsen, Mercer, and Balota (2006). , 2008, Emotion.

[217]  Karen Emmorey,et al.  Modulation of BOLD Response in Motion-sensitive Lateral Temporal Cortex by Real and Fictive Motion Sentences , 2010, Journal of Cognitive Neuroscience.

[218]  G. Vigliocco,et al.  Language in mind , 2004 .

[219]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[220]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[221]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991, Journal of experimental psychology. General.

[222]  Paul E. Engelhardt,et al.  Good enough language processing: A satisficing approach , 2009 .

[223]  J. Mattingley,et al.  Annual meeting of the Cognitive Neuroscience Society , 1997 .

[224]  S. Levinson,et al.  Rethinking Linguistic Relativity , 1991, Current Anthropology.

[225]  C. Dobel,et al.  Effects of language comprehension on visual processing – MEG dissociates early perceptual and late N400 effects , 2011, Brain and Language.

[226]  Chara Vakrou,et al.  Induced Deficits in Speed Perception by Transcranial Magnetic Stimulation of Human Cortical Areas V5/MT+ and V3A , 2008, The Journal of Neuroscience.

[227]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[228]  Barbara Kaup,et al.  From top to bottom: spatial shifts of attention caused by linguistic stimuli , 2012, Cognitive Processing.

[229]  Angelika Lingnau,et al.  Speed encoding in human visual cortex revealed by fMRI adaptation. , 2009, Journal of vision.

[230]  B. Avants,et al.  Impaired action knowledge in amyotrophic lateral sclerosis , 2008, Neurology.

[231]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[232]  Rolf A. Zwaan,et al.  Moving words: dynamic representations in language comprehension , 2004 .

[233]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[234]  A. Glenberg,et al.  Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning , 2000 .

[235]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[236]  Andrea Pavan,et al.  Linguistic Representations of Motion Do Not Depend on the Visual Motion System , 2013, Psychological science.

[237]  Michael P. Kaschak,et al.  The Body's Contribution to Language , 2003 .

[238]  F. Donders,et al.  For Review Only The Function of Words: Distinct neural correlates for words denoting differently manipulable objects , 2009 .

[239]  Alexander Thiele,et al.  Speed skills: measuring the visual speed analyzing properties of primate MT neurons , 2001, Nature Neuroscience.

[240]  Jeanine K. Stefanucci,et al.  The effects of handedness and reachability on perceived distance. , 2009, Journal of experimental psychology. Human perception and performance.

[241]  P. Kay,et al.  Whorf hypothesis is supported in the right visual field but not the left. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[242]  T. Ebner,et al.  Position, Direction of Movement, and Speed Tuning of Cerebellar Purkinje Cells during Circular Manual Tracking in Monkey , 2005, The Journal of Neuroscience.

[243]  M Gentilucci,et al.  Influence of automatic word reading on motor control , 1998, The European journal of neuroscience.

[244]  Yehezkel Yeshurun,et al.  Multiple lines of evidence link the SMA proper to Encoding of speed and direction of movement in the human supplementary motor area Laboratory investigation , 2022 .

[245]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[246]  Rolf A. Zwaan,et al.  Spatial iconicity affects semantic relatedness judgments , 2003, Psychonomic bulletin & review.

[247]  Rolf A. Zwaan,et al.  PSYCHOLOGICAL SCIENCE Research Article THE EFFECT OF IMPLIED ORIENTATION DERIVED FROM VERBAL CONTEXT ON PICTURE RECOGNITION , 2022 .

[248]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[249]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[250]  Leslie G. Ungerleider,et al.  Discrete Cortical Regions Associated with Knowledge of Color and Knowledge of Action , 1995, Science.

[251]  W. K. Simmons,et al.  A common neural substrate for perceiving and knowing about color , 2007, Neuropsychologia.

[252]  A. Lees Cognitive Deficits in Parkinson’s Disease , 1985 .

[253]  George S. Cree,et al.  Factors underlying category-specific semantic deficits , 2001 .

[254]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[255]  A. Majid,et al.  The Thickness of Musical Pitch , 2013, Psychological science.

[256]  Angela D. Friederici,et al.  Top-Down and Bottom-Up Contributions to Understanding Sentences Describing Objects in Motion , 2010, Front. Psychology.

[257]  Michael J. Spivey,et al.  Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects , 2001, Psychological research.

[258]  L. Connell,et al.  Modality exclusivity norms for 400 nouns: The relationship between perceptual experience and surface word form , 2012, Behavior Research Methods.

[259]  Teenie Matlock,et al.  The integration of figurative language and static depictions: An eye movement study of fictive motion , 2007, Cognition.

[260]  A. Meyer,et al.  Using the visual world paradigm to study language processing: a review and critical evaluation. , 2011, Acta psychologica.