of Experimental Psychology : Human Perception and Performance Attentional Capture of Objects Referred to by Spoken Language

Participants saw a small number of objects in a visual display and performed a visual detection or visual-discrimination task in the context of task-irrelevant spoken distractors. In each experiment, a visual cue was presented 400 ms after the onset of a spoken word. In experiments 1 and 2, the cue was an isoluminant color change and participants generated an eye movement to the target object. In experiment 1, responses were slower when the spoken word referred to the distractor object than when it referred to the target object. In experiment 2, responses were slower when the spoken word referred to a distractor object than when it referred to an object not in the display. In experiment 3, the cue was a small shift in location of the target object and participants indicated the direction of the shift. Responses were slowest when the word referred to the distractor object, faster when the word did not have a referent, and fastest when the word referred to the target object. Taken together, the results demonstrate that referents of spoken words capture attention.

[1]  G. Altmann,et al.  The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing , 2007 .

[2]  J. Findlay,et al.  The Relationship between Eye Movements and Spatial Attention , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[3]  Eva Belke,et al.  Top-down effects of semantic knowledge in visual search are modulated by cognitive but not perceptual load , 2008, Perception & psychophysics.

[4]  S. Yantis 3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .

[5]  W. James,et al.  The Principles of Psychology. , 1983 .

[6]  G W Humphreys,et al.  Automatic access to object identity: attention to global information, not to particular physical dimensions, is important. , 1995, Journal of experimental psychology. Human perception and performance.

[7]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[8]  G. Humphreys,et al.  Early, involuntary top-down guidance of attention from working memory. , 2005, Journal of experimental psychology. Human perception and performance.

[9]  Mark S. Gilzenrat,et al.  A Systems-Level Perspective on Attention and Cognitive Control: Guided Activation, Adaptive Gating, Conflict Monitoring, and Exploitation versus Exploration. , 2004 .

[10]  David Soto,et al.  Automatic guidance of visual attention from verbal working memory. , 2007, Journal of experimental psychology. Human perception and performance.

[11]  W. Nelson Francis,et al.  FREQUENCY ANALYSIS OF ENGLISH USAGE: LEXICON AND GRAMMAR , 1983 .

[12]  P. Downing,et al.  Interactions Between Visual Working Memory and Selective Attention , 2000, Psychological science.

[13]  Eva Belke,et al.  Early activation of object names in visual search , 2007, Psychonomic bulletin & review.

[14]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[15]  O. Mimura [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.

[16]  G. Altmann Language can mediate eye movement control within 100 milliseconds, regardless of whether there is anything to move the eyes to , 2011, Acta psychologica.

[17]  S. Yantis,et al.  Uniqueness of abrupt visual onset in capturing attention , 1988, Perception & psychophysics.

[18]  Yuki Kamide,et al.  Now you see it, now you don't: mediating the mapping between language and the visual world , 2004 .

[19]  Daniel C. Richardson,et al.  Representation, space and Hollywood Squares: looking at things that aren't there anymore , 2000, Cognition.

[20]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[21]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[22]  G. Altmann Language-mediated eye movements in the absence of a visual world: the ‘blank screen paradigm’ , 2004, Cognition.

[23]  Falk Huettig,et al.  Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness , 2007 .

[24]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[25]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[26]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[27]  Colin M. Macleod Half a century of research on the Stroop effect: an integrative review. , 1991, Psychological bulletin.

[28]  D. E. Irwin,et al.  Attentional and oculomotor capture by onset, luminance and color singletons , 2000, Vision Research.

[29]  M. Tanenhaus,et al.  Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition , 2005, Psychonomic bulletin & review.

[30]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[31]  M. Posner The Cognitive Neuroscience of Attention , 2020 .

[32]  Roger M. Cooper,et al.  The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. , 1974 .

[33]  L. Chelazzi,et al.  Associative knowledge controls deployment of visual selective attention , 2003, Nature Neuroscience.

[34]  R. Burchfield Frequency Analysis of English Usage: Lexicon and Grammar. By W. Nelson Francis and Henry Kučera with the assistance of Andrew W. Mackie. Boston: Houghton Mifflin. 1982. x + 561 , 1985 .

[35]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[36]  G. Altmann,et al.  Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation , 2009, Cognition.

[37]  J. Maxwell,et al.  The role of prior exposure in the capture of attention by items in working memory , 2008 .

[38]  M. Sacks E-mail notification of your latest issue online! , 2002 .

[39]  Michael K. Tanenhaus,et al.  Eye movements and spoken language processing , 2007 .

[40]  G. Humphreys,et al.  Selection by color and form in vision. , 1997, Journal of experimental psychology. Human perception and performance.

[41]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[42]  Anne Pier Salverda,et al.  A goal-based perspective on eye movements in visual world studies. , 2011, Acta psychologica.

[43]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[44]  J. Theeuwes,et al.  Feature-based memory-driven attentional capture: visual working memory content affects visual attention. , 2006, Journal of experimental psychology. Human perception and performance.

[45]  Julie C. Sedivy,et al.  Eye movements to pictures reveal transient semantic activation during spoken word recognition. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Paul D. Allopenna,et al.  Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models , 1998 .

[47]  S. Yantis Stimulus-driven attentional capture and attentional control settings. , 1993, Journal of experimental psychology. Human perception and performance.

[48]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[49]  G. Altmann,et al.  Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm , 2005, Cognition.

[50]  G. Humphreys,et al.  Automatic guidance of attention from working memory , 2008, Trends in Cognitive Sciences.