Representing spatial shifts in event processing

Representing spatial shifts in event processing Glenn Patrick Williams (g.w.williams@dundee.ac.uk) Anuenue Kukona (a.b.bakerkukona@dundee.ac.uk) Yuki Kamide ( y.kamide@dundee.ac.uk ) School of Psychology, University of Dundee, DD1 4HN, UK associated with these locations. However, this effect was subsequently shown to be due to the number of ‘event boundaries’ encountered, rather than the distance travelled. When controlling for distance, but manipulating the number of event boundaries – specifically, doorways – crossed, accessibility for information decreased (Radvansky & Copeland, 2006; Rinck, Hahnel, Bower, & Glowalla, 1997), suggesting that “walking through doorways causes forgetting” (Radvansky & Copeland: p.1154). Abstract Two experiments explored the effects of changes in distance and location on the accessibility of event-related information during language comprehension. In Experiment 1, listeners viewed visual scenes depicting a location containing several objects, while they listened to narratives describing an agent either staying in that initial location, or moving to a new one (either close or far away), and then thinking about one of the depicted objects. We found that eye movements to these objects were modulated (reduced) by changes in location, rather than distance. In Experiment 2, listeners viewed scenes depicting two rooms, while they listened to narratives describing an object moving either between the rooms, or within one room. When the object was mentioned following the event, we found fewer eye movements to it when the movement occurred between rooms. We discuss these results in relation to the Event Horizon model. Keywords: Event cognition; Mental models; Situation models; Spatial processing; Motion events; Visual world paradigm. Introduction When understanding a narrative, we must track information along a number of (often) changing dimensions. For example, what is being referred to, and where is it? Language comprehenders are assumed to activate a set of mental representations that contain information needed to establish a coherent situation (or mental) model of the events described in a narrative (Glenberg, Meyer, & Lindem, 1987). But what is maintained in a situation model, and how does the structure of a situation model affect comprehension? Location representation A series of experiments by Bower and colleagues (Morrow, Greenspan, & Bower, 1987; Rinck & Bower, 1995, 2000) aimed to address whether spatial information is retained in a situation model. They found that language comprehenders often took the perspective of an agent, and focused on information associated with the agent’s current location, while suppressing information associated with other locations. Critically, these experiments reported a spatial gradient of accessibility (Rinck & Bower, 1995), in which the further the agent travelled from previous locations, the harder it was for comprehenders to retrieve information Competing representations Why does crossing an event boundary affect accessibility? The Event Horizon model (Radvansky, 2012) claims that information is structured around, and segmented according to, ‘event boundaries’. If a boundary is crossed, information either side of it is segmented into separate events. This account also argues that (i) one event will be more activated or more in focus than others in comprehenders’ working memory; and (ii) when objects are contained in multiple events, competition can occur (Radvansky & Zacks, 2011). As such, this model predicts a cost to switching focus from one event to another, and for accessing a single representation of an object that is represented in two events. Current experiments Although the current evidence suggests that situation models are structured around event boundaries, and not distance, much of this evidence depends on explicit memory-based tasks, which often take place long after the processing of critical linguistic input. Indeed, both distance and event boundaries have been shown to influence the accessibility of information under certain task conditions (Rinck & Denis, 2004). Here, we addressed two issues: in the absence of an overt task, (i) are situation models organised around distance or event boundaries (Experiment 1); and (ii) do event-based effects stem from event switching costs, or memory load costs (i.e., of maintaining multiple events; Experiment 2)? We used the visual-world eye-tracking paradigm (e.g., Tanenhaus, Spivey-Knowlton, Eberhard, & Sedivy, 1995) to explore these issues.

[1]  G. Altmann,et al.  Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation , 2009, Cognition.

[2]  G. Bower,et al.  Temporal and spatial distance in situation models , 2000, Memory & cognition.

[3]  Mike Rinck,et al.  Anaphora Resolution and the Focus of Attention in Situation Models , 1995 .

[4]  Gabriel A Radvansky,et al.  Walking through Doorways Causes Forgetting: Further Explorations , 2011, Quarterly journal of experimental psychology.

[5]  G. Bower,et al.  The metrics of spatial situation models. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[6]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[7]  D. Barr Analyzing ‘visual world’ eyetracking data using multilevel logistic regression , 2008 .

[8]  A. Glenberg,et al.  Mental models contribute to foregrounding during text comprehension , 1987 .

[9]  G. Altmann Language-mediated eye movements in the absence of a visual world: the ‘blank screen paradigm’ , 2004, Cognition.

[10]  Sharon L. Thompson-Schill,et al.  The Effect of Object State-Changes on Event Processing: Do Objects Compete with Themselves? , 2012, The Journal of Neuroscience.

[11]  Gabriel A. Radvansky,et al.  Across the Event Horizon , 2012 .

[12]  Gabriel A Radvansky,et al.  Event perception. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[13]  Mike Rinck,et al.  The metrics of spatial distance traversed during mental imagery. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[14]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[15]  Gabriel A Radvansky,et al.  Walking through doorways causes forgetting: Situation models and experienced space , 2006, Memory & cognition.

[16]  S. Greenspan,et al.  Accessibility and situation models in narrative comprehension , 1987 .

[17]  Silvia P. Gennari,et al.  Time in language: Event duration in language comprehension , 2011, Cognitive Psychology.