Actions and roles: Using depicted events for disambiguation and reinterpretation in German and English

Can depicted actions help in establishing role relations between participants in an event and trigger rapid disambiguation of local structural and role ambiguity in sentence comprehension? Verb information has been shown to influence visual referential processing (e.g. Altmann & Kamide, 1999; Kako & Trueswell, 2000). Moreover, results from priming studies (e.g. Ferretti, McRae & Hatherell, 2001) suggest that verbs activate typical agents, patients and instruments via event knowledge. Thus, verbs can make complex knowledge structures accessible. However, verb knowledge may sometimes not be sufficient to interpret role relations correctly. We investigated if visual information about a character’s role-relation to other characters in an event influences processes of role assignment in on-line sentence comprehension. Three experiments present evidence that visual event information – actions and roles – lead to rapid disambiguation of initial structural and role ambiguity which verb knowledge alone did not disambiguate. In addition we found effects of reinterpretation processes. Findings have been replicated cross-linguistically for two different sentence structures (German SVO/OVS and English MV/RR clause).

[1]  M. Tanenhaus,et al.  Circumscribing Referential Domains during Real-Time Language Comprehension , 2002 .

[2]  Barbara Hemforth,et al.  Kognitives Parsing: Repräsentation und Verarbeitung sprachlichen Wissens , 1993, DISKI.

[3]  Christopher T. Kello,et al.  Verb-specific constraints in sentence processing: separating effects of lexical preference from garden-paths. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[4]  J. Trueswell THE ROLE OF LEXICAL FREQUENCY IN SYNTACTIC AMBIGUITY RESOLUTION , 1996 .

[5]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[6]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[7]  John C. Trueswell,et al.  Verb Meanings, Object Affordances, and the Incremental Restrictions of Reference , 2000 .

[8]  Christoph Scheepers,et al.  Integration of Syntactic and Semantic Information in Predictive Processing: Cross-Linguistic Evidence from German and English , 2003, Journal of psycholinguistic research.

[9]  David R. Dowty Thematic proto-roles and argument selection , 1991 .

[10]  Julie C. Sedivy,et al.  Achieving incremental semantic interpretation through contextual representation , 1999, Cognition.

[11]  M. Tanenhaus,et al.  Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension , 1998 .

[12]  D. C. Howell Statistical Methods for Psychology , 1987 .

[13]  K. McRae,et al.  Integrating Verbs, Situation Schemas, and Thematic Role Concepts , 2001 .

[14]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .