Viewpoint in the Visual-Spatial Modality: The Coordination of Spatial Perspective

Sign languages express viewpoint-dependent spatial relations (e.g., left, right) iconically but must conventionalize from whose viewpoint the spatial relation is being described, the signer's or the perceiver's. In Experiment 1, ASL signers and sign-naïve gesturers expressed viewpoint-dependent relations egocentrically, but only signers successfully interpreted the descriptions nonegocentrically, suggesting that viewpoint convergence in the visual modality emerges with language conventionalization. In Experiment 2, we observed that the cost of adopting a nonegocentric viewpoint was greater for producers than for perceivers, suggesting that sign languages have converged on the most cognitively efficient means of expressing left-right spatial relations. We suggest that nonlinguistic cognitive factors such as visual perspective-taking and motor embodiment may constrain viewpoint convergence in the visual-spatial modality.

[1]  Alison M Trude.  When to simulate and when to associate? Accounting for inter-talker variability in the speech signal. , 2013, The Behavioral and brain sciences.

[2]  Marios N. Avraamides,et al.  Flexible spatial perspective-taking: conversational partners weigh multiple cues in collaborative tasks , 2013, Front. Hum. Neurosci..

[3]  B. Tversky,et al.  Embodied and disembodied cognition: Spatial perspective-taking , 2009, Cognition.

[4]  D R Proffitt,et al.  The influence of spatial reference frames on imagined object- and viewer rotations. , 1999, Acta psychologica.

[5]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[6]  S. Levinson.  Space in language and cognition: Explorations in cognitive diversity , 2003 .

[7]  Karen Emmorey,et al.  Evidence from an emerging sign language reveals that language supports spatial cognition , 2010, Proceedings of the National Academy of Sciences.

[8]  Martha W. Alibali,et al.  Mimicry and simulation in gesture comprehension , 2010, Behavioral and Brain Sciences.

[9]  J. Ridley.  Studies of Interference in Serial Verbal Reactions , 2001 .

[10]  N. Rinehart,et al.  Interpersonal motor resonance in autism spectrum disorder: evidence against a global “mirror system” deficit , 2013, Front. Hum. Neurosci..

[11]  A. Senghas,et al.  The Emergence of Two Functions for Spatial Devices in Nicaraguan Sign Language , 2011, Human Development.

[12]  D. Barr,et al.  Taking Perspective in Conversation: The Role of Mutual Knowledge in Comprehension , 2000, Psychological science.

[13]  Sotaro Kita,et al.  Attention to Speech-Accompanying Gestures: Eye Movements and Information Uptake , 2009, Journal of nonverbal behavior.

[14]  S. Levine,et al.  Atypical signed language development: A case study of challenges with visual–spatial processing , 2013, Cognitive neuropsychology.

[15]  Klaus Kessler,et al.  The embodied nature of spatial perspective taking: Embodied transformation versus sensorimotor interference , 2010, Cognition.

[16]  Daniel T. Gilbert,et al.  The Momentary Realist , 2000, Psychological science.

[17]  Colin M. Macleod.  Half a century of research on the Stroop effect: an integrative review. , 1991, Psychological bulletin.

[18]  M. González.  Politeness: some universals in language usage , 1995 .

[19]  Karen Emmorey,et al.  Mental rotation within linguistic and non-linguistic domains in users of American sign language , 1998, Cognition.

[20]  F. J. Langdon,et al.  The Child's Conception of Space , 1967 .

[21]  H. H. Clark,et al.  Audience Design in Meaning and Reference , 1982 .

[22]  M. Pickering,et al.  An integrated theory of language production and comprehension. , 2013, The Behavioral and brain sciences.

[23]  M. Wilson,et al.  Perceiving imitatible stimuli: consequences of isomorphism between input and output. , 2001, Psychological bulletin.

[24]  Gary S. Dell,et al.  Mechanisms for Listener-Adaptation in Language Production: Limiting the Role of the "Model of the Listener" , 2013 .

[25]  D. Barr,et al.  Limits on theory of mind use in adults , 2003, Cognition.

[26]  R. Proctor,et al.  The influence of irrelevant location information on performance: A review of the Simon and spatial Stroop effects , 1995, Psychonomic bulletin & review.

[27]  Brice Isableu,et al.  Embodied spatial transformations: "body analogy" for the mental rotation of objects. , 2006, Journal of experimental psychology. General.

[28]  H. H. Clark.  Arenas of language use , 1993 .

[29]  B. Keysar,et al.  When do speakers take into account common ground? , 1996, Cognition.

[30]  G. Miller,et al.  Language and Perception , 1976 .

[31]  Michael F. Schober,et al.  Speakers, addressees, and frames of reference: Whose effort is minimized in conversations about locations? , 1995 .

[32]  Barbara Tversky,et al.  Descriptions of Simple Spatial Scenes in English and Japanese , 2003, Spatial Cogn. Comput..

[33]  D. Barr,et al.  The Egocentric Basis of Language Use , 1998 .

[34]  N. Epley,et al.  Perspective taking as egocentric anchoring and adjustment. , 2004, Journal of personality and social psychology.

[35]  Pamela M. Perniss,et al.  Achieving spatial coherence in German Sign Language narratives: The use of classifiers and perspective , 2007 .

[36]  Ann Senghas,et al.  Language Promotes False-Belief Understanding , 2009, Psychological science.

[37]  Karen Emmorey,et al.  The signer as an embodied mirror neuron system: neural mechanisms underlying sign language and action , 2006 .

[38]  H. H. Clark.  SPACE, TIME, SEMANTICS, AND THE CHILD , 1973 .

[39]  F. J. Langdon,et al.  The Child's Conception of Space , 1967 .

[40]  Karen Emmorey,et al.  Spatial perspective choice in ASL , 2002 .

[41]  S. M. Carlson,et al.  Executive function and theory of mind: stability and prediction from ages 2 to 3. , 2004, Developmental psychology.

[42]  Marios N. Avraamides,et al.  The Conversational Partner's Perspective Affects Spatial Memory and Descriptions. , 2013 .

[43]  Penelope Brown,et al.  Politeness: Some Universals in Language Usage , 1989 .

[44]  M. F. Schober.  Spatial perspective-taking in conversation , 1993, Cognition.