When up is down and down is up: Body orientation, proximity, and gestures as resources

This article is concerned with understanding situations in which speakers talk in the presence of scientific inscriptions (lectures in science classes, public presentations). Drawing on extensive video materials accumulated in middle and high school science classrooms and university lectures, we develop a framework for the resources speakers make available to their audience for understanding what the talk is about. We distinguish three situations according to the nature of reference to the phenomenon talked about: (i) talk is about phenomenon but mediated by reference to a two-dimensional (2-D) inscription; (ii) talk is about phenomenon but mediated by reference to a three-dimensional (3-D) inscription; and (iii) talk is directly about phenomenon. Associated with these three situations are different body orientations, distances from inscriptions, and types of gestures. When speakers laminate talk characteristic of two different types of situations, the orientation “up” can become “down” and “down” can become “up,” potentially leading to confusing statements.

[1]  O. Braddick,et al.  Seeing in Depth , 2008 .

[2]  D. McNeill So you think gestures are nonverbal , 1985 .

[3]  C. Goodwin Gestures as a resource for the organization of mutual orientation , 1986 .

[4]  C. Heath,et al.  Body movement and speech in medical interaction: Postscript: the use of medical records and computers during the consultation , 1986 .

[5]  Adam Kendon,et al.  How gestures can become like words , 1988 .

[6]  K. K. Cetina,et al.  The fixation of (visual) evidence , 1988 .

[7]  Wiebe E. Bijker,et al.  Science in action : how to follow scientists and engineers through society , 1989 .

[8]  Every picture tells a story , 1988 .

[9]  Greg Myers,et al.  Commentary: Every picture tells a story , 2021, JTCVS techniques.

[10]  A. J. Wootton,et al.  Erving Goffman: Exploring the interaction order. , 1992 .

[11]  E. Glasersfeld Cognition, Construction of Knowledge, and Teaching , 1989 .

[12]  R. Rorty Contingency, irony, and solidarity: Contents , 1989 .

[13]  B. Butterworth,et al.  Gesture, speech, and computational stages: a reply to McNeill. , 1989, Psychological review.

[14]  S. Woolgar,et al.  Representation in Scientific Practice , 1990 .

[15]  A. Kendon Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[16]  Kathryn Henderson,et al.  Flexible Sketches and Inflexible Data Bases: Visual Communication, Conscription Devices, and Boundary Objects in Design Engineering , 1991 .

[17]  Graham Button,et al.  Published in: Technology in Working Order: Studies of Work, Interaction, and Technology, , 2022 .

[18]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[19]  John B. Haviland,et al.  Anchoring, Iconicity, and Orientation in Guugu Yimithirr Pointing Gestures , 1993 .

[20]  Susan Fiksdal,et al.  Conducting Interaction: Patterns of Behavior in Focused Encounters. Adam Kendon. Cambridge: Cambridge University Press, 1990. Pp. vii + 292. $54.50 cloth, $16.95 paper. , 1993, Studies in Second Language Acquisition.

[21]  Christian Heath,et al.  Disembodied Conduct: Interactional Asymmetries in Video-Mediated Communication , 1993 .

[22]  Janet Beavin Bavelas,et al.  Gestures as Part of Speech: Methodological Implications , 1994 .

[23]  Wolff-Michael Roth,et al.  Thinking with Hands, Eyes, and Signs: MultiModal Science Talk in a Grade 6/7 Unit on Simple Machines , 1994, Interact. Learn. Environ..

[24]  Elinor Ochs,et al.  Interpretive Journeys: How Physicists Talk and Travel through Graphic Space , 1994 .

[25]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[26]  J. Bavelas,et al.  Gestures Specialized for Dialogue , 1995 .

[27]  Wolfgang Klein,et al.  Frame of analysis , 1995 .

[28]  Charles Goodwin,et al.  Seeing in Depth , 1995 .

[29]  Wolff-Michael Roth,et al.  Differential Participation During Science Conversations: The Interaction of Display Artifacts, Social Configurations, and Physical Arrangements , 1996, ICLS.

[30]  M. Egbert Context-sensitivity in conversation: Eye gaze and the German repair initiator bitte? , 1996, Language in Society.

[31]  Elinor Ochs,et al.  Interaction and grammar: “When I come down I'm in the domain state”: grammar and graphic representation in the interpretive activity of physicists , 1996 .

[32]  D. Slobin,et al.  Social interaction, Social Context, and Language : Essays in Honor of Susan Ervin-tripp , 1996 .

[33]  G Rizzolatti,et al.  The Space Around Us , 1997, Science.

[34]  Stephen C. Levinson,et al.  Language and Cognition: The Cognitive Consequences of Spatial Description in Guugu Yimithirr , 1997 .

[35]  T. Widlok Orientation in the wild : The shared cognition of Hai||om Bushpeople , 1997 .

[36]  Kenneth Tobin,et al.  Cascades of inscriptions and the re-presentation of nature: how numbers, tables, graphs, and money come to re-present a rolling ball , 1997 .

[37]  Kuniyoshi Kataoka Gravity or Levity: Vertical Space in Japanese Rock Climbing Instructions , 1998 .

[38]  Wolff-Michael Roth,et al.  How Prepared Are Preservice Teachers to Teach Scientific Inquiry? Levels of Performance in Scientific Representation Practices , 1998 .

[39]  G. Beattie,et al.  Do iconic gestures have a functional role in lexical access? An experimental study of the effects of repeating a verbal message on gesture production , 1998 .

[40]  Wolff-Michael Roth,et al.  Decalages in Talk and Gesture: Visual and Verbal Semiotics of Ecology Lectures , 1998 .

[41]  M. Minami,et al.  Social interaction, social context, and language: Essays in honor of Susan Ervin-Tripp . Dan Isaac Slobin, Julie Gerhardt, Amy Kyratzis, and Jiansheng Guo (Eds.). Mahwah, NJ: Erlbaum, 1996. , 1998, Applied Psycholinguistics.

[42]  Wolff-Michael Roth,et al.  Differences in graph-related practices between high school biology textbooks and scientific ecology journals , 1999 .

[43]  B. Latour Pandora's Hope: Essays on the Reality of Science Studies , 1999 .

[44]  Gunter Senft,et al.  Referring to space: Studies in Austronesian and Papuan languages , 1999 .

[45]  Wolff-Michael Roth,et al.  Becoming-in-the-classroom: a case study of teacher development through coteaching , 1999 .

[46]  J. Haviland Language and Gesture: Pointing, gesture spaces, and mental maps , 2000 .

[47]  Felix Stalder,et al.  Pandora's Hope: Essays on the Reality of Science Studies , 2000, Inf. Soc..

[48]  Wolff‐Michael Roth From gesture to scientific language , 2000 .

[49]  Wolff-Michael Roth,et al.  Professionals Read Graphs: A Semiotic Analysis , 2001 .

[50]  Wolff‐Michael Roth,et al.  From activity to gestures and scientific language , 2001 .

[51]  E. Glasersfeld Cognition, construction of knowledge, and teaching , 1989, Synthese.