Encapsulating Concepts in Gestures and Drawings During Educational Design Team Meetings

ABSTRACT Design activities in which two or more people are participating are always multimodal and thus require a multimodal analytical framework. This article reports how a multimodal analytical framework is used in a microanalysis of a segment from an educational design team meeting in which 3 participants created and reused a metaphoric gesture in support of their discussion. The gesture was associated with a diagram through a combination of talk, gaze, and other nonverbal communicative modes. The repetition of the gesture as a single semiotic resource helped evoke a rich, shared team history, which made it easier to discuss complex concepts.

[1]  H. Garfinkel.  Studies in Ethnomethodology , 1968 .

[2]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[3]  Sara A. Bly,et al.  A use of drawing surfaces in different collaborative settings , 1988, CSCW '88.

[4]  John C. Tang,et al.  A framework for understanding the workspace activity of design teams , 1988, CSCW '88.

[5]  James L. Heap.  Applied ethnomethodology: Looking for the local rationality of reading activities , 1990 .

[6]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[7]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[8]  John Rheinfrank,et al.  Design languages , 1996 .

[9]  Kathryn Henderson,et al.  On Line and On Paper: Visual Representations, Visual Culture, and Computer Graphics in Design Engineering , 1998 .

[10]  Wolff‐Michael Roth,et al.  Inscriptions: Toward a Theory of Representing as Social Practice , 1998 .

[11]  David L. Barton.  Design Languages , 1999, The VLSI Handbook.

[12]  Wolff‐Michael Roth.  From gesture to scientific language , 2000 .

[13]  E. Salas,et al.  Reflections on shared cognition , 2001 .

[14]  Wolff‐Michael Roth.  Gestures: Their Role in Teaching and Learning , 2001 .

[15]  R. van der Lugt.  Sketching in design idea generation meetings , 2001 .

[16]  Wolff‐Michael Roth,et al.  From activity to gestures and scientific language , 2001 .

[17]  Alex Soojung-Kim Pang.  On Line and on Paper: Visual Representations, Visual Culture, and Computer Graphics in Design Engineering. Kathryn Henderson , 2001 .

[18]  Sigrid Norris,et al.  The implication of visual research for discourse analysis: transcription beyond language , 2002 .

[19]  T. Koschmann,et al.  Learner Articulation as Interactional Achievement: Studying the Conversation of Gesture , 2002 .

[20]  Daniel V. Lawless,et al.  Scientific investigations, metaphorical gestures, and the emergence of abstract scientific concepts , 2002 .

[21]  Anne Römer,et al.  Support value of sketching in the design process , 2003 .

[22]  S. Kita.  Pointing: Where language, culture, and cognition meet , 2003 .

[23]  Sigrid Norris,et al.  Analyzing Multimodal Interaction: A Methodological Framework , 2004 .

[24]  Peter Goodyear,et al.  Educational design and networked learning: Patterns, pattern languages and design practice , 2005 .

[25]  Wolff‐Michael Roth.  Mathematical Inscriptions and the Reflexive Elaboration of Understanding: An Ethnography of Graphing and Numeracy in a Fish Hatchery , 2005 .

[26]  D. McNeill.  Gesture and Thought , 2005 .

[27]  Paul Seedhouse,et al.  Applying conversation analysis , 2005 .

[28]  Remko van der Lugt,et al.  How sketching can affect the idea generation process in design group meetings , 2005 .

[29]  Willemien Visser,et al.  Designing as Construction of Representations: A Dynamic Viewpoint in Cognitive Design Research , 2006, Hum. Comput. Interact..

[30]  Michael Derntl,et al.  A Classification Framework for Educational Modeling Languages in Instructional Design , 2006 .

[31]  Michael Derntl,et al.  A Comparison of Visual Instructional Design Languages for Blended Learning , 2006 .

[32]  S. Todd Stubbs,et al.  Design Drawing in Instructional Design at Brigham Young University's Center for Instructional Design: A Case Study , 2006 .

[33]  Edwin Hutchins,et al.  The Distributed Cognition Perspective on Human Interaction , 2020 .

[34]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[35]  Edwin Hutchins,et al.  The Multimodal Production of Common Ground Understandings in Intercultural Flight Training , 2007 .

[36]  James D. Hollan,et al.  Representational Gestures as Cognitive Artifacts for Developing Theories in a Scientific Laboratory , 2008, Theory in CSCW.

[37]  L. Mondada,et al.  Interweaving Objects, Gestures, and Talk in Context , 2008 .

[38]  Sheryl Staub-French,et al.  Physical and Digital Artifact-Mediated Coordination in Building Design , 2008, Computer Supported Cooperative Work (CSCW).

[39]  Robert Ramberg,et al.  Where all the interaction is: sketching in interaction design as an embodied practice , 2008, DIS '08.

[40]  Kensy Cooperrider.  Roots of human sociality: culture, cognition and interaction , 2009 .

[41]  Willemien Visser,et al.  Function and Form of Gestures in a Collaborative Design Meeting , 2009, Gesture Workshop.

[42]  Willemien Visser,et al.  The Function of Gesture in an Architectural Design Meeting , 2009, ArXiv.

[43]  Lfe Medieninformatik,et al.  Knowledge Visualization , 2009 .

[44]  Barbara Tversky,et al.  Explanations in Gesture, Diagram, and Word , 2009, Spatial Language and Dialogue.

[45]  Michael Derntl,et al.  Cognitive effectiveness of visual instructional design languages , 2010, J. Vis. Lang. Comput..

[46]  Elise van den Hoven,et al.  Grasping gestures: Gesturing with physical artifacts , 2011, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[47]  Shirley Agostinho,et al.  The use of a visual learning design representation to support the design process of teaching in higher education , 2011 .

[48]  Thomas F. Stahovich,et al.  Using speech to identify gesture pen strokes in collaborative, multimodal device descriptions , 2011, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[49]  Jacob Buur,et al.  Getting the point: The role of gesture in managing intersubjectivity in a design activity , 2011, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[50]  Willemien Visser,et al.  The role of gesture in designing , 2011, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[51]  Gráinne Conole,et al.  Designing for Learning in an Open World , 2012 .

[52]  Rachael Luck,et al.  Kinds of seeing and spatial reasoning: Examining user participation at an architectural design event , 2012 .

[53]  Dave Randall,et al.  Recovering the emergent logic in a software design exercise , 2012 .

[54]  R. Luck.  ‘Doing designing’: On the practical analysis of design in practice , 2012 .

[55]  A. Oak.  ‘You can argue it two ways’: The collaborative management of a design dilemma , 2012 .

[56]  J. Hindmarch.  Video in Qualitative Research: Analysing Social Interaction in Everyday Life , 2012, QMiP Bulletin.

[57]  Jonas Ivarsson,et al.  Embodied reasoning in architectural critique , 2012 .

[58]  David B. Martin,et al.  The cooperative use of material resources and contextual features in graphic design work , 2012 .

[59]  Jaime Snyder,et al.  Image-Enabled Discourse: Investigating the Creation of Visual Information as Communicative Practice , 2012 .

[60]  Kate Thompson,et al.  Identification of Patterns of Tool Use and Sketching Practices in a Learning By Design Task , 2013, CSCL.

[61]  Sandra Wills,et al.  Representing learning designs – making design explicit and shareable , 2013 .

[62]  John M. Carroll,et al.  Cognitive artifacts as a window on design , 2013, J. Vis. Lang. Comput..

[63]  James Dalziel,et al.  Learning Design: Conceptualizing a Framework for Teaching and Learning Online , 2014 .

[64]  Petra Badke-Schaub,et al.  A comparative analysis of multimodal communication during design sketching in co-located and distributed environments , 2014 .

[65]  Dewa Wardak.  Traces on the Walls and Traces in the Air: Inscriptions and Gestures in Educational Design Team Meetings , 2015 .

[66]  Alfredo Jornet,et al.  The Matter of Space: Bodily Performances and the Emergence of Boundary Objects During Multidisciplinary Design Meetings , 2015 .