Gesture-based interaction design: communication and cognition

This workshop explores and identifies the cognitive issues fundamental to the design of gestural interactive systems. To achieve this, a dialogue will be facilitated among researchers in the cognitive science of gesture and gestural interaction within the HCI community. During the workshop we will discuss the different methodologies and results within the study of gestural interaction, with a focus on how the use of bodily movement in an interface affects the cognition of users, groups, communities and societies. We invite participants from cognitive science, HCI, user experience design, educational technology and interactive installation art to present their work on gestural interfaces and discuss how that work has been observed to impact user perceptual or cognitive faculties. The workshop's material outcomes include a book on gestural interaction and cognition, while the research outcomes include methodologies, heuristics, design principles and hypotheses for the further design and investigation of gestural and tangible technologies.

[1]  Seth E. Hunter,et al.  Make a Riddle and TeleStory: designing children's applications for the siftables platform , 2010, IDC.

[2]  Barbara Tversky,et al.  Gestures Alter Thinking About Time , 2012, CogSci.

[3]  Barbara Tversky,et al.  Using Diagrams and Gestures to Think and Talk about Insight Problems , 2006 .

[4]  Yang Li,et al.  User-defined motion gestures for mobile interaction , 2011, CHI.

[5]  Susan Goldin-Meadow,et al.  Action’s Influence on Thought: The Case of Gesture , 2010, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  Mary Lou Maher,et al.  The Impact of Tangible User Interfaces on Designers' Spatial Cognition , 2008, Hum. Comput. Interact..

[7]  Judy Kay,et al.  Orchestrating a multi-tabletop classroom: from activity design to enactment and reflection , 2012, ITS '12.

[8]  John B. Black,et al.  From Hands to Minds: Gestures Promote Action Understanding , 2012, CogSci.

[9]  Alan Cienki,et al.  Inhibiting gesture reduces the amount of spatial metaphors in speech , 2011 .

[10]  S. Goldin-Meadow,et al.  Gesturing Gives Children New Ideas About Math , 2009, Psychological science.

[11]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[12]  Barbara Tversky,et al.  Gestures for Thinking , 2013, CogSci.

[13]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[14]  Timothy C Clausner.  How Conceptual Metaphors are Productive of Spatial-Graphical Expressions , 2002 .

[15]  Timothy C. Clausner,et al.  Perceptual Cues and Imagined Viewpoints Modulate Visual Search in Air Traffic Control Displays , 2009 .

[16]  Willemien Visser,et al.  The role of gesture in designing , 2011, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.