“You move THIS!”: Annotation of Pointing Gestures on Tabletop Interfaces in Low Awareness Situations

This paper analyses pointing gestures during low awareness situations occurring in a collaborative problem-solving activity implemented on an interactive tabletop interface. Awareness is considered as crucial requirement to support fluid and natural collaboration. We focus on pointing gestures as strategy to maintain awareness. We describe the results from a user study with five groups, each group consisting of three participants, who were asked to solve a task collaboratively on a tabletop interface. The ideal problem-solving solution would have been, if the three participants had been fully aware of what their personal area is depicting and had communicated this properly to the peers. However, often some participants are hesitant due to lack of awareness, some other want to take the lead work or expedite the process, and therefore pointing gestures to others’ personal areas arise. Our results from analyzing a multimodal corpus of 168.68 minutes showed that in 95% of the cases, one user pointed to the personal area of the other, while in a few cases (3%) a user not only pointed, but also performed a touch gesture on the personal area of another user. In our study, the mean for such pointing gestures in low awareness situations per minute and for all groups was M=1.96, SD=0.58.

[1]  Allison Druin,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[2]  Andreas Paepcke,et al.  Cooperative gestures: multi-user gestural interactions for co-located groupware , 2006, CHI.

[3]  Barbara Tversky,et al.  RETRACTED: Communicative gestures facilitate problem solving for both communicators and recipients , 2006 .

[4]  Toni Kempler Rogat,et al.  Socially Shared Regulation in Collaborative Groups: An Analysis of the Interplay Between Quality of Social Regulation and Group Processes , 2011 .

[5]  Julia Woodward,et al.  Investigating Separation of Territories and Activity Roles in Children's Collaboration around Tabletops , 2018, Proc. ACM Hum. Comput. Interact..

[6]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[7]  Patrick Griffin,et al.  The Changing Role of Education and Schools , 2012 .

[8]  Sara Price,et al.  What have you done! the role of 'interference' in tangible environments for supporting collaborative learning , 2009, CSCL.

[9]  Alessio Malizia,et al.  Light on horizontal interactive surfaces: Input space for tabletop computing , 2014, CSUR.

[10]  Martin Schmitz,et al.  Permulin: mixed-focus collaboration on multi-view tabletops , 2014, CHI.

[11]  Laurie D. Edwards,et al.  The Design and Analysis of a Mathematical Microworld , 1995 .

[12]  Peter Wittenburg,et al.  ELAN: a Professional Framework for Multimodality Research , 2006, LREC.

[13]  Regan L. Mandryk,et al.  System Guidelines for Co-located, Collaborative Work on a Tabletop Display , 2003, ECSCW.

[14]  Francis K. H. Quek.  Eyes in the interface , 1995, Image Vis. Comput..

[15]  Dimitra Anastasiou,et al.  A Gesture-Speech Corpus on a Tangible Interface , 2016 .

[16]  Paul Marshall,et al.  Beyond one-size-fits-all: how interactive tabletops support collaborative learning , 2011, IDC.

[17]  Valérie Maquil,et al.  Designing collaborative scenarios on tangible tabletop interfaces - insights from the implementation of paper prototypes in the context of a multidisciplinary design workshop , 2019, ECSCW Exploratory Papers, Demos and Posters.

[18]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[19]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[20]  Yvonne Rogers,et al.  Collaboration and interference: awareness with mice or touch input , 2008, CSCW.

[21]  Sara Price,et al.  Action and representation in tangible systems: implications for design of learning interactions , 2010, TEI '10.

[22]  Thibaud Latour,et al.  Empirical studies on a tangible user interface for technology-based assessment: Insights and emerging challenges , 2012 .