Gesture Elicitation Study on How to Opt-in & Opt-out from Interactions with Public Displays

Public interactive displays with gesture-recognizing cameras enable new forms of interactions. However, often such systems do not yet allow passers-by a choice to engage voluntarily or disengage from an interaction. To address this issue, this paper explores how people could use different kinds of gestures or voice commands to explicitly opt-in or opt-out of interactions with public installations. We report the results of a gesture elicitation study with 16 participants, generating gestures within five gesture-types for both a commercial and entertainment scenario. We present a categorization and themes of the 430 proposed gestures, and agreement scores showing higher consensus for torso gestures and for opting-out with face/head. Furthermore, patterns indicate that participants often chose non-verbal representations of opposing pairs such as 'close and open' when proposing gestures. Quantitative results showed overall preference for hand and arm gestures, and generally a higher acceptance for gestural interaction in the entertainment setting.

[1]  Jörg Müller,et al.  StrikeAPose: revealing mid-air gestures on public displays , 2013, CHI.

[2]  Florian Alt,et al.  Looking glass: a field study on noticing interactivity of a shop window , 2012, CHI.

[3]  Bongshin Lee,et al.  Reducing legacy bias in gesture elicitation studies , 2014, INTR.

[4]  Markku Turunen,et al.  Information wall: evaluation of a gesture-controlled public display , 2014, MUM.

[5]  Jan O. Borchers,et al.  Overcoming Assumptions and Uncovering Practices: When Does the Public Really Look at Public Displays? , 2008, Pervasive.

[6]  Paul Marshall,et al.  Exploring the effects of space and place on engagement with an interactive installation , 2013, CHI.

[7]  Fabio Pittarello,et al.  Prototyping a gestural interface for selecting and buying goods in a public environment , 2012, AVI.

[8]  Kris Luyten,et al.  Proxemic Flow: Dynamic Peripheral Floor Visualizations for Revealing and Mediating Large Surface Interactions , 2015, INTERACT.

[9]  Jonathan Randall Howarth,et al.  Cultural similarities and differences in user-defined gestures for touchscreen user interfaces , 2010, CHI EA '10.

[10]  Austin Henderson,et al.  Making sense of sensing systems: five questions for designers and researchers , 2002, CHI.

[11]  Yvonne Rogers,et al.  Enticing People to Interact with Large Public Displays in Public Spaces , 2003, INTERACT.

[12]  Sebastian Boring,et al.  Dark patterns in proxemic interactions: a critical perspective , 2014, Conference on Designing Interactive Systems.

[13]  Martin Ludvigsen,et al.  "Help Me Pull That Cursor" A Collaborative Interactive Floor Enhancing Community Interaction , 2004, Australas. J. Inf. Syst..

[14]  Albrecht Schmidt,et al.  Display Blindness: The Effect of Expectations on Attention towards Digital Signage , 2009, Pervasive.

[15]  Wendy Ju,et al.  Range: exploring implicit interaction through electronic whiteboard design , 2008, CSCW.

[16]  Kenton O'Hara,et al.  Understanding collective play in an urban screen game , 2008, CSCW.

[17]  M. Argyle,et al.  A Cross-Cultural Study of the Communication of Extra-Verbal Meaning by Gesture , 1975 .

[18]  Sriram Subramanian,et al.  Putting your best foot forward: investigating real-world mappings for foot-based gestures , 2012, CHI.

[19]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[20]  Anne Marie Piper,et al.  A Wizard-of-Oz elicitation study examining child-defined gestures with a whole-body interface , 2013, IDC.

[21]  Dane Archer,et al.  Unspoken Diversity: Cultural Differences in Gestures , 1997 .

[22]  Brad A. Myers,et al.  Maximizing the guessability of symbolic input , 2005, CHI Extended Abstracts.

[23]  Teddy Seyed,et al.  User Elicitation on Single-hand Microgestures , 2016, CHI.

[24]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[25]  Radu-Daniel Vatavu,et al.  Leap gestures for TV: insights from an elicitation study , 2014, TVX.

[26]  Kenton O'Hara,et al.  WaveWindow: public, performative gestural interaction , 2010, ITS '10.

[27]  Meredith Ringel Morris,et al.  Web on the wall: insights from a multimodal interaction elicitation study , 2012, ITS.

[28]  Radu-Daniel Vatavu,et al.  Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit , 2015, CHI.

[29]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[30]  Teddy Seyed,et al.  Eliciting usable gestures for multi-display environments , 2012, ITS.

[31]  Tiffany Holmes,et al.  Eco-visualization: combining art and technology to reduce energy consumption , 2007, C&C '07.

[32]  Eva Hornecker,et al.  Urban HCI: spatial aspects in the design of shared encounters for media facades , 2012, CHI.

[33]  Paul Dourish,et al.  Re-place-ing space: the roles of place and space in collaborative systems , 1996, CSCW '96.

[34]  Hans-Werner Gellersen,et al.  How users associate wireless devices , 2011, CHI.

[35]  Paul Marshall,et al.  Display Blindness?: Looking Again at the Visibility of Situated Displays using Eye-tracking , 2015, CHI.

[36]  Sebastian Boring,et al.  Proxemic peddler: a public advertising display that captures and preserves the attention of a passerby , 2012, PerDis.

[37]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[38]  Sebastian Boring,et al.  The Dark Patterns of Proxemic Sensing , 2014, Computer.

[39]  Keyur Sorathia,et al.  A Study for Investigating Suitable Gesture Based Selection for Gestural User Interfaces , 2015, IndiaHCI.