Real world responses to interactive gesture based public displays

Today, one does not have to travel far to find examples of digital signage, yet the adoption of interactive gesture based public displays remains quite rare. Subsequently, not much is known about them despite a large array of potential advantages. This paper contributes to our understanding of how people perceive, respond to and interact with such displays outside the controlled environment of a research lab. Unlike other works which have focused on isolated aspects of in-lab interaction, we present a detailed examination that addresses a wide range of responses to such a display - including those who ignore them completely. To facilitate our study we created an experimental coarse gesture based software suite and then deployed the system along with associated applications as part of an existing large scale public display network. Using this as a base, we executed four studies designed to passively observe the reactions of passers-by and followed these up with a fifth controlled experiment that compared the effectiveness of two different kinds of gesture in the context of menu item selection. To conclude, we present our key-findings and highlight possible avenues of further study for the future of gesture based digital signage.

[1]  Albrecht Schmidt,et al.  Requirements and design space for interactive public displays , 2010, ACM Multimedia.

[2]  Yvonne Rogers,et al.  Collaborating around vertical and horizontal large interactive displays: which way is best? , 2004, Interact. Comput..

[3]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[4]  Yvonne Rogers,et al.  Collaborating around large interactive displays: which way is best to meet? , 2003 .

[5]  Jan O. Borchers,et al.  Overcoming Assumptions and Uncovering Practices: When Does the Public Really Look at Public Displays? , 2008, Pervasive.

[6]  Albrecht Schmidt,et al.  Display Blindness: The Effect of Expectations on Attention towards Digital Signage , 2009, Pervasive.

[7]  Yvonne Rogers,et al.  The iterative design and study of a large display for shared and sociable spaces , 2005, DUX '05.

[8]  Keith Cheverst,et al.  Social interaction around a rural community photo display , 2009, Int. J. Hum. Comput. Stud..

[9]  Mohamed S. Kamel,et al.  Image Analysis and Recognition , 2014, Lecture Notes in Computer Science.

[10]  Daniel M. Russell,et al.  Social Aspects of Using Large Public Interactive Displays for Collaboration , 2002, UbiComp.

[11]  HyungSeok Kim,et al.  Gesture-Based Interactions on Multiple Large Displays with a Tabletop Interface , 2007, HCI.

[12]  Yvonne Rogers,et al.  Enticing People to Interact with Large Public Displays in Public Spaces , 2003, INTERACT.

[13]  Lars Erik Holmquist,et al.  Between aesthetics and utility: designing ambient information visualizations , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[14]  Yong-Moo Kwon,et al.  Large Display Interaction Using Video Avatar and Hand Gesture Recognition , 2004, ICIAR.

[15]  Nemanja Memarovic,et al.  Talking to Strangers: Using Large Public Displays to Facilitate Social Interaction , 2011, HCI.

[16]  Fred Henrik Hamker,et al.  The emergence of attention by population-based inference and its role in distributed processing and cognitive control of vision , 2005, Comput. Vis. Image Underst..

[17]  Uwe Hansmann,et al.  Pervasive Computing , 2003 .

[18]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[19]  Jennifer G. Sheridan,et al.  Public Ubiquitous Computing Systems: Lessons from the e-Campus Display Deployments , 2006, IEEE Pervasive Computing.

[20]  Anthony Tang,et al.  Designing for bystanders: reflections on building a public digital forum , 2008, CHI.

[21]  Joseph F. McCarthy,et al.  UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous, Peripheral Displays , 2001, UbiComp.

[22]  Enrico Rukzio,et al.  Physical mobile interactions : mobile devices as pervasive mediators for interactions with the real world , 2006 .

[23]  Elizabeth D. Mynatt,et al.  Semi-public displays for small, co-located groups , 2003, CHI '03.