Is Anyone Looking? Mitigating Shoulder Surfing on Public Displays through Awareness and Protection

Displays are growing in size, and are increasingly deployed in semi-public and public areas. When people use these public displays to pursue personal work, they expose their activities and sensitive data to passers-by. In most cases, such shoulder-surfing by others is likely voyeuristic vs. a deliberate attempt to steal information. Even so, safeguards are needed. Our goal is to mitigate shoulder-surfing problems in such settings. Our method leverages notions of territoriality and proxemics, where we sense and take action based on the spatial relationships between the passerby, the user of the display, and the display itself. First, we provide participants with awareness of shoulder-surfing moments, which in turn helps both parties regulate their behaviours and mediate further social interactions. Second, we provide methods that protect information when shoulder-surfing is detected. Here, users can move or hide information through easy to perform explicit actions. Alternately, the system itself can mask information from the passerby's view when it detects shoulder-surfing moments.

[1]  J. Freedman,et al.  Conceptions of Crowding. (Book Reviews: Crowding and Behavior; The Environment and Social Behavior. Privacy, Personal Space. Territory, Crowding) , 1975 .

[2]  Yvonne Rogers,et al.  Enticing People to Interact with Large Public Displays in Public Spaces , 2003, INTERACT.

[3]  Leysia Palen,et al.  Social, individual and technological issues for groupware calendar systems , 1999, CHI '99.

[4]  Tal Garfinkel,et al.  Reducing shoulder-surfing by using gaze-based password entry , 2007, SOUPS '07.

[5]  Antonella De Angeli,et al.  Usability and biometric verification at the ATM interface , 2003, CHI '03.

[6]  Sebastian Boring,et al.  Proxemic peddler: a public advertising display that captures and preserves the attention of a passerby , 2012, PerDis.

[7]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[8]  Desney S. Tan,et al.  Information voyeurism: social impact of physically large displays on information privacy , 2003, CHI Extended Abstracts.

[9]  Antti Oulasvirta,et al.  It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre , 2008, CHI.

[10]  Emmanuel Pietriga,et al.  High-precision pointing on large wall displays using small handheld devices , 2013, CHI.

[11]  Alireza Sahami Shirazi,et al.  Interaction techniques for creating and exchanging content with public displays , 2013, CHI.

[12]  P. Agre,et al.  Technology and privacy: The new landscape , 1998 .

[13]  E. Hall,et al.  The Hidden Dimension , 1970 .

[14]  Michael Boyle,et al.  PDAs and shared public displays: Making personal information public, and public information personal , 1999, Personal Technologies.

[15]  Chris Harrison,et al.  A new angle on cheap LCDs: making positive use of optical distortion , 2011, UIST '11.

[16]  J. Barefoot,et al.  Avoidance of an act which would violate personal space , 1972 .

[17]  Sebastian Boring,et al.  Gradual Engagement between Digital Devices as a Function of Proximity: From Awareness to Progressive Reveal to Information Transfer , 2012 .

[18]  Edward G. Freedman,et al.  Coordination of the eyes and head: movement kinematics , 2000, Experimental Brain Research.

[19]  Yvonne Rogers,et al.  Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface , 2011, CHI.

[20]  Michael Boyle,et al.  The language of privacy: Learning from video media space analysis and design , 2005, TCHI.

[21]  M. Young,et al.  Discrimination of Changes of Latency during Voluntary Hand Movement of Virtual Objects , 1999 .

[22]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[23]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[24]  Julian J. Edney.  Property, Possession and Permanence: A Field Study in Human Territoriality1 , 1972 .

[25]  F D Becker,et al.  Study of spatial markers. , 1973, Journal of personality and social psychology.

[26]  Heinrich Hußmann,et al.  Vibrapass: secure authentication based on shared lies , 2009, CHI.

[27]  Garth Shoemaker.  Supporting private information on public displays , 2000, CHI Extended Abstracts.

[28]  F. Becker,et al.  Territorial defense and the good neighbor. , 1969, Journal of personality and social psychology.

[29]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[30]  J. Stahl,et al.  Amplitude of human head movements associated with horizontal saccades , 1999, Experimental Brain Research.

[31]  Victoria Bellotti,et al.  Design for privacy in multimedia computing and communications environments , 1997 .

[32]  M. Sheelagh T. Carpendale,et al.  How people use orientation on tables: comprehension, coordination and communication , 2003, GROUP '03.

[33]  Andriy Pavlovych,et al.  The tradeoff between spatial jitter and latency in pointing tasks , 2009, EICS '09.

[34]  Jörg Müller,et al.  The Audience Funnel: Observations of Gesture Based Interaction With Multiple Large Displays in a City Center , 2011, Int. J. Hum. Comput. Interact..

[35]  Susanne Hertz,et al.  Personal Space The Behavioral Basis Of Design , 2016 .

[36]  Bruce A. Reinig,et al.  Managing user perceptions of email privacy , 1995, CACM.

[37]  Heinrich Hußmann,et al.  Touch me once and i know it's you!: implicit authentication based on touch screen patterns , 2012, CHI.

[38]  Kori Inkpen Quinn,et al.  Single display privacyware: augmenting public displays with private information , 2001, CHI.

[39]  Jörg Müller,et al.  Chained displays: configurations of public displays can be used to influence actor-, audience-, and passer-by behavior , 2012, CHI.

[40]  John C. Tang.  Findings from Observational Studies of Collaborative Work , 1991, Int. J. Man Mach. Stud..

[41]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[42]  W. Whyte,et al.  Studies in Personal space , 1959 .

[43]  Alexander De Luca,et al.  A privacy-respectful input method for public terminals , 2008, NordiCHI.

[44]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[45]  Florian Alt,et al.  Looking glass: a field study on noticing interactivity of a shop window , 2012, CHI.

[46]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[47]  Stacey D. Scott,et al.  Investigating Tabletop Territoriality in Digital Tabletop Workspaces , 2006 .

[48]  Desney S. Tan,et al.  Spy-resistant keyboard: more secure password entry on public touch screen displays , 2005, OZCHI.

[49]  Saul Greenberg,et al.  Informing the Design of Proxemic Interactions , 2012, IEEE Pervasive Computing.

[50]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[51]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[52]  Rainer Stiefelhagen,et al.  Pointing gesture recognition based on 3D-tracking of face, hands and head orientation , 2003, ICMI '03.

[53]  Saul Greenberg,et al.  Is anyone looking?: mediating shoulder surfing on public displays (the video) , 2014, CHI Extended Abstracts.

[54]  Roy Want,et al.  Enhancing web browsing security on public terminals using mobile composition , 2008, MobiSys '08.

[55]  Richard Sharp,et al.  Secure Mobile Computing Via Public Terminals , 2006, Pervasive.

[56]  Andrea Bianchi.  Authentication on public terminals with private devices , 2011, Tangible and Embedded Interaction.