Gradual engagement: facilitating information exchange between digital devices as a function of proximity

The increasing number of digital devices in our environment enriches how we interact with digital content. Yet, cross-device information transfer -- which should be a common operation -- is surprisingly difficult. One has to know which devices can communicate, what information they contain, and how information can be exchanged. To mitigate this problem, we formulate the gradual engagement design pattern that generalizes prior work in proxemic interactions and informs future system designs. The pattern describes how we can design device interfaces to gradually engage the user by disclosing connectivity and information exchange capabilities as a function of inter-device proximity. These capabilities flow across three stages: (1) awareness of device presence/connectivity, (2) reveal of exchangeable content, and (3) interaction methods for transferring content between devices tuned to particular distances and device capabilities. We illustrate how we can apply this pattern to design, and show how existing and novel interaction techniques for cross-device transfers can be integrated to flow across its various stages. We explore how techniques differ between personal and semi-public devices, and how the pattern supports interaction of multiple users.

[1]  E. Hall,et al.  The Hidden Dimension , 1970 .

[2]  Saul Greenberg,et al.  Informing the Design of Proxemic Interactions , 2012, IEEE Pervasive Computing.

[3]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[4]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[5]  Dominik Schmidt PhoneTouch: a technique for direct phone interaction on surfaces , 2010, ITS '10.

[6]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[7]  Hans-Werner Gellersen,et al.  How users associate wireless devices , 2011, CHI.

[8]  Wang A Public Advertising Display that Captures and Preserves the Attention of a , 2012 .

[9]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[10]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[11]  Robert Hardy,et al.  Touch & interact: touch-based interaction of mobile phones with displays , 2008, Mobile HCI.

[12]  Bernt Schiele,et al.  Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts , 2001, UbiComp.

[13]  Michael Rohs,et al.  Group coordination and negotiation through spatial proximity regions around mobile devices on augmented tabletops , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[14]  A. Kendon Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[15]  Meredith Ringel Morris,et al.  Code space: touch + air gesture hybrid interactions for supporting developer meetings , 2011, ITS '11.

[16]  Pourang Irani,et al.  Chucking: A One-Handed Document Sharing Technique , 2009, INTERACT.

[17]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[18]  Jan O. Borchers,et al.  Dynamic portals: a lightweight metaphor for fast object transfer on interactive surfaces , 2011, ITS '11.

[19]  Carl Gutwin,et al.  A comparison of techniques for multi-display reaching , 2005, CHI.

[20]  Michael Rohs,et al.  User-defined gestures for connecting mobile phones, public displays, and tabletops , 2010, Mobile HCI.

[21]  Jan O. Borchers A pattern approach to interaction design , 2001, DIS '00.

[22]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[23]  Andy Hopper,et al.  Implementing a Sentient Computing System , 2001, Computer.

[24]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[25]  Brian P. Bailey,et al.  ARIS: An Interface for Application Relocation in an Interactive Space , 2004, Graphics Interface.

[26]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[27]  Jeffrey Nichols,et al.  Interacting at a Distance Using Semantic Snarfing , 2001, UbiComp.

[28]  Wendy Ju,et al.  Range: exploring implicit interaction through electronic whiteboard design , 2008, CSCW.

[29]  Mary Czerwinski,et al.  Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-Operated Systems , 2003, INTERACT.

[30]  Kori Inkpen Quinn,et al.  That one there! Pointing to establish device identity , 2002, UIST '02.

[31]  Gerd Kortuem,et al.  Sensing and visualizing spatial relations of mobile devices , 2005, UIST.

[32]  Jenifer Tidwell Designing Interfaces , 2005 .

[33]  Gerd Kortuem,et al.  Supporting device discovery and spontaneous interaction with spatial references , 2009, Personal and Ubiquitous Computing.

[34]  Bing Jiang,et al.  Some Methods for Privacy in RFID Communication , 2004, ESAS.

[35]  Jenifer Tidwell,et al.  Designing interfaces - patterns for effective interaction design , 2019 .

[36]  Norbert A. Streitz,et al.  Hello.Wall - Beyond Ambient Displays , 2003 .

[37]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[38]  Robert E. Kraut,et al.  Patterns of contact and communication in scientific research collaboration , 1990, CSCW '88.

[39]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[40]  Raimund Dachselt,et al.  Natural throw and tilt interaction between mobile phones and distant displays , 2009, CHI Extended Abstracts.

[41]  Jun Rekimoto,et al.  Proximal Interactions: A Direct Manipulation Technique for Wireless Networking , 2003, INTERACT.