Gradual Engagement between Digital Devices as a Function of Proximity: From Awareness to Progressive Reveal to Information Transfer

Connecting and information transfer between the increasing number of personal and shared digital devices in our environment – phones, tablets, and large surfaces – is tedious. One has to know which devices can communicate, what information they contain, and how information can be exchanged. Inspired by Proxemic Interactions, we introduce novel interaction techniques that allow people to naturally connect to and perform cross-device operations. Our techniques are based on the notion of gradual engagement between a person’s handheld device and the other devices surrounding them as a function of finegrained measures of proximity. They all provide awareness of device presence and connectivity, progressive reveal of available digital content, and interaction methods for transferring digital content between devices from a distance and from close proximity. They also illustrate how gradual engagement may differ when the other device seen is personal (such as a handheld) vs. semi-public (such as a large display). We illustrate our techniques within two applications that enable gradual engagement leading up to information exchange between digital devices. ACM Classification: H5.2 [Information interfaces and presentation]: User Interfaces – Input devices and strategies General terms: Design, Human Factors

[1]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[2]  Bernt Schiele,et al.  Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts , 2001, UbiComp.

[3]  Michael Rohs,et al.  User-defined gestures for connecting mobile phones, public displays, and tabletops , 2010, Mobile HCI.

[4]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[5]  Gerd Kortuem,et al.  Supporting device discovery and spontaneous interaction with spatial references , 2009, Personal and Ubiquitous Computing.

[6]  Bing Jiang,et al.  Some Methods for Privacy in RFID Communication , 2004, ESAS.

[7]  Brian P. Bailey,et al.  ARIS: An Interface for Application Relocation in an Interactive Space , 2004, Graphics Interface.

[8]  Jun Rekimoto,et al.  Proximal Interactions: A Direct Manipulation Technique for Wireless Networking , 2003, INTERACT.

[9]  Kori Inkpen Quinn,et al.  That one there! Pointing to establish device identity , 2002, UIST '02.

[10]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[11]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[12]  Michael Rohs,et al.  Group coordination and negotiation through spatial proximity regions around mobile devices on augmented tabletops , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[13]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[14]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[15]  Robert Hardy,et al.  Touch & interact: touch-based interaction of mobile phones with displays , 2008, Mobile HCI.

[16]  Wendy Ju,et al.  Range: exploring implicit interaction through electronic whiteboard design , 2008, CSCW.

[17]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[18]  Mary Czerwinski,et al.  Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-Operated Systems , 2003, INTERACT.

[19]  Hans-Werner Gellersen,et al.  How users associate wireless devices , 2011, CHI.

[20]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[21]  Saul Greenberg,et al.  Informing the Design of Proxemic Interactions , 2012, IEEE Pervasive Computing.

[22]  Gerd Kortuem,et al.  Sensing and visualizing spatial relations of mobile devices , 2005, UIST.

[23]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[24]  E. Hall,et al.  The Hidden Dimension , 1970 .

[25]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.