Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies

Remote controls facilitate interactions at-a-distance with appliances. However, the complexity, diversity, and increasing number of digital appliances in ubiquitous computing ecologies make it increasingly difficult to: (1) discover which appliances are controllable; (2) select a particular appliance from the large number available; (3) view information about its status; and (4) control the appliance in a pertinent manner. To mitigate these problems we contribute proxemic-aware controls, which exploit the spatial relationships between a person's handheld device and all surrounding appliances to create a dynamic appliance control interface. Specifically, a person can discover and select an appliance by the way one orients a mobile device around the room, and then progressively view the appliance's status and control its features in increasing detail by simply moving towards it. We illustrate proxemic-aware controls of assorted appliances through various scenarios. We then provide a generalized conceptual framework that informs future designs of proxemic-aware controls.

[1]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[2]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[3]  E. Hall,et al.  The Hidden Dimension , 1970 .

[4]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[5]  Jeffrey Nichols,et al.  Huddle: automatically generating interfaces for systems of multiple connected appliances , 2006, UIST.

[6]  William Lidwell,et al.  Universal Principles of Design , 2003 .

[7]  Kori Inkpen Quinn,et al.  That one there! Pointing to establish device identity , 2002, UIST '02.

[8]  James D. Hollan,et al.  Pad++: a zooming graphical interface for exploring alternate interface physics , 1994, UIST '94.

[9]  Brad A. Myers Mobile Devices for Control , 2002, Mobile HCI.

[10]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[11]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[12]  Andreas Butz,et al.  Touch projector: mobile interaction through video , 2010, CHI.

[13]  Jun Rekimoto,et al.  InfoPoint: A Device that Provides a Uniform User Interface to Allow Appliances to Work Together over a Network , 2001, Personal and Ubiquitous Computing.

[14]  Gerd Kortuem,et al.  Supporting device discovery and spontaneous interaction with spatial references , 2009, Personal and Ubiquitous Computing.

[15]  Sebastian Boring,et al.  Gradual engagement: facilitating information exchange between digital devices as a function of proximity , 2012, ITS.

[16]  Jeffrey Nichols,et al.  Interacting at a Distance Using Semantic Snarfing , 2001, UbiComp.

[17]  Kimiya Yamaashi,et al.  Object-oriented video: interaction with real-world objects through live video , 1992, CHI.

[18]  Erik Stolterman,et al.  What makes a prototype novel?: a knowledge contribution concern for interaction design research , 2014, NordiCHI.

[19]  A C Bonacci,et al.  Living with complexity. , 1986, American journal of hospital pharmacy.

[20]  Albrecht Schmidt,et al.  An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning , 2006, UbiComp.

[21]  Xiang Cao,et al.  PICOntrol: using a handheld projector for direct control of physical devices through visible light , 2012, UIST.

[22]  Daisuke Sakamoto,et al.  CRISTAL: a collaborative home media and device controller based on a multi-touch display , 2009, ITS '09.

[23]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[24]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[25]  Riku Suomela,et al.  Accessing Context in Wearable Computers , 2002, Personal and Ubiquitous Computing.

[26]  Edward A. Lee,et al.  A Context Menu for the Real World: Controlling Physical Appliances Through Head-Worn Infrared Targeting , 2013 .

[27]  Pasi Välkkynen,et al.  Physical Browsing Research , 2005, PERMID.

[28]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[29]  Michael Beigl Point & Click - Interaction in Smart Environments , 1999, HUC.

[30]  Dieter Schmalstieg,et al.  Zooming interfaces for augmented reality browsers , 2010, Mobile HCI.

[31]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[32]  Sebastian Boring,et al.  Gradual Engagement between Digital Devices as a Function of Proximity: From Awareness to Progressive Reveal to Information Transfer , 2012 .