Using mobile phones to interact with tabletop computers

Tabletop computers can be used by several people at the same time, and many are likely to be carrying mobile phones. We examine different ways of performing interactions in this multi-device ecology. We conducted a study into the use of a phone as a controller for a dial manipulation task, comparing three different forms of interaction: direct touch, using the phone as a general-purpose tangible controller on a tabletop computer and manipulating the dial directly on the phone's screen. We also examined user performance for these interactions both with and without tactile feedback from the phone. We found interacting on the phone itself fastest overall, with tactile feedback improving performance. We also show a range of concerns that users have about using their phone as a controller. The results suggest that using a phone and table together can sometimes be better than using the table alone.

[1]  Andreas Butz,et al.  Interactions in the air: adding further depth to interactive tabletops , 2009, UIST '09.

[2]  Andrés Lucero,et al.  Pass-them-around: collaborative use of mobile phones for photo sharing , 2011, CHI.

[3]  Stephen A. Brewster,et al.  Usable gestures for mobile interfaces: evaluating social acceptability , 2010, CHI.

[4]  M. Sheelagh T. Carpendale,et al.  The Haptic Tabletop Puck: tactile feedback for interactive tabletops , 2009, ITS '09.

[5]  Andreas Butz,et al.  Physical handles at the interactive surface: exploring tangibility and its benefits , 2008, AVI '08.

[6]  Alireza Sahami Shirazi,et al.  Poker surface: combining a multi-touch table and mobile phones in interactive card games , 2009, Mobile HCI.

[7]  Dominik Schmidt PhoneTouch: a technique for direct phone interaction on surfaces , 2010, ITS '10.

[8]  Andreas Butz,et al.  Touch projector: mobile interaction through video , 2010, CHI.

[9]  June M. Hinckley Feedback I , 2004 .

[10]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[11]  Patrick Jermann,et al.  An empirical evaluation of touch and tangible interfaces for tabletop displays , 2010, TEI '10.

[12]  Stephen A. Brewster,et al.  Feedback is... late: measuring multimodal delays in mobile device touchscreen interaction , 2010, ICMI-MLMI '10.

[13]  Sebastian Boring,et al.  HandSense: discriminating different ways of grasping and holding a tangible user interface , 2009, Tangible and Embedded Interaction.

[14]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[15]  Philip Tuddenham,et al.  Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks , 2010, CHI.

[16]  Michael Rohs,et al.  User-defined gestures for connecting mobile phones, public displays, and tabletops , 2010, Mobile HCI.

[17]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[18]  Patrick Baudisch,et al.  Lumino: tangible blocks for tabletop computers based on glass fiber bundles , 2010, CHI.

[19]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[20]  Stephen Brewster,et al.  Distal tactile feedback for text entry on tabletop computers , 2009 .

[21]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[22]  Sy-Yen Kuo,et al.  iCon: utilizing everyday objects as additional, auxiliary and instant tabletop controllers , 2010, CHI.

[23]  Dan Morris,et al.  Dynamic mapping of physical controls for tabletop groupware , 2009, CHI.

[24]  F. Ichikawa,et al.  Where's The Phone? A Study of Mobile Phone Location in Public Spaces , 2005, 2005 2nd Asia Pacific Conference on Mobile Technology, Applications and Systems.

[25]  Robert Hardy,et al.  Touch & Interact: touch-based interaction with a tourist application , 2008, Mobile HCI.

[26]  Stuart E. Schechter,et al.  Can i borrow your phone?: understanding concerns when sharing mobile phones , 2009, CHI.

[27]  Raimund Dachselt,et al.  Natural throw and tilt interaction between mobile phones and distant displays , 2009, CHI Extended Abstracts.

[28]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[29]  Gary Marsden,et al.  Creating and sharing multi-media packages using large situated public displays and mobile phones , 2007, Mobile HCI.