Using handheld devices for mobile interaction with displays in home environments

An increasing number of households are equipped with a large number of TV sets and more and more of them are large highresolution displays. Furthermore, we see the integration of web browsing and email functionalities in these devices, which are then often controlled via a wireless mouse and keyboard. The latter were rather designed for the usage on a desk, rather then by a person sitting on their sofa in a living room. Therefore, this paper investigates the usage of a PDA, as a replacement which can be used for controlling a remote cursor and for text input. The results of the experimental comparison of these input devices show, as expected, the superiority of mouse and keyboard (as the study participants were very experienced with them). Surprising results were the task completion time and usability satisfaction when using the mobile device. These results show the applicability of using a mobile device for controlling an application on a remote screen. Using a mobile device provides the advantages that every person can e.g. use their own mobile phone or that these devices can be used in multi-user scenarios.

[1]  Stefan Edlund,et al.  A Universal Information Appliance , 1999, IBM Syst. J..

[2]  Dan R. Olsen,et al.  Cross-modal interaction using XWeb , 2000, UIST '00.

[3]  Rick Kjeldsen,et al.  Improvements in vision-based pointer control , 2006, Assets '06.

[4]  Marc Abrams,et al.  UIML: An Appliance-Independent XML User Interface Language , 1999, Comput. Networks.

[5]  Jacob O. Wobbrock.  A robust design for accessible text entry , 2006, ASAC.

[6]  Brad A. Myers.  Mobile Devices for Control , 2002, Mobile HCI.

[7]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[8]  Armando Fox,et al.  The Event Heap: a coordination infrastructure for interactive workspaces , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[9]  Jeffrey Nichols.  Using handhelds as controls for everyday appliances: a paper prototype study , 2001, CHI Extended Abstracts.

[10]  Hao Jiang,et al.  Direct pointer: direct manipulation for large-display interaction using handheld cameras , 2006, CHI.

[11]  Dan R. Olsen,et al.  Laser pointer interaction , 2001, CHI.

[12]  Petr Musílek,et al.  A keystroke and pointer control input interface for wearable computers , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications (PERCOM'06).

[13]  Marc Langheinrich,et al.  Operating Appliances with Mobile Phones - Strengths and Limits of a Universal Interaction Device , 2007, Pervasive.

[14]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.

[15]  Rafael Ballagas,et al.  iStuff mobile: rapidly prototyping new mobile phone interfaces for ubiquitous computing , 2007, CHI.

[16]  Kaisa Väänänen,et al.  Evolution towards smart home environments: empirical evaluation of three user interfaces , 2004, Personal and Ubiquitous Computing.

[18]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[19]  Wolfgang Stuerzlinger,et al.  Laser Pointers as Collaborative Pointing Devices , 2002, Graphics Interface.

[20]  Liviu Iftode,et al.  Smart Phone: an embedded system for universal interactions , 2004, Proceedings. 10th IEEE International Workshop on Future Trends of Distributed Computing Systems, 2004. FTDCS 2004..