Mobile Interaction with the Real World: An Evaluation and Comparison of Physical Mobile Interaction Techniques

Mobile devices are more and more used for mobile interactions with things, places and people in the real world. However, so far no studies have discussed which interaction techniques are preferred by users in different contexts. This paper presents an experimental comparison of four different physical mobile interaction techniques: touching, pointing, scanning and user-mediated object interaction. To evaluate these techniques across different scenarios and to collect real usage data, four prototypes were implemented: a system for mobile interaction in smart environments, a mobile tourist guide, a mobile museum guide and a prototype for mobile interaction with advertisement posters. In each setting an experimental comparison was performed. Based on the results of these studies, which involved over 60 participants in total, advantages and disadvantages of these interaction techniques are described. Context-specific user preferences are presented for the interaction techniques, to help application designers and developers decide which interaction technique(s) to integrate into their application and which consequences this decision has.

[1]  Timothy W. Finin,et al.  Mobile interaction with the real world , 2006, MIRW.

[2]  Clayton Lewis,et al.  TASK-CENTERED USER INTERFACE DESIGN A Practical Introduction , 2006 .

[3]  Keith Cheverst,et al.  Developing a context-aware electronic tourist guide: some issues and experiences , 2000, CHI.

[4]  Heikki Ailisto,et al.  A user interaction paradigm for physical browsing and near-object control based on tags , 2003 .

[5]  Gregory D. Abowd,et al.  Human-Computer Interaction (3rd Edition) , 2003 .

[6]  J. Boyd.  Here comes the wallet phone [wireless credit card] , 2005, IEEE Spectrum.

[7]  Bill Serra,et al.  People, Places, Things: Web Presence for the Real World , 2000, Proceedings Third IEEE Workshop on Mobile Computing Systems and Applications.

[8]  Albrecht Schmidt,et al.  An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning , 2006, UbiComp.

[9]  Michael Rohs,et al.  USING CAMERA-EQUIPPED MOBILE PHONES FOR INTERACTING WITH REAL-WORLD OBJECTS , 2004 .

[10]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[11]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[12]  Enrico Rukzio,et al.  Physical mobile interactions : mobile devices as pervasive mediators for interactions with the real world , 2006 .

[13]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[14]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[15]  Albrecht Schmidt,et al.  Supporting Mobile Service Usage through Physical Mobile Interaction , 2007, Fifth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom'07).