Mobile Phone Based Interaction with Everyday Products - On the Go

Linking the physical world with information and services is a powerful concept. Even though RFID technology is very promising, the widespread use of RFID tags on retail products remains unlikely for the next years. In contrast, barcodes are ubiquitous - printed on virtually all consumer items world-wide. Recently there is an increasing interest in applications based on the recognition of standard ID barcodes using the built-in cameras of mobile phones. Since many of the potential applications are especially useful when being "on the go", e.g., while shopping, a simple and fast user interaction is essential. In this paper we want to present two contributions that enable such a simple and fast interaction with everyday products and their services: A system for the recognition of ID barcodes on mobile phones that differs in two aspects from already existing solutions: the fast and robust real-time recognition of codes on the camera's video images as well as the live detection of additional code parameters, like the barcode's relative orientation to the mobile phone. Besides that, we present and suggest the usage of these additional parameters in order to ease and accelerate the user interaction process -for example with the help of orientation sensitive menus.

[1]  Michael Rohs,et al.  Marker-Based Embodied Interaction for Handheld Augmented Reality Games , 2007, J. Virtual Real. Broadcast..

[2]  Marc Langheinrich,et al.  Toolkit for Bar Code Recognition and Resolving on Camera Phones - Jump Starting the Internet of Things , 2006, GI Jahrestagung.

[3]  Paul P. Maglio,et al.  Informative things: how to attach information to the real world , 1998, UIST '98.

[4]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[5]  Bill Serra,et al.  People, Places, Things: Web Presence for the Real World , 2000, Proceedings Third IEEE Workshop on Mobile Computing Systems and Applications.

[6]  Alan F. Blackwell,et al.  Interacting with mobile services: an evaluation of camera-phones and visual tags , 2007, Personal and Ubiquitous Computing.

[7]  Marc Langheinrich,et al.  Workshop Mobile and Embedded Interactive Systems ( MEIS ' 06 ) , 2006 .

[8]  Enrico Magli,et al.  All-integer Hough transform: performance evaluation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[9]  Hiroshi Hanaizumi,et al.  Barcode readers using the camera device in mobile phones , 2004, 2004 International Conference on Cyberworlds.

[10]  Michael Rohs,et al.  Real-World Interaction with Camera Phones , 2004, UCS.

[11]  Pierre Wellner,et al.  Adaptive Thresholding for the DigitalDesk , 1993 .

[12]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.