Unsynchronized 4D Barcodes

We present a novel technique for optical data transfer between public displays and mobile devices based on unsynchronized 4D barcodes. We assume that no direct (electromagnetic or other) connection between the devices can exist. Time-multiplexed, 2D color barcodes are displayed on screens and recorded with camera equipped mobile phones. This allows to transmit information optically between both devices. Our approach maximizes the data throughput and the robustness of the barcode recognition, while no immediate synchronization exists. Although the transfer rate is much smaller than it can be achieved with electromagnetic techniques (e.g., Bluetooth or WiFi), we envision to apply such a technique wherever no direct connection is available. 4D barcodes can, for instance, be integrated into public web-pages, movie sequences, advertisement presentations or information displays, and they encode and transmit more information than possible with single 2D or 3D barcodes.

[1]  Suresh Chande,et al.  Mobile visual interaction: enhancing local communication and collaboration with visual interactions , 2006, MUM '06.

[2]  Richard Sharp,et al.  Using visual tags to bypass Bluetooth device discovery , 2005, MOCO.

[3]  Michael Rohs,et al.  Real-World Interaction with Camera Phones , 2004, UCS.

[4]  Masao Nakagawa,et al.  Performance evaluation of visible-light wireless communication system using white LED lightings , 2004, Proceedings. ISCC 2004. Ninth International Symposium on Computers And Communications (IEEE Cat. No.04TH8769).

[5]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[6]  James M. Coughlan,et al.  Reading LCD/LED Displays with a Camera Cell Phone , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[7]  Masao Nakagawa,et al.  Indoor Visible Light Data Transmission System Utilizing White LED Lights , 2003 .

[8]  interactions Staff,et al.  CHI 2005 , 2005 .

[9]  Peter Deutsch,et al.  DEFLATE Compressed Data Format Specification version 1.3 , 1996, RFC.

[10]  Alan F. Blackwell,et al.  Interacting with mobile services: an evaluation of camera-phones and visual tags , 2007, Personal and Ubiquitous Computing.

[11]  Paul S. Heckbert,et al.  Fundamentals of Texture Mapping and Image Warping , 1989 .

[12]  Michael Rohs,et al.  Visual code widgets for marker-based interaction , 2005, 25th IEEE International Conference on Distributed Computing Systems Workshops.

[13]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.