RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors

This paper describes how to instrument the physical world so that objects become self-describing, communicating their identity, geometry, and other information such as history or user annotation. The enabling technology is a wireless tag which acts as a radio frequency identity and geometry (RFIG) transponder. We show how addition of a photo-sensor to a wireless tag significantly extends its functionality to allow geometric operations - such as finding the 3D position of a tag, or detecting change in the shape of a tagged object. Tag data is presented to the user by direct projection using a handheld locale-aware mobile projector. We introduce a novel technique that we call interactive projection to allow a user to interact with projected information e.g. to navigate or update the projected information.The ideas are demonstrated using objects with active radio frequency (RF) tags. But the work was motivated by the advent of unpowered passive-RFID, a technology that promises to have significant impact in real-world applications. We discuss how our current prototypes could evolve to passive-RFID in the future.

[1]  Bernt Schiele,et al.  Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts , 2001, UbiComp.

[2]  Joseph A. Paradiso,et al.  The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup , 2002, UbiComp.

[3]  Bill N. Schilit,et al.  An overview of the PARCTAB ubiquitous computing experiment , 1995, IEEE Wirel. Commun..

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  Roy Want,et al.  RFID. A key to automating everything. , 2004, Scientific American.

[6]  Oliver Bimber,et al.  The virtual showcase , 2005, SIGGRAPH Courses.

[7]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[8]  Claudio S. Pinhanez The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[9]  Gregory D. Abowd,et al.  A 2-Way Laser-Assisted Selection Scheme for Handhelds in a Physical Environment , 2003, UbiComp.

[10]  Neil Gershenfeld,et al.  An installation of interactive furniture , 2000, IBM Syst. J..

[11]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[12]  Jun Rekimoto,et al.  DataTiles: a modular platform for mixed physical and graphical interactions , 2001, CHI.

[13]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[14]  A. de Smit,et al.  Development of a Flexible Augmented Prototyping System , 2003, WSCG.

[15]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[16]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[17]  Paul A. Beardsley,et al.  Interactive projection , 2004, SIGGRAPH '04.

[18]  Matthias Ringwald,et al.  Spontaneous Interaction with Everyday Devices Using a PDA , 2002 .

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Chris Hanson,et al.  Amorphous computing , 2000, Commun. ACM.

[21]  Roy Want,et al.  Implementing phicons: combining computer vision with infrared technology for interactive physical icons , 1999, UIST '99.

[22]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[23]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[24]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[25]  Jiawen Chen,et al.  Pervasive Pose-Aware Applications and Infrastructure , 2003, IEEE Computer Graphics and Applications.

[26]  윤상경 Laser projection display , 2005 .

[27]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[28]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[29]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.