Lumino: tangible blocks for tabletop computers based on glass fiber bundles

Tabletop computers based on diffuse illumination can track fiducial markers placed on the table's surface. In this paper, we demonstrate how to do the same with objects arranged in a three-dimensional structure without modifying the table. We present lumino, a system of building blocks. In addition to a marker, each block contains a glass fiber bundle. The bundle optically guides the light reflected off markers in the higher levels down to the table surface, where the table's built-in camera reads it. While guiding marker images down, the bundle optically scales and rearranges them. It thereby fits the images of an entire vertical arrangement of markers into the horizontal space usually occupied by a single 2D marker. We present six classes of blocks and matching marker designs, each of which is optimized for different requirements. We show three demo applications. One of them is a construction kit that logs and critiques constructions. The presented blocks are unpowered and maintenance-free, keeping larger numbers of blocks manageable.

[1]  Andy Hopper,et al.  A new location technique for the active office , 1997, IEEE Wirel. Commun..

[2]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.

[3]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[4]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Pietro Polotti,et al.  Tangible Acoustic Interfaces and their Applications for the Design of New Musical Instruments , 2005, NIME.

[6]  Peter Brandl,et al.  Shared Design Space: Sketching Ideas Using Digital Pens and a Large Augmented Tabletop Setup , 2006, ICAT.

[7]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[8]  Dan Rosenfeld,et al.  Going beyond the display: a surface technology with an electronically switchable diffuser , 2008, UIST '08.

[9]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[10]  E Peli,et al.  Fiber-optic reading magnifiers for the visually impaired. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[12]  O. Hilliges,et al.  Photohelix: Browsing, Sorting and Sharing Digital Photo Collections , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[13]  Joseph A. Paradiso,et al.  Tangible Music Interfaces using Passive Magnetic Tags , 2001, NIME.

[14]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[15]  Patrick Reuter,et al.  GeoTUI: a tangible user interface for geoscience , 2008, TEI.

[16]  Tom Bartindale,et al.  Stacks on the surface: resolving physical order using fiducial markers with structured transparency , 2009, ITS '09.

[17]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[18]  Timothy S. McNerney From turtles to Tangible Programming Bricks: explorations in physical language design , 2004, Personal and Ubiquitous Computing.

[19]  Yoshifumi Kitamura,et al.  Real-time 3D interaction with ActiveCube , 2001, CHI Extended Abstracts.

[20]  Kenichi Arakawa,et al.  Tangible search for stacked objects , 2003, CHI Extended Abstracts.

[21]  A.D. Wilson Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[22]  Ehud Sharlin,et al.  Exploring the use of tangible user interfaces for human-robot interaction: a comparative study , 2008, CHI.

[23]  Darren Leigh,et al.  Building virtual structures with physical blocks , 1999, UIST '99.

[24]  Gerald Penn,et al.  Tablescape Plus: Interactive Small-sized Vertical Displays on a Horizontal Tabletop Display , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[25]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[26]  Alex Olwal,et al.  SurfaceFusion: unobtrusive tracking of everyday objects in tangible user interfaces , 2008, Graphics Interface.

[27]  Janet C. Read,et al.  Designing and testing a tangible interface prototype , 2007, IDC.