The soul of ActiveCube: implementing a flexible, multimodal, three-dimensional spatial tangible interface

ActiveCube is a novel user interface which allows intuitive interaction with computers. ActiveCube allows users to construct and interact with Three Dimensional (3D) environments using physical cubes equipped with input/output devices. Spatial, temporal and functional consistency is always maintained between the physical object and its corresponding representation in the computer. In this paper we detail the design and implementation of our system. We describe the method we used to realize flexible 3D modeling by controlling the recognition signals of each face in each cube. We also explain how we integrated additional multimodal interaction options by a number of sophisticated I/O devices and by the inclusion of a second microprocessor in our cubes. We argue that ActiveCube, with its current real-time multimodal and spatial capabilities, is ready to enable a large range of interactive entertainment applications that were impossible to realize before.

[1]  Anthony T. Patera,et al.  Geometry-defining processors for engineering design and analysis , 1989, The Visual Computer.

[2]  Paul A. Beardsley,et al.  Tangible interaction + graphical interpretation: a new approach to 3D modeling , 2000, SIGGRAPH.

[3]  M. Resnick,et al.  Programmable Bricks: Toys to Think With , 1996, IBM Syst. J..

[4]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[5]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[6]  Yoshifumi Kitamura,et al.  Implementation of ActiveCube as an Intuitive 3D Computer Interface , 2004, Smart Graphics.

[7]  Ehud Sharlin,et al.  Cognitive cubes: a tangible user interface for cognitive assessment , 2002, CHI.

[8]  John H. Frazer,et al.  An Evolutionary Architecture , 1995 .

[9]  Ehud Sharlin,et al.  Spatial Tangible User Interfaces for Cognitive Assessment and Training , 2004, BioADIT.

[10]  Yoshifumi Kitamura,et al.  Real-time 3D interaction with ActiveCube , 2001, CHI Extended Abstracts.

[11]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[12]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[13]  Yoshifumi Kitamura,et al.  Interactive retrieval of 3D virtual shapes using physical objects , 2004, IEEE Virtual Reality 2004.

[14]  Robert Aish,et al.  Architecture without numbers — CAAD based on a 3D modelling system , 1984 .

[15]  Ellen Yi-Luen Do,et al.  Navigational blocks: navigating information space with tangible media , 2002, IUI '02.