The actuated Workbench : 2D actuation in tabletop tangible interfaces

The Actuated Workbench is a new actuation mechanism that uses magnetic forces to control the two-dimensional movement of physical objects on flat surfaces. This mechanism is intended for use with existing tabletop Tangible User Interfaces, providing computer-controlled movement of the physical objects on the table, and creating an additional feedback layer for Human Computer Interaction (HCI). Use of this actuation technique makes possible new kinds of physical interactions with tabletop interfaces, and allows the computer to maintain consistency between the physical and digital states of data objects in the interface. This thesis focuses on the design and implementation of the actuation mechanism as an enabling technology, introduces new techniques for motion control, and discusses practical and theoretical implications of computer-controlled movement of physical objects in tabletop tangible interfaces. Thesis Supervisor: Hiroshi Ishii Title: Associate Professor of Media Arts and Sciences The Actuated Workbench: 2D Actuation in Tabletop Tangible Interfaces Gian Antonio Pangaro

[1]  John C. Tang,et al.  Videodraw: a video interface for collaborative drawing , 1991, TOIS.

[2]  Ben Shneiderman,et al.  The future of interactive systems and the emergence of direct manipulation , 1982 .

[3]  Keith Nesbitt,et al.  Using force feedback for multi-sensory display , 2001, Proceedings Second Australasian User Interface Conference. AUIC 2001.

[4]  B. V. Jayawant.  Electromagnetic levitation and suspension techniques , 1981 .

[5]  John Stuart Beeteson.  Visualising Magnetic Fields: Numerical Equation Solvers in Action , 2000 .

[6]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[7]  Scott R. Klemmer,et al.  Two worlds apart: bridging the gap between physical and virtual media for distributed design collaboration , 2003, CHI '03.

[8]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[9]  William Buxton,et al.  There's more to interaction than meets the eye: some issues in manual input , 1987 .

[10]  Ken Perlin,et al.  Physical objects as bidirectional user interface elements , 2004, IEEE Computer Graphics and Applications.

[11]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[12]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[13]  Hiroshi Ishii,et al.  A tangible interface for organizing information using a grid , 2002, CHI.

[14]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[15]  William Buxton,et al.  An empirical evaluation of graspable user interfaces: towards specialized, space-multiplexed input , 1997, CHI.

[16]  D. Maynes-Aminzade,et al.  The actuated workbench: computer-controlled actuation in tabletop tangible interfaces , 2003, ACM Trans. Graph..

[17]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[18]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[19]  William Buxton,et al.  Graspable user interfaces , 1996 .

[20]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[21]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[22]  Hiroshi Ishii,et al.  Tangible interfaces for remote collaboration and communication , 1998, CSCW '98.

[23]  Dan Reznik,et al.  C'mon part, do the local motion! , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[24]  Hiroshi Ishii,et al.  Toward an open shared workspace: computer and video fusion approach of TeamWorkStation , 1991, CACM.

[25]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[26]  Mark W. Newman,et al.  The designers' outpost: a tangible interface for collaborative web site , 2001, UIST '01.

[27]  John C. Tang,et al.  VideoDraw: a video interface for collaborative drawing , 1990, CHI '90.

[28]  Afzal Godil,et al.  Integrating active tangible devices with a synthetic environment for collaborative engineering , 2001, Web3D '01.

[29]  Andrew A. Berlin,et al.  AirJet paper mover: an example of mesoscale MEMS , 2000, SPIE MOEMS-MEMS.

[30]  Tom White,et al.  Introducing liquid haptics in high bandwidth human computer interfaces , 1998 .

[31]  TechnologySankt,et al.  The Responsive Workbench , 1994 .

[32]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[33]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[34]  S. Earnshaw.  On the Nature of the Molecular Forces which Regulate the Constitution of the Luminiferous Ether , .

[35]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[36]  Hiroshi Ishii,et al.  curlybot: designing a new class of computational toys , 2000, CHI.

[37]  Bernd Fröhlich,et al.  The Responsive Workbench [virtual work environment] , 1994, IEEE Computer Graphics and Applications.

[38]  Ralph L. Hollis,et al.  Interaction with a real time dynamic environment simulation using a magnetic levitation haptic interface device , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[39]  Karon E. MacLean,et al.  Haptic techniques for media control , 2001, UIST '01.

[40]  Howie Choset,et al.  Virtual vehicle: parcel manipulation and dynamics with a distributed actuator array , 1998, Other Conferences.

[41]  Brygg Ullmer,et al.  Tangible interfaces for manipulating aggregates of digital information , 2002 .

[42]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[43]  Hiroshi Ishii,et al.  ambientROOM: integrating ambient media with architectural space , 1998, CHI Conference Summary.

[44]  Jun Rekimoto,et al.  ToolStone: effective use of the physical manipulation vocabularies of input devices , 2000, UIST '00.

[45]  Stephan Diehl,et al.  Proceedings of the sixth international conference on 3D Web technology , 2001 .

[46]  Hiroshi Ishii,et al.  A comparison of spatial organization strategies in graphical and tangible user interfaces , 2000, DARE '00.

[47]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..