Media tables: an extensible method for developing multi-user media interaction platforms for shared spaces

As digital entertainment applications evolve, there is a need for new kinds of platforms that can support sociable media interactions for everyday consumers. This thesis demonstrates an extensible method and sensing framework for real-time tracking of multiple objects on an interactive table with an embedded display. This tabletop platform can support many different applications, and is designed to overcome the commercial obstacles of previous single purpose systems. The approach is supported through the design and implementation of an acoustic-based sensing system that provides a means for managing large numbers of objects and applications across multiple platform instances. The design requires precise and dynamic positioning of multiple objects in order to enable real-time multi-user interactions with media applications. Technical analysis shows the approach to be robust, scalable to various sizes, and accurate to within a few millimeters of tolerance. A qualitative user evaluation of the table within a real-world setting illustrates its usability in the consumer entertainment space for digital media browsing and game play. Our observations revealed different ways of mapping physical interaction objects to the media space, as either generic controls or fixed function devices, and highlighted the issue of directionality on visual displays that are viewable from different sides. The thesis suggests that by providing a general purpose method for shared tabletop display platforms we give application designers the freedom to invent a broad range of media interactions and applications for everyday social environments, such as homes, classrooms and public spaces. Contributions of the thesis include: formulation of an extensible method for media table platforms; development of a novel sensing approach for dynamic object tracking on glass surfaces; a taxonomy of interface design considerations; and prototype designs for media content browsing, digital storytelling and game play applications. (Copies available exclusively from MIT Libraries, Rm. 14-0551, Cambridge, MA 02139-4307. Ph. 617-253-5668; Fax 617-253-1690.)

[1]  Takeshi Naemura,et al.  Lumisight table: a face-to-face collaboration support system that optimizes direction of projected information to each stakeholder , 2004, CSCW.

[2]  Russell F. Pinkston,et al.  A Touch Sensitive Dance Floor/MIDI Controller , 1995, ICMC.

[3]  Anthony T. Patera,et al.  Geometry-defining processors for engineering design and analysis , 1989, The Visual Computer.

[4]  Neil Gershenfeld,et al.  An immersive, multi-user, musical stage environment , 2001, SIGGRAPH.

[5]  B. Auld,et al.  Acoustic fields and waves in solids , 1973 .

[6]  Albrecht Schmidt,et al.  Building intelligent environments with Smart-Its , 2004, IEEE Computer Graphics and Applications.

[7]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[8]  Hobart R. Everett,et al.  Mobile robot positioning: Sensors and techniques , 1997, J. Field Robotics.

[9]  Gregory D. Abowd,et al.  The Aware Home: A Living Laboratory for Ubiquitous Computing Research , 1999, CoBuild.

[10]  John H. Frazer,et al.  An Evolutionary Architecture , 1995 .

[11]  Hiroshi Ishii,et al.  Tangible viewpoints: a physical approach to multimedia stories , 2002, MULTIMEDIA '02.

[12]  Sergi Jordà,et al.  Sonigraphical Instruments: From FMOL to the reacTable* , 2003, NIME.

[13]  Morten Fjeld,et al.  BUILD-IT: An Intuitive Design Tool Based on Direct Object Manipulation , 1997, Gesture Workshop.

[14]  Gregory D. Abowd,et al.  The smart floor: a mechanism for natural user identification and tracking , 2000, CHI Extended Abstracts.

[15]  T. O. Ellis,et al.  The RAND tablet: a man-machine graphical communication device , 1964, AFIPS '64 (Fall, part I).

[16]  P. A. Piccione,et al.  In Search of the Meaning of Senet , 1980 .

[17]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[18]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[19]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[20]  Kent Larson,et al.  A living laboratory for the design and evaluation of ubiquitous computing technologies , 2005, CHI Extended Abstracts.

[21]  Terry Winograd,et al.  FLEXIBLE, COLLABORATIVE ORGANIZATION ON A TABLETOP , 2002 .

[22]  Joseph A. Paradiso,et al.  Tracking and characterizing knocks atop large interactive displays , 2005 .

[23]  Kaj Grønbæk,et al.  Domestic hypermedia: mixed media in the home , 2004, HYPERTEXT '04.

[24]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[25]  Hiroshi Ishii,et al.  Illuminating light: an optical design tool with a luminous-tangible interface , 1998, CHI.

[26]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[27]  Dan Rosenfeld.  Planar manipulator display , 2004 .

[28]  Brygg Ullmer,et al.  Tangible interfaces for manipulating aggregates of digital information , 2002 .

[29]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[30]  Norman M. Abramson,et al.  THE ALOHA SYSTEM: another alternative for computer communications , 1899, AFIPS '70 (Fall).

[31]  Debby Hindus,et al.  Casablanca: designing social communication devices for the home , 2001, CHI 2001.

[32]  Che King Leo.  Contact and free-gesture tracking for large interactive surfaces , 2002 .

[33]  Douglas Ash,et al.  World furniture;: An illustrated history , 1965 .

[35]  Jean Scholtz,et al.  Engineering ethnography in the home , 1996, CHI Conference Companion.

[36]  A BoltRichard,et al.  Put-that-there , 1980 .

[37]  Alexandra Mazalek,et al.  Tangible interfaces for interactive point-of-view narratives , 2001 .

[38]  Joseph A. Paradiso,et al.  The magic carpet: physical sensing for immersive environments , 1997, CHI Extended Abstracts.

[39]  Joshua Andrew Strickon.  Design and HCI applications of a low-cost scanning laser rangefinder , 1999 .

[40]  Nisha Checka,et al.  A system for tracking and characterizing acoustic impacts on large interactive surfaces , 2001 .

[41]  Joseph A. Paradiso,et al.  Passive acoustic sensing for tracking knocks atop large interactive displays , 2002, Proceedings of IEEE Sensors.

[42]  W. Bu.  A MULTI-TOUCH THREE DIMENSIONAL TOUCH-SENSITIVE TABLET , 1985 .

[43]  Jakub Segen,et al.  Dialog Table , 2004, DIS '04.

[44]  Joseph A. Paradiso,et al.  PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play , 1999, CHI '99.

[45]  Robert Charles Bell,et al.  Board and table games from many civilizations , 1969 .

[46]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[47]  Lawrence G. Roberts,et al.  ALOHA packet system with and without slots and capture , 1975, CCRV.

[48]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[49]  Neil Gershenfeld,et al.  An installation of interactive furniture , 2000, IBM Syst. J..

[50]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[51]  L. Manovich,et al.  The language of new media , 2001 .

[52]  Tom Standage.  The Turk: The Life and Times of the Famous Eighteenth-Century Chess-Playing Machine , 2002 .

[53]  Andrew Lippman,et al.  Movie-maps: An application of the optical videodisc to computer graphics , 1980, SIGGRAPH '80.

[54]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[55]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[56]  Hobart R. Everett,et al.  Sensors for Mobile Robots: Theory and Application , 1995 .

[57]  Mitchel Resnick,et al.  The Computer Clubhouse: Preparing for Life in a Digital World , 1996, IBM Syst. J..

[58]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[59]  Tom Rodden,et al.  At home with the technology: an ethnographic study of a set-top-box trial , 1999, TCHI.

[60]  Frédéric Vernier,et al.  Personal digital historian: story sharing around the table , 2003, INTR.

[61]  Stefan Agamanolis,et al.  Synergistic storyscapes and constructionist cinematic sharing , 2000, IBM Syst. J..

[62]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[63]  金子 進.  Coordinate input apparatus and a coordinate input system , 2006 .

[64]  M. Fink,et al.  Time-reversed Lamb waves , 1998, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[65]  Ali Mazalek,et al.  A tangible platform for documenting experiences and sharing multimedia stories , 2003, ETP '03.

[66]  Hiroshi Ishii,et al.  Audiopad: A Tag-based Interface for Musical Performance , 2002, NIME.

[67]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.