A taxonomy for and analysis of multi-person-display ecosystems

Interactive displays are increasingly being distributed in a broad spectrum of everyday life environments: they have very diverse form factors and portability characteristics, support a variety of interaction techniques, and can be used by a variable number of people. The coupling of multiple displays creates an interactive “ecosystem of displays”. Such an ecosystem is suitable for particular social contexts, which in turn generates novel settings for communication and performance and challenges in ownership. This paper aims at providing a design space that can inform the designers of such ecosystems. To this end, we provide a taxonomy that builds on the size of the ecosystem and on the degree of individual engagement as dimensions. We recognize areas where physical constraints imply certain kinds of social engagement, versus other areas where further work on interaction techniques for coupling displays can open new design spaces.

[1]  Kathy Ryall,et al.  UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces , 2003, UbiComp.

[2]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[3]  Trent Apted,et al.  Tabletop sharing of digital photographs for the elderly , 2006, CHI.

[4]  Ted G. Lewis Cars, Phones, and Tamagotchi Tribes , 1997, Computer.

[5]  Mark Wright,et al.  Branded meeting places: Ubiquitous technologies and the design of places for meaningful human encounter , 2010 .

[6]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[7]  Mark Weiser The computer for the 21st century , 1991 .

[8]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[9]  Brad A. Myers,et al.  Using handhelds and PCs together , 2001, CACM.

[10]  Desney S. Tan,et al.  Impromptu: a new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development , 2008, CHI.

[11]  Hao Jiang,et al.  System design for the WeSpace: Linking personal devices to a table-centered multi-user, multi-surface environment , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[12]  Jun Rekimoto,et al.  tranSticks: physically manipulatable virtual connections , 2005, CHI.

[13]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[14]  Regan L. Mandryk,et al.  Exploring display factors that influence co-located collaboration: angle, size, number, and user arrangement , 2005 .

[15]  M. Weiser The Computer for the Twenty-First Century , 1991 .

[16]  Daniel J. Wigdor,et al.  Table-centric interactive spaces for real-time collaboration , 2006, AVI '06.

[17]  René Mayrhofer,et al.  Shake Well Before Use: Authentication Based on Accelerometer Data , 2007, Pervasive.

[18]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.

[19]  David S. Kirk,et al.  Savannah: mobile gaming and learning? , 2004, J. Comput. Assist. Learn..

[20]  Daniel G. Bobrow,et al.  WYSIWIS revised: early experiences with multi-user interfaces , 1986, CSCW.

[21]  Thomas G. Zimmerman,et al.  : Near-field , 2022 .

[22]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.

[23]  Lars Erik Holmquist,et al.  OpenTrek: A Platform for Developing Interactive Networked Games on Mobile Devices , 2003, Mobile HCI.

[24]  Corina Sas,et al.  Breaking the campus bubble: informed, engaged, connected , 2007 .

[25]  Gregory D. Abowd,et al.  Teaching and learning as multimedia authoring: the classroom 2000 project , 1997, MULTIMEDIA '96.

[26]  Gerd Kortuem,et al.  A relative positioning system for co-located mobile devices , 2005, MobiSys '05.

[27]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[28]  Lucia Terrenghi,et al.  Designing hybrid interaction through an understanding of the affordances of physical and digital technologies , 2007, C&C '07.

[29]  Carl Gutwin,et al.  E-conic: a perspective-aware interface for multi-display environments , 2007, UIST.

[30]  Brian P. Bailey,et al.  ARIS: An Interface for Application Relocation in an Interactive Space , 2004, Graphics Interface.

[31]  Armando Fox,et al.  The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms , 2002, IEEE Pervasive Comput..

[32]  Michael Rohs,et al.  Group coordination and negotiation through spatial proximity regions around mobile devices on augmented tabletops , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[33]  Kori Inkpen Quinn,et al.  GeneyTM: designing a collaborative activity for the palmTM handheld computer , 2001, CHI.

[34]  Jun Rekimoto,et al.  ProxNet: Secure Dynamic Wireless Connection by Proximity Sensing , 2004, Pervasive.

[35]  Gregory D. Abowd,et al.  Opportunistic Annexing for Handheld Devices: Opportunities and Challenges , 2003 .

[36]  Dieter Schmalstieg,et al.  Towards Massively Multi-user Augmented Reality on Handheld Devices , 2005, Pervasive.

[37]  Bernt Schiele,et al.  Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts , 2001, UbiComp.

[38]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[39]  Duck Gun Park,et al.  TAP: touch-and-play , 2006, CHI.

[40]  Daniel G. Bobrow,et al.  WYSIWIS revised: early experiences with multiuser interfaces , 1987, TOIS.

[41]  Jun Rekimoto SyncTap: synchronous user operation for spontaneous network connection , 2004, Personal and Ubiquitous Computing.

[42]  Norbert A. Streitz,et al.  Connectables: dynamic coupling of displays for the flexible creation of shared workspaces , 2001, UIST '01.

[43]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[44]  Steve Benford,et al.  Formalising Performative Interaction , 2005, DSV-IS.

[45]  Takeshi Naemura,et al.  UlteriorScape: Interactive optical superimposition on a view-dependent tabletop display , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[46]  Keith Cheverst,et al.  Probing communities: study of a village photo display , 2007, OZCHI '07.

[47]  Andrew D. Wilson,et al.  BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking , 2007, GI '07.

[48]  Coniferous softwood GENERAL TERMS , 2003 .

[49]  David Kirk,et al.  Savannah: experiential learning through mobile gaming , 2004 .

[50]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[51]  Yvonne Rogers,et al.  Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media , 2003, UIST '03.