Conductor: enabling and understanding cross-device interaction

The proliferation of inexpensive connected devices has created a situation where a person, at any given moment, is surrounded by interactive computers. Despite this fact, there are very few means by which a user may take advantage of this large number of screens. We present Conductor, a prototype framework which serves as an exemplar for the construction of cross-device applications. We present a series of interaction methods by which users can easily share information, chain tasks across devices, and manage sessions across devices. We also present a cross-device usage scenario which utilizes several cross-device applications built within our prototype framework. We also describe a user study, which helped us to understand how users will take advantage of a large number of devices in support of performance of a sense making task.

[1]  Peter Cook,et al.  Project Nick: meetings augmentation and analysis , 1986, CSCW '86.

[2]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[3]  Armando Fox,et al.  The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms , 2002, IEEE Pervasive Comput..

[4]  Daniel J. Wigdor,et al.  A field study of multi-device workflows in distributed workspaces , 2013, UbiComp.

[5]  Gregory D. Abowd,et al.  Opportunistic Annexing for Handheld Devices: Opportunities and Challenges , 2003 .

[6]  Roel Vertegaal,et al.  DisplayStacks: interaction techniques for stacks of flexible thin-film displays , 2012, CHI.

[7]  Brad A. Myers,et al.  Collaboration using multiple PDAs connected to a PC , 1998, CSCW '98.

[8]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[9]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[10]  Jun Rekimoto,et al.  A multiple device approach for supporting whiteboard-based interactions , 1998, CHI.

[11]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[12]  Chris North,et al.  A comparison of two display models for collaborative sensemaking , 2013, PerDis '13.

[13]  Carl Gutwin,et al.  A comparison of techniques for multi-display reaching , 2005, CHI.

[14]  Jean Scholtz,et al.  Evaluating Visual Analytics at the 2007 VAST Symposium Contest , 2008, IEEE Computer Graphics and Applications.

[15]  Nicholas Chen,et al.  Designing a multi-slate reading environment to support active reading activities , 2012, TCHI.

[16]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[17]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[18]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[19]  Nicholas Chen,et al.  Graduate student use of a multi-slate reading system , 2013, CHI.

[20]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[21]  Hao Jiang,et al.  WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system , 2009, CHI.

[22]  Daniel G. Bobrow,et al.  WYSIWIS revised: early experiences with multiuser interfaces , 1987, TOIS.

[23]  Mary Czerwinski,et al.  Display space usage and window management operation comparisons between single monitor and multiple monitor users , 2004, AVI.

[24]  Jonathan Grudin,et al.  Partitioning digital worlds: focal and peripheral awareness in multiple monitor use , 2001, CHI.

[25]  Rob Miller,et al.  Synchronizing clipboards of multiple computers , 1999, UIST '99.

[26]  Andreas Butz,et al.  Touch projector: mobile interaction through video , 2010, CHI.

[27]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[28]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[29]  Ken Hinckley.  Bumping Objects Together as a Semantically Rich Way of Forming Connections between Ubiquitous Devices , 2016 .

[30]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[31]  Dimitre Novatchev,et al.  Chunking and Phrasing and the Design of Human-Computer Dialogues - Response , 1986, IFIP Congress.

[32]  William Buxton,et al.  Sentient Data Access via a Diverse Society of Devices , 2003, ACM Queue.