An infrastructure for extending applications' user experiences across multiple personal devices

Users increasingly interact with a heterogeneous collection of computing devices. The applications that users employ on those devices, however, still largely provide user experiences that assume the use of a single computer. This failure is due in part to the difficulty of creating user experiences that span multiple devices, particularly the need to manage identifying, connecting to, and communicating with other devices. In this paper we present an infrastructure based on instant messaging that simplifies adding that additional functionality to applications. Our infrastructure elevates device ownership to a first class property, allowing developers to provide functionality that spans personal devices without writing code to manage users' devices or establish connections among them. It also provides simple mechanisms for applications to send information, events, or commands between a user's devices. We demonstrate the effectiveness of our infrastructure by presenting a set of sample applications built with it and a user study demonstrating that developers new to the infrastructure can implement all of the cross-device functionality for three applications in, on average, less than two and a half hours.

[1]  Mahadev Satyanarayanan,et al.  Coda: A Highly Available File System for a Distributed Workstation Environment , 1990, IEEE Trans. Computers.

[2]  Antti Oulasvirta,et al.  Mobile kits and laptop trays: managing multiple devices in mobile information work , 2007, CHI.

[3]  Mahadev Satyanarayanan,et al.  Towards seamless mobility on pervasive hardware , 2005, Pervasive Mob. Comput..

[4]  Dan R. Olsen,et al.  Join and capture: a model for nomadic interaction , 2001, UIST '01.

[5]  Mahadev Satyanarayanan,et al.  Coda: a highly available file system for a distributed workstation environment , 1989, Proceedings of the Second Workshop on Workstation Operating Systems.

[6]  Claudio S. Pinhanez,et al.  Fostering a Symbiotic Handheld Environment , 2003, Computer.

[7]  Juwon Ahn,et al.  SEREFE: serendipitous file exchange between users and devices , 2005, Mobile HCI.

[8]  Rafael Ballagas,et al.  Spontaneous marriages of mobile devices and interactive spaces , 2005, CACM.

[9]  Bill N. Schilit,et al.  Looking across four system layers — link , network , data , and application — the authors survey the technologies , standards , and leading-edge research making device ensembles a reality , 2022 .

[10]  David Dearman,et al.  It's on my other computer!: computing with multiple devices , 2008, CHI.

[11]  Peter Tandler,et al.  The BEACH application model and software framework for synchronous collaboration in ubiquitous computing environments , 2004, J. Syst. Softw..

[12]  Shumin Zhai,et al.  Dial and see: tackling the voice menu navigation problem with cross-device user experience integration , 2005, UIST '05.

[13]  Jakob E. Bardram,et al.  Support for activity-based computing in a personal computing operating system , 2006, CHI.

[14]  A. Fox,et al.  Integrating information appliances into an interactive workspace , 2000, IEEE Computer Graphics and Applications.

[15]  Jeffrey S. Pierce,et al.  Understanding the whethers, hows, and whys of divisible interfaces , 2006, AVI '06.

[16]  Klara Nahrstedt,et al.  A Middleware Infrastructure for Active Spaces , 2002, IEEE Pervasive Comput..

[17]  Ramón Cáceres,et al.  Reincarnating PCs with portable SoulPads , 2005, MobiSys '05.

[18]  Armando Fox,et al.  Multibrowsing: Moving Web Content across Multiple Displays , 2001, UbiComp.

[19]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[20]  John C. Tang,et al.  Recent shortcuts: using recent interactions to support shared activities , 2007, CHI.

[21]  Mark W. Newman,et al.  User interfaces when and where they are needed: an infrastructure for recombinant computing , 2002, UIST '02.