Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices

We present Phone as a Pixel: a scalable, synchronization-free, platform-independent system for creating large, ad-hoc displays from a collection of smaller devices. In contrast to most tiled-display systems, the only requirement for participation is for devices to have an internet connection and a web browser. Thus, most smartphones, tablets, laptops and similar devices can be used. Phone as a Pixel uses a color-transition encoding scheme to identify and locate displays. This approach has several advantages: devices can be arbitrarily arranged (i.e., not in a grid) and infrastructure consists of a single conventional camera. Further, additional devices can join at any time without re-calibration. These are desirable properties to enable collective displays in contexts like sporting events, concerts and political rallies. In this paper we describe our system, show results from proof-of-concept setups, and quantify the performance of our approach on hundreds of displays.

[1]  Alan J. Dix,et al.  A taxonomy for and analysis of multi-person-display ecosystems , 2009, Personal and Ubiquitous Computing.

[2]  Kenton O'Hara,et al.  Understanding collective play in an urban screen game , 2008, CSCW.

[3]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[4]  Tom Barker,et al.  Investigating political and demographic factors in crowd based interfaces , 2009, OZCHI '09.

[5]  Ming Li,et al.  Ad-Hoc Multi-Displays for Mobile Interactive Applications , 2010, Eurographics.

[6]  Takayuki Okatani,et al.  Easy Calibration of a Multi-projector Display System , 2009, International Journal of Computer Vision.

[7]  Louise Barkhuus,et al.  Engaging the crowd: studies of audience-performer interaction , 2008, CHI Extended Abstracts.

[8]  H. Bastian Sensation and Perception.—I , 1869, Nature.

[9]  Jeremy M. Wolfe,et al.  Sensation and Perception , 2008 .

[10]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[11]  Kenton O'Hara,et al.  Crowd computer interaction , 2009, CHI Extended Abstracts.

[12]  Tomohiro Tanikawa,et al.  Particle Display System - Virtually Perceivable Pixels with Randomly Distributed Physical Pixels , 2009, J. Inf. Process..

[13]  Barry A. T. Brown,et al.  Designing for crowds , 2010, NordiCHI.

[14]  Suguru Higashino,et al.  C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal , 2004, UIST '04.

[15]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.