Multi-user interaction on media facades through live video on mobile devices

The increasing number of media facades in urban spaces offers great potential for new forms of interaction especially for collaborative multi-user scenarios. In this paper, we present a way to directly interact with them through live video on mobile devices. We extend the Touch Projector interface to accommodate multiple users by showing individual content on the mobile display that would otherwise clutter the facade's canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting on the facade and (2) solving a 15-puzzle. We gathered informal feedback during the ARS Electronica Festival in Linz, Austria and found that our interaction technique is (1) considered easy-to-learn, but (2) may leave users unaware of the actions of others.

[1]  Mirjam Struppek,et al.  The social potential of Urban Screens , 2006 .

[2]  Odilo Schoch,et al.  My building is my display , 2006 .

[3]  Andreas Butz,et al.  Touch projector: mobile interaction through video , 2010, CHI.

[4]  Daniel Jackson,et al.  Smart Phone Interaction with Registered Displays , 2009, IEEE Pervasive Computing.

[5]  Christa Sommerer,et al.  The Art and Science of Interface and Interaction Design , 2010 .

[6]  Timo Ojala,et al.  MobiSpray: mobile phone as virtual spray can for painting BIG anytime anywhere on anything , 2009, SIGGRAPH '09.

[7]  William J. Mitchell,et al.  Urban pixels: painting the city with light , 2009, CHI.

[8]  Kim Halskov,et al.  Designing urban media façades: cases and challenges , 2010, CHI.

[9]  Matthias Böttger,et al.  Space time play : computer games, architecture and urbanism : the next level , 2007 .

[10]  Christa Sommerer,et al.  Media Facades as Architectural Interfaces , 2008 .

[11]  Tom Barker.  Introduction to Hank Hausler’s book Media Facades: History, Technology and Media Content , 2009 .

[12]  Carmelo Ardito,et al.  Extending large-scale event participation with user-created mobile media on a public display , 2007, MUM.

[13]  Marko Jurmu,et al.  Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays , 2009, OZCHI.

[14]  Tom Barker,et al.  Media facades : history, technology, content , 2009 .

[15]  Kimiya Yamaashi,et al.  Object-oriented video: interaction with real-world objects through live video , 1992, CHI.

[16]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.