Designing Interfaces in Public Settings - Understanding the Role of the Spectator in Human-Computer Interaction

The rapidly increasing reach of computation into our everyday public settings presents new and significant challenges for the design of interfaces. One key feature of these settings is the increased presence of third parties to interaction, watching or passing-by as conduct with an interface takes place. This thesis assumes a performative perspective on interaction in public, presenting a framework derived from four empirical studies of interaction in a diverse series of public places---museums and galleries, city streets and funfairs---as well as observations on a variety of computer science, art and sociological literatures. As these settings are explored, a number of basic framework concepts are built up: * The first study chapter presents a deployment of an interactive exhibit within an artistic installation, introducing a basic division of roles and the ways in which visitors may be seen as `audience' to manipulations of interactive devices by `participants'. It also examines how visitors in an audience role may transition to active participant and vice versa. * The second study chapter describes a storytelling event that employed a torch-based interface. This chapter makes a distinction between non-professional and professional members of settings, contrasting the role of `actor' with that of participants. * The third study chapter examines a series of scientific and artistic performance events that broadcast live telemetry data from a fairground ride to a watching audience. The study expands the roles introduced in previous chapters through making a further distinction between `behind-the-scenes'---in which `orchestrators' operate---and `centre-stage' settings---in which actors present the rider's experience to the audience. * The final study chapter presents a performance art game conducted on city streets, in which participants follow a series of often ambiguous clues in order to lead them to their goal. This chapter introduces a further `front-of-house' setting, the notion of a circumscribing performance `frame' in which the various roles are situated, and the additional role of the `bystander' as part of this. These observations are brought together into a design framework which analyses other literature to complement the earlier studies. This framework seeks to provide a new perspective on and language for human-computer interaction (HCI), introducing a series of sensitising concepts, constraints and strategies for design that may be employed in order to approach the various challenges presented by interaction in public settings.

[1]  Allison Druin,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[2]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[3]  Paul Dourish,et al.  Re-place-ing space: the roles of place and space in collaborative systems , 1996, CSCW '96.

[4]  Alex Pentland,et al.  Augmented Performance in Dance and Theater , 1999 .

[5]  Liam J. Bannon,et al.  Shaping experiences in the hunt museum: a design case study , 2004, DIS '04.

[6]  L. Blud Social interaction and learning among family groups visiting a museum , 1990 .

[7]  Austin Henderson,et al.  Making sense of sensing systems: five questions for designers and researchers , 2002, CHI.

[8]  Tony P. Pridmore,et al.  Expected, sensed, and desired: A framework for designing sensing-based interaction , 2005, TCHI.

[9]  J. Huizinga Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[10]  Steve Benford,et al.  Collaboratively improvising magic: An approach to managing participation in an on-line drama , 2001, ECSCW.

[11]  Annika Waern,et al.  Participant Roles in Socially Expanded Games , 2006 .

[12]  Jonathan Arnowitz,et al.  Michel Waisvisz: the man and the hands , 2005, INTR.

[13]  John Bale,et al.  The Spatial Development of the Modern Stadium , 1993 .

[14]  C. Heath,et al.  Exhibiting Interaction: Conduct and Collaboration in Museums and Galleries , 2001 .

[15]  Jon Hindmarsh,et al.  Engaging constable: revealing art with new technology , 2007, CHI.

[16]  Matthew Chalmers,et al.  Gaming on the Edge: Using Seams in Pervasive Games , 2005 .

[17]  Steve Benford,et al.  Where on-line meets on the streets: experiences with mobile mixed reality games , 2003, CHI '03.

[18]  Stephen Bitgood ENVIRONMENTAL PSYCHOLOGY IN MUSEUMS, ZOOS, AND OTHER EXHIBITION CENTERS , 2002 .

[19]  Alan J. Dix,et al.  Understanding Interaction in Ubiquitous Guerrilla Performances in Playful Arenas , 2004, BCS HCI.

[20]  Stefan Rennick Egglestone,et al.  Augmenting amusement rides with telemetry , 2007, ACE '07.

[21]  E. Hutchins Cognition in the wild , 1995 .

[22]  Sara Price,et al.  Data recording and reuse: Supporting research and digitally augmented learning experiences , 2004 .

[23]  James W. Davis,et al.  The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment , 1999, Presence.

[24]  Duncan Rowland,et al.  Interweaving mobile games with everyday life , 2006, CHI.

[25]  Steve Benford,et al.  A poetry performance in a collaborative virtual environment , 2000 .

[26]  Dan Shapiro,et al.  Faltering from ethnography to design , 1992, CSCW '92.

[27]  Mark Levine,et al.  Rethinking Bystander Nonintervention: Social Categorization and the Evidence of Witnesses at the James Bulger Murder Trial , 1999 .

[28]  Antti Oulasvirta,et al.  Supporting the shared experience of spectators through mobile group media , 2005, GROUP.

[29]  Susan Leigh Star,et al.  The Structure of Ill-Structured Solutions: Boundary Objects and Heterogeneous Distributed Problem Solving , 1989, Distributed Artificial Intelligence.

[30]  Robert J. Moore,et al.  "Alone together?": exploring the social dynamics of massively multiplayer online games , 2006, CHI.

[31]  Blair MacIntyre,et al.  Wizard of Oz interfaces for mixed reality applications , 2005, CHI EA '05.

[32]  Steve Benford,et al.  Engaging Augmented Reality in Public Places , 2005 .

[33]  Dennis Kennedy,et al.  Sports and Shows: Spectators in Contemporary Culture , 2001, Theatre Research International.

[34]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[35]  H. Geser Towards a Sociological Theory of the Mobile Phone , 2004 .

[36]  Ian Alexander Designing Collaborative Systems. A Practical Guide to Ethnography , 2003, Eur. J. Inf. Syst..

[37]  Duncan Rowland,et al.  The Error of Our Ways: The Experience of Self-Reported Position in a Location-Based Game , 2004, UbiComp.

[38]  Tony P. Pridmore,et al.  Visually-tracked Flashlights as Interaction Devices , 2003, INTERACT.

[39]  Steve Benford,et al.  The augurscope: a mixed reality interface for outdoors , 2002, CHI.

[40]  Marina Jirotka,et al.  Unpacking collaboration: the interactional organisation of trading in a city dealing room , 1993, Computer Supported Cooperative Work (CSCW).

[41]  Jon Hindmarsh,et al.  Interaction in Isolation: The Dislocated World of the London Underground Train Driver , 1999 .

[42]  Richard I. Anderson,et al.  Conversations with Clement Mok and Jakob Nielsen, and with Bill Buxton and Clifford Nass , 2000, INTR.

[43]  Rafael Ballagas,et al.  REXplorer: a mobile, pervasive spell-casting game for tourists , 2007, CHI Extended Abstracts.

[44]  T. Winograd,et al.  From Computing Machinery to Interaction Design , 2004 .

[45]  Edward Lank,et al.  Renegade gaming: practices surrounding social use of the Nintendo DS handheld gaming system , 2008, CHI.

[46]  Paul Tennent,et al.  From ReplayTool to Digital Replay System , 2008 .

[47]  C. Heath,et al.  Technology and social interaction: the emergence of 'workplace studies'. , 2000, The British journal of sociology.

[48]  Steven M. Seitz,et al.  Techniques for interactive audience participation , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[49]  P. McCorduck Aaron's Code , 1990 .

[50]  Y. Rogers,et al.  Interaction Design , 2002 .

[51]  R. Watson,et al.  Ethnomethodology, consciousness and self , 1998 .

[52]  Wolfgang Kemp,et al.  Only Connect...: Art and the Spectator in the Italian Renaissance , 1994 .

[53]  David Sudnow,et al.  Ways of the hand : the organization of improvised conduct , 1978 .

[54]  Perttu Hämäläinen,et al.  Martial arts in artificial reality , 2005, CHI.

[55]  Austin Henderson,et al.  Your place or mine? Learning from long-term use of Audio-Video communication , 1996, Computer Supported Cooperative Work (CSCW).

[56]  Christian Heath,et al.  Technology in Action: The collaborative production of computer commands , 2000 .

[57]  H. Blumer,et al.  Symbolic Interactionism: Perspective and Method , 1988 .

[58]  Duncan Rowland,et al.  Life on the edge: supporting collaboration in location-based experiences , 2005, CHI.

[59]  Joseph A. Paradiso,et al.  The Brain Opera Technology: New Instruments and Gestural Sensors for Musical Interaction and Performance , 1999 .

[60]  Steve Benford,et al.  Orchestrating a mixed reality performance , 2001, CHI.

[61]  Steve Benford,et al.  A Spatial Model of Interaction in Large Virtual Environments , 1993, ECSCW.

[62]  M. Moss,et al.  How Telecommunications Systems are Transforming Urban Spaces , 1999 .

[63]  Ernest A. Edmonds,et al.  Approaches to interactive art systems , 2004, GRAPHITE '04.

[64]  Allison Woodruff,et al.  Sotto voce: exploring the interplay of conversation and mobile audio spaces , 2002, CHI.

[65]  Barry A. T. Brown,et al.  Experts at Play , 2009 .

[66]  Tony P. Pridmore,et al.  Camping in the digital wilderness: tents and flashlights as interfaces to virtual worlds , 2002, CHI Extended Abstracts.

[67]  Karen Ruhleder,et al.  Capturing complex, distributed activities: video-based interaction analysis as a component of workplace ethnography , 1997 .

[68]  Philip E. Agre,et al.  Changing Places: Contexts of Awareness in Computing , 2001, Hum. Comput. Interact..

[69]  Oskar Juhlin,et al.  Watching the cars go round and round: designing for active spectating , 2006, CHI.

[70]  S. Macdonald,et al.  Behind the Scenes at the Science Museum , 2002 .

[71]  Ravi Jain,et al.  CodeBLUE: a Bluetooth interactive dance club system , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[72]  Eduardo Kac,et al.  Ornitorrinco and Rara Avis: Telepresence Art on the Internet , 2017 .

[73]  Paul Dourish,et al.  Implications for design , 2006, CHI.

[74]  Duncan Rowland,et al.  Uncle Roy All Around You: Implicating the City in a Location-Based Performance , 2004 .

[75]  Steve Benford,et al.  Orchestrating a mixed reality game 'on the ground' , 2004, CHI.

[76]  Annika Wærn,et al.  Prosopopeia: experiences from a pervasive Larp , 2006, ACE '06.

[77]  Charles Rosen,et al.  Piano notes : the hidden world of the pianist , 2004 .

[78]  Pai H. Chou,et al.  A wearable wireless sensor platform for interactive dance performances , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications (PERCOM'06).

[79]  G. Jefferson Glossary of transcript symbols with an introduction , 2004 .

[80]  Tim Kroenert The Hard Sell , 2009 .

[81]  Steve Benford,et al.  Ambiguity as a resource for design , 2003, CHI '03.

[82]  Jonathan Grudin,et al.  The computer reaches out: the historical continuity of interface design , 1989, CHI '90.

[83]  John Bowers,et al.  Simple interfaces to complex sound in improvised music , 2000, CHI Extended Abstracts.

[84]  Steve Benford,et al.  Supporting ethnographic studies of ubiquitous computing in the wild , 2006, DIS '06.

[85]  Annika Wærn,et al.  Involving non-players in pervasive games , 2005, Critical Computing.

[86]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[87]  Joseph A. Paradiso,et al.  Instrumented Footwear for Interactive Dance , 1998 .

[88]  Matthew Chalmers,et al.  Sharing the Square: Collaborative Leisure in the City Streets , 2005, ECSCW.

[89]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[90]  Christian Heath,et al.  Collaboration and controlCrisis management and multimedia technology in London Underground Line Control Rooms , 1992, Computer Supported Cooperative Work (CSCW).

[91]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[92]  Matthew Chalmers,et al.  Seamful interweaving: heterogeneity in the theory and design of interactive systems , 2004, DIS '04.

[93]  Mark Levine,et al.  Rethinking Bystander Nonintervention: Social Categorization and the Evidence of Witnesses at the James Bulger Murder Trial , 1999 .

[94]  Allison Woodruff,et al.  Revisiting the visit:: understanding how technology can shape the museum visit , 2002, CSCW '02.

[95]  Tom Rodden,et al.  Exploding the interface: experiences of a CSCW network , 1993, INTERCHI.

[96]  Ng Kher Hui,et al.  Situating Historical Events through Mixed Reality: Adult-Child Interactions in the Storytent , 2003 .

[97]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.

[98]  E. Edmonds,et al.  The Creative Process Where the Artist is Amplified or Superseded by the Computer , 1973 .

[99]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[100]  Steve Benford,et al.  Formalising Performative Interaction , 2005, DSV-IS.

[101]  Tony P. Pridmore,et al.  Interactive flashlights in special needs education , 2007, Digit. Creativity.

[102]  Steve Benford,et al.  Assembling History: Achieving Coherent Experiences with Diverse Technologies , 2003, ECSCW.

[103]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[104]  Carl Gutwin,et al.  DJs' perspectives on interaction and awareness in nightclubs , 2006, DIS '06.

[105]  Richard Wiseman,et al.  Magic in Theory: An Introduction to the Theoretical and Psychological Elements of Conjuring , 2005 .

[106]  M. B. Alt Evaluating Didactic Exhibits: A Critical Look at Shettel's Work , 1977 .

[107]  Tom Rodden,et al.  Moving out from the control room: ethnography in system design , 1994, CSCW '94.

[108]  Bruce H. Thomas,et al.  First Person Indoor/Outdoor Augmented Reality Application: ARQuake , 2002, Personal and Ubiquitous Computing.

[109]  Paul Dourish,et al.  Where the action is , 2001 .

[110]  Yvonne Rogers,et al.  The Periscope: supporting a computer enhanced field trip for children , 2003, Personal and Ubiquitous Computing.

[111]  Steve Benford,et al.  The Frame of the Game: Blurring the Boundary between Fiction and Reality in Mobile Experiences , 2006, CHI 2006.

[112]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[113]  Wei Liu,et al.  Human Pacman: a sensing-based mobile entertainment system with ubiquitous computing and tangible interaction , 2003, NetGames '03.

[114]  Jason E. Stewart,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[115]  Timo Ojala,et al.  MobiLenin combining a multi-track music video, personal mobile phones and a public display into multi-user interactive entertainment , 2005, MULTIMEDIA '05.

[116]  Jason Cleverly,et al.  Creating assemblies:: aboard the Ghost Ship , 2002, CSCW '02.

[117]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[118]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[119]  B. Asher The Professional Vision , 1994 .

[120]  C. Heath,et al.  Crafting participation: designing ecologies, configuring experience , 2002 .

[121]  Lars Erik Holmquist,et al.  "Why Is Everyone Inside Me?!" Using Shared Displays in Mobile Computer Games , 2004, ICEC.

[122]  Steve Benford,et al.  Can you see me now? , 2006, TCHI.

[123]  Flavia Sparacino,et al.  The Museum Wearable: real-time sensor-driven understanding of visitors' interests for personalized visually-augmented museum experiences , 2002 .

[124]  Steve Benford,et al.  The Cooperative Work of Gaming: Orchestrating a Mobile SMS Game , 2007, Computer Supported Cooperative Work (CSCW).

[125]  Bernard McKenna,et al.  Information Arts: Intersections of Art, Science and Technology , 2004 .

[126]  James D. Hollan,et al.  Strategic directions in human-computer interaction , 1996, CSUR.

[127]  C. Heath,et al.  Analysing Interaction: video, ethnography and situated conduct , 2002 .

[128]  Stefan Rennick Egglestone,et al.  Performing thrill: designing telemetry systems and spectator interfaces for amusement rides , 2008, CHI.

[129]  E. Goffman Frame analysis: An essay on the organization of experience , 1974 .

[130]  Steve Benford,et al.  Hitchers: Designing for Cellular Positioning , 2006, UbiComp.

[131]  Liam J. Bannon,et al.  Workplace Studies: Situating workplace studies within the human-computer interaction field , 2000 .

[132]  S Yarrow,et al.  Hard sell. , 1994, Nursing times.

[133]  Matthew Chalmers,et al.  Lessons from the lighthouse: collaboration in a shared mixed reality system , 2003, CHI '03.

[134]  Tony P. Pridmore,et al.  The spatial character of sensor technology , 2006, DIS '06.

[135]  G. Marx Murky conceptual waters: The public and the private , 2001, Ethics and Information Technology.

[136]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.