Design representations of moving bodies for interactive, motion-sensing spaces

This paper describes the development and use of a set of design representations of moving bodies in the design of Bystander, a multi-user, interactive, immersive artwork built on video-based, motion-sensing technology. We extended the traditional user-centred design tools of personas and scenarios to explicitly address human movement characteristics embedded in social interaction. A set of corresponding movement schemas in Labanotation was constructed to visually represent the spatial and social interaction of multiple users over time. Together these three design representations of moving bodies were used to enable the design team to work with the aspects of human movement relevant to Bystander and to ensure that the system could respond in a coherent and robust manner to the shifting configurations of visitors in the space. They also supported two experiential methods of design reflection-in-action-enactment and immersion-that were vital for grounding designers' understandings of the specific interactive nature of the work in their own sensing, feeling and moving bodies.

[1]  Neil Gershenfeld,et al.  An installation of interactive furniture , 2000, IBM Syst. J..

[2]  Mads Vedel Jensen,et al.  A physical approach to tangible interaction design , 2007, TEI.

[3]  Olav W. Bertelsen,et al.  Proceedings of the Second Nordic Conference on Human-Computer Interaction 2002, Aarhus, Denmark, October 19-23, 2002 , 2002, NordiCHI.

[4]  Pelle Ehn,et al.  From System Descriptions to Scripts for Action , 1992 .

[5]  Giorgio De Michelis,et al.  Opening the Digital Box for Design Work: Supporting Performative Interactions, Using Inspirational Materials and Configuring of Place , 2007, The Disappearing Computer.

[6]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[7]  R. Laban,et al.  The mastery of movement , 1950 .

[8]  S Sietske Klooster,et al.  Designing products as an integral part of choreography of interaction : the product's form as an integral part of movement , 2005 .

[9]  Brenda Laurel,et al.  Design Research: Methods and Perspectives , 2003 .

[10]  Toni Robertson,et al.  Labanotation for design of movement-based interaction , 2005 .

[11]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[12]  Goran Vučković,et al.  Human Activities at Different Levels of Detail , 2003 .

[13]  Donald A. Sch.  The reflective practitioner: how professionals think in action , 1983 .

[14]  Carlo Jacucci.  Guiding design with approaches to masked performance , 2006, Interact. Comput..

[15]  Tim Mansfield,et al.  Designing an immersive environment for public use , 2006, PDC '06.

[16]  Susanne Bødker,et al.  Understanding Representation in Design , 1998, Hum. Comput. Interact..

[17]  Ann Hutchinson Guest.  Dance notation : the process of recording movement on paper , 1986 .

[18]  Jacob Buur,et al.  Hands-only scenarios and video action walls: novel methods for tangible user interaction design , 2004, DIS '04.

[19]  C. Heath,et al.  Crafting participation: designing ecologies, configuring experience , 2002 .

[20]  Toni Robertson,et al.  Designing a movement-based interactive experience using empirically derived personas and scenarios , 2005 .

[21]  Morten Kyng,et al.  Creating contexts for design , 1995 .

[22]  Mark Blythe.  Pastiche scenarios , 2004, INTR.

[23]  Eva Brandt,et al.  Evoking the future: Drama and props in user centered design , 2000 .

[24]  Kristina Höök,et al.  Sense and sensibility: evaluation and interactive art , 2003, CHI '03.

[25]  Ann Hutchinson Guest.  Choreographics: A Comparison of Dance Notation Systems from the Fifteenth Century to the Present , 1991, Dance Research Journal.

[26]  Giulio Jacucci,et al.  Acting to know: improving creativity in the design of mobile services by using performances , 2002, Creativity & Cognition.

[27]  Giulio Jacucci,et al.  Imagining and experiencing in design, the role of performances , 2002, NordiCHI '02.

[28]  John M. Carroll,et al.  Five reasons for scenario-based design , 2000, Interact. Comput..

[29]  T. Robertson,et al.  Experiential Bodily Knowing as a Design (Sens)-ability in Interaction Design , 2007 .

[30]  Jin Moen,et al.  Towards people based movement interaction and kinaesthetic interaction experiences , 2005, Critical Computing.

[31]  Caroline Hummels,et al.  Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction , 2007, Personal and Ubiquitous Computing.

[32]  Jennie Carroll,et al.  Acting out the future: a process for envisionment , 2003, ECIS.

[33]  Jin Kjölberg,et al.  Designing full body movement interaction using modern dance as a starting point , 2004, DIS '04.

[34]  Jason Cleverly,et al.  Creating Assemblies in Public Environments: Social Interaction, Interactive Exhibits and CSCW , 2005, Computer Supported Cooperative Work (CSCW).

[35]  Antti Oulasvirta,et al.  Understanding contexts by being there: case studies in bodystorming , 2003, Personal and Ubiquitous Computing.

[36]  Steve Howard,et al.  Provoking Innovation: Acting-out in Contextual Scenarios , 2002 .

[37]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[38]  John M. Carroll,et al.  Making use: scenarios and scenario-based design , 2000, DIS '00.

[39]  Guillermo Fernández,et al.  Interactive exhibits: how visitors respond , 2000 .

[40]  Margot Brereton,et al.  Meaning in Movement: A Gestural Design Game , 2004 .

[41]  Ann Hutchinson Guest,et al.  Labanotation : or, Kinetography Laban : the system of analyzing and recording movement , 1970 .

[42]  Susanne Bødker,et al.  Scenarios in user-centred design-setting the stage for reflection and action , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[43]  Steve Sato,et al.  Methods & tools: Playacting and focus troupes:: theater techniques for creating quick, intense, immersive, and engaging focus group sessions , 1999, INTR.

[44]  Jin Moen,et al.  From hand-held to body-worn: embodied experiences of the design and use of a wearable movement-based interaction concept , 2007, TEI.

[45]  Lene Nielsen,et al.  From user to character: an investigation into user-descriptions in scenarios , 2002, DIS '02.

[46]  Jacob Buur,et al.  Designing the user actions in tangible interaction , 2005, Critical Computing.

[47]  Bill Verplank,et al.  Actors, hairdos & videotape—informance design , 1994, CHI Conference Companion.

[48]  Giulio Jacucci,et al.  Everyday Life as a Stage in Creating and Performing Scenarios for Wireless Devices , 2002, Personal and Ubiquitous Computing.

[49]  Veikko Ikonen,et al.  Interactive scenarios—building ubiquitous computing concepts in the spirit of participatory design , 2004, Personal and Ubiquitous Computing.

[50]  Jenny Edwards,et al.  The feel dimension of technology interaction: exploring tangibles through movement and touch , 2007, TEI.

[51]  Thecla Schiphorst,et al.  Between Bodies: using Experience Modeling to Create Gestural Protocols for Physiological Data Transfer , 2004 .

[52]  Joep W. Frens,et al.  Interaction relabelling and extreme characters: methods for exploring aesthetic interactions , 2000, DIS '00.

[53]  Jonathan Grudin,et al.  Personas: practice and theory , 2003, DUX '03.

[54]  E. Edmonds,et al.  Understanding the experience of interactive art: Iamascope in Beta_space , 2005 .

[55]  Jonathan Grudin,et al.  Personas, Participatory Design and Product Development: An Infrastructure for Engagement , 2002 .

[56]  George Poonkhin Khut,et al.  Evolving creative practice: a reflection on working with audience experience in Cardiomorphologies , 2005 .

[57]  Frank Vetere,et al.  Visualizing use context with picture scenarios in the design process , 2005, Mobile HCI.

[58]  Brigid Costello,et al.  Collaborative analysis framework for evaluating interactive art experience , 2006 .

[59]  Perttu Hämäläinen,et al.  Describing children's intuitive movements in a perceptive adventure game , 2004 .

[60]  C. Heath,et al.  Exhibiting Interaction: Conduct and Collaboration in Museums and Galleries , 2001 .

[61]  Toni Robertson,et al.  Making Strange with the Falling Body in Interactive Technology Design , 2007 .

[62]  Dag Svanæs,et al.  Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems , 2004, CHI.

[63]  Andrew Clement.  PDC 2004 : artful integration : interweaving media, materials, and practices : proceedings of the eighth Participatory Design Conference 2004, July 27-31, 2004, Toronto, Canada , 2004 .