Yamove! A Movement Synchrony Game That Choreographs Social Interaction

Movement-based interactive systems for play came into the spotlight over a decade ago, and were met with enthusiasm by the general public as well as the Human-Computer Interaction research community. Yet a decade of research and practice has not fully addressed the challenge of designing for the moving body and play. This thesis argues that often, the role of the technology to sustain the play activity, and to drive the design process, has been over-emphasized, and has resulted in limited design possibilities. This thesis explores an alternative design approach to address the problem through combining the design of the technology with designing aspects of the social and spatial context where the play activity takes place. The work is grounded in an embodied perspective of experience, action, and design. Methodologically, it belongs to the Research through Design tradition (RtD).A core concept and a characterization of design practices are presented as key contributions. The concept of embodied core mechanics is introduced to frame desirable and repeatable movement-based play actions, paying attention to the way these are supported by design resources including rules, physical and digital artifacts, and the physical and spatial arrangement of players and artifacts. The concept was developed during the two main design cases: the Oriboo case, targeting dance games for children, and the PhySeEar case, targeting rehabilitative therapy for the elderly. It was further substantiated in subsequent external design collaborations. To support the design process, this thesis presents embodied sketching: a set of ideation design practices that leverage the embodied experience and enable designers to scrutinize the desired embodied experience early in the design process. Three forms of embodied sketching are presented: embodied sketching for bodystorming, co-designing with users, and sensitizing designers.Through reframing the design task as one of designing and studying embodied core mechanics, this thesis establishes an alternative approach to design for movement-based play in which significant aspects of the embodied play experience, lead, drive, and shape the design process and the design of the technology.

[1]  Katherine Isbister,et al.  Game Usability - Advice from the Experts for Advancing the Player Experience , 2008 .

[2]  Yvonne de Kort,et al.  People, places, and play: player experience in a socio-spatial context , 2008, CIE.

[3]  Barry A. T. Brown,et al.  Designing for crowds , 2010, NordiCHI.

[4]  Shaowen Bardzell,et al.  Immodest Proposals: Research Through Design and Knowledge , 2015, CHI.

[5]  Katherine Isbister,et al.  How to stop being a buzzkill: designing yamove!, a mobile tech mash-up to truly augment social play , 2012, Mobile HCI.

[6]  Marko Turpeinen,et al.  Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[7]  Elena Márquez Segura,et al.  The design space of body games: technological, physical, and social design , 2013, CHI.

[8]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[9]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[10]  Jean Newlove,et al.  Laban for All , 2003 .

[11]  Erik Stolterman,et al.  The Nature of Design Practice and Implications for Interaction Design Research , 2008 .

[12]  Saul Greenberg,et al.  Proxemic Interactions: From Theory to Practice , 2015, Proxemic Interactions.

[13]  Jennifer G. Sheridan,et al.  Designing sports: a framework for exertion games , 2011, CHI.

[14]  Daniel Fallman,et al.  Design-oriented human-computer interaction , 2003, CHI '03.

[15]  J. G. Tanenbaum,et al.  Envisioning the Future of Wearable Play: Conceptual Models for Props and Costumes as Game Controllers , 2015, FDG.

[16]  Katherine Isbister,et al.  Movement-based game guidelines , 2014, CHI.

[17]  B. Buxton The “Natural” Language Of Interaction: A Perspective On Non-Verbal Dialogues , 1989 .

[18]  Nadia Bianchi-Berthouze,et al.  Understanding the Role of Body Movement in Player Engagement , 2012, Hum. Comput. Interact..

[19]  Kristina Höök,et al.  How to stay in the emotional rollercoaster: lessons learnt from designing EmRoll , 2010, NordiCHI.

[20]  Kristina Höök,et al.  On being supple: in search of rigor without rigidity in meeting new design and evaluation challenges for HCI practitioners , 2009, CHI.

[21]  Amy Voida,et al.  Wii all play: the console game as a computational meeting place , 2009, CHI.

[22]  Katherine Isbister,et al.  Is more movement better?: a controlled comparison of movement-based games , 2011, FDG.

[23]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[24]  Elena Márquez Segura,et al.  Enabling Co-Located Physical Social Play: A Framework for Design and Evaluation , 2015, Game User Experience Evaluation.

[25]  Anthony J. Liddicoat,et al.  An Introduction to Conversation Analysis , 2007 .

[26]  Elena Márquez Segura,et al.  Embodied Sketching , 2016, CHI.

[27]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[28]  Annika Waern Chapter Eight – Information Technology in Pervasive Games , 2009 .

[29]  Antony Stephen Reid Manstead,et al.  The social dimension of emotion , 2005 .

[30]  Martin R. Gibbs,et al.  Towards understanding how to design for social play in exertion games , 2009, Personal and Ubiquitous Computing.

[31]  Paul Dourish,et al.  Where the action is , 2001 .

[32]  Robert J. Moore,et al.  "Alone together?": exploring the social dynamics of massively multiplayer online games , 2006, CHI.

[33]  Stuart Reeves,et al.  Designing Interfaces in Public Settings - Understanding the Role of the Spectator in Human-Computer Interaction , 2011, Human-Computer Interaction Series.

[34]  Katherine Isbister,et al.  Scoop!: using movement to reduce math anxiety and affect confidence , 2012, FDG.

[35]  Katherine Isbister,et al.  Emotion and motion: games as inspiration for shaping the future of interface , 2011, INTR.

[36]  Peter Dalsgård,et al.  Performing perception—staging aesthetics of interaction , 2008, TCHI.

[37]  Caroline Hummels,et al.  Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction , 2007, Personal and Ubiquitous Computing.

[38]  Alan Light,et al.  The Vibe History of Hip Hop , 1999 .

[39]  M.M.H. van Best Participatory Gaming Culture: Indie Game Design As Dialogue Between Player & Creator , 2011 .

[40]  Richard Buchanan,et al.  Wicked Problems in Design Thinking , 1992 .

[41]  A. Manstead,et al.  Social context and the experience of emotion , 1996 .

[42]  Kenton O'Hara,et al.  On the naturalness of touchless: Putting the “interaction” back into NUI , 2013, TCHI.

[43]  Jakob Tholander,et al.  Design qualities for whole body interaction: learning from golf, skateboarding and BodyBugging , 2010, NordiCHI.

[44]  Katherine Isbister,et al.  Enabling Social Play: A Framework for Design and Evaluation , 2010, Evaluating User Experience in Games.

[45]  Christopher Cole Gorney,et al.  Hip Hop Dance: Performance, Style, and Competition , 2009 .

[46]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[47]  Katherine Isbister,et al.  Guidelines for the Design of Movement-Based Games and Their Relevance to HCI , 2015, Hum. Comput. Interact..

[48]  Ann Hutchinson Guest Labanotation: The System of Analyzing and Recording Movement , 1987 .

[49]  Jenny Edwards,et al.  Understanding movement for interaction design: frameworks and approaches , 2007, Personal and Ubiquitous Computing.

[50]  Nadia Bianchi-Berthouze,et al.  Stirring up experience through movement in game play: effects on engagement and social behaviour , 2008, CHI.

[51]  Jakob Tholander,et al.  Weather Gods and Fruit Kids - Embodying abstract concepts using tactile feedback and whole body interaction , 2011 .

[52]  Tony P. Pridmore,et al.  Expected, sensed, and desired: A framework for designing sensing-based interaction , 2005, TCHI.

[53]  Donald A. Sch The reflective practitioner: how professionals think in action , 1983 .

[54]  Bart Simon,et al.  Wii are Out of Control: Bodies, Game Screens and the Production of Gestural Excess , 2009 .

[55]  Dan Saffer Designing gestural interfaces , 2009 .

[56]  Emma Westecott,et al.  Independent Game Development as Craft , 2012 .

[57]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.