Observations on Experience and Flow in Movement-Based Interaction

Movement-based interfaces assume that their users move. Users have to perform exercises, they have to dance, they have to golf or football, or they want to train particular bodily skills. Many examples of those interfaces exist, sometimes asking for subtle interaction between user and interface and sometimes asking for ‘brute force’ interaction between user and interface. Often these interfaces mediate between players of a game. Obviously, one of the players may be a virtual human. We embed this interface research in ambient intelligence and entertainment computing research, and the interfaces we consider are not only mediating, but they also ‘add’ intelligence to the interaction. Intelligent movement-based interfaces, being able to know and learn about their users, should also be able to provide means to keep their users engaged in the interaction. Issues that will be discussed in this chapter are ‘flow’ and ‘immersion’ for movement-based interfaces and we look at the possible role of interaction synchrony to measure and support engagement.

[1]  Nadia Bianchi-Berthouze,et al.  Does Body Movement Engage You More in Digital Game Play? and Why? , 2007, ACII.

[2]  Taku Komura,et al.  NiceMeetVR: facing professional baseball pitchers in the virtual batting cage , 2002, SAC '02.

[3]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yvonne de Kort,et al.  Fun and Sports: Enhancing the Home Fitness Experience , 2004, ICEC.

[5]  Lennart E. Nacke,et al.  Wiimote vs. controller: electroencephalographic measurement of affective gameplay interaction , 2010, Future Play.

[6]  F. Tanaka,et al.  Dance interaction with QRIO: a case study for non-boring interaction by using an entrainment ensemble model , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[7]  Anton Nijholt,et al.  Mutually Coordinated Anticipatory Multimodal Interaction , 2008, COST 2102 Workshop.

[8]  Anton Nijholt,et al.  Playing and Cheating in Ambient Entertainment , 2007, ICEC.

[9]  Anton Nijholt,et al.  Beyond the beat: modelling intentions in a virtual conductor , 2008, INTETAIN '08.

[10]  James A. Landay,et al.  Design requirements for technologies that encourage physical activity , 2006, CHI.

[11]  Desney S. Tan,et al.  Playing with your brain: brain-computer interfaces and games , 2007, ACE '07.

[12]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[13]  Karolien Poels,et al.  Measuring the experience of digital game enjoyment , 2008 .

[14]  Frans Mäyrä,et al.  Fundamental Components of the Gameplay Experience: Analysing Immersion , 2005, DiGRA Conference.

[15]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[16]  Trish Gorely,et al.  BIOS Instant Notes in Sport and Exercise Psychology , 2004 .

[17]  Hanna Strömberg,et al.  A group game played in interactive virtual space: design and evaluation , 2002, DIS '02.

[18]  Jenny Edwards,et al.  Introduction to the special issue on movement-based interaction , 2007, Personal and Ubiquitous Computing.

[19]  Adrian David Cheok,et al.  Age Invaders: Inter-generational Mixed Reality Family Game , 2006, Int. J. Virtual Real..

[20]  Stefan Agamanolis,et al.  Exertion interfaces: sports over a distance for social bonding and fun , 2003, CHI '03.

[21]  Masa Inakage,et al.  MiXer: the communication entertainment content by using "entrainment phenomenon" and "bio-feedback" , 2007 .

[22]  Martin R. Gibbs,et al.  Remote impact: shadowboxing over a distance , 2008, SIGGRAPH '08.

[23]  H. van Welbergen,et al.  On the timing of gestures of a Virtual Physiotherapist , 2006 .

[24]  Philip Hingston,et al.  Considerations for the design of exergames , 2007, GRAPHITE '07.

[25]  Paul A. Cairns,et al.  Behaviour, realism and immersion in games , 2005, CHI Extended Abstracts.

[26]  James W. Davis,et al.  Virtual PAT: A Virtual Personal Aerobics Trainer , 1998 .

[27]  Perttu Hämäläinen,et al.  Shadow boxer: a physically interactive fitness game , 2004, NordiCHI '04.

[28]  Lennart E. Nacke,et al.  Electroencephalographic Assessment of Player Experience , 2011 .

[29]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[30]  Marek P. Michalowski,et al.  A dancing robot for rhythmic social interaction , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[31]  W. IJsselsteijn,et al.  Exploring Behavioral Expressions of Player Experience in Digital Games , 2008 .

[32]  Anton Nijholt,et al.  Towards Bi-directional Dancing Interaction , 2006, ICEC.

[33]  Martin R. Gibbs,et al.  Remote impact: shadowboxing over a distance , 2008, CHI Extended Abstracts.

[34]  Juhani Heinilä,et al.  Fitness computer game with a bodily user interface , 2003, ICEC.

[35]  Wei Liu,et al.  Human Pacman: a mobile, wide-area entertainment system based on physical, social, and ubiquitous computing , 2004, Personal and Ubiquitous Computing.

[36]  Martin R. Gibbs,et al.  Considerations for the design of networked exertion interactions , 2010, Int. J. Arts Technol..

[37]  M. Csíkszentmihályi,et al.  Flow in sports: The keys to optimal experiences and performances. , 1999 .

[38]  D. Kort,et al.  Digital Games as Social Presence Technology: Development of the Social Presence in Gaming Questionnaire (SPGQ) , 2007 .

[39]  Dhananjoy Shaw,et al.  Sport and exercise psychology , 2016 .

[40]  J. Murray.  Hamlet on the Holodeck , 1997 .

[41]  Giuseppe Riva,et al.  Being there : the experience of presence in mediated environments , 2003 .

[42]  Anna L. Cox,et al.  Quantifying the experience of immersion in games. , 2006 .

[43]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[44]  T. C. Nicholas Graham,et al.  Using games to increase exercise motivation , 2007, Future Play.

[45]  Nadia Bianchi-Berthouze,et al.  Evaluating Exertion Games , 2010, Evaluating User Experience in Games.

[46]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[47]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[48]  Nadia Bianchi-Berthouze,et al.  Stirring up experience through movement in game play: effects on engagement and social behaviour , 2008, CHI.