Design of Experience and Flow in Movement-Based Interaction

Movement-based and exertion interfaces assume that their users move. Users have to perform exercises, they have to dance, they have to golf or football, or they want to train particular bodily skills. Many examples of those interfaces exist, sometimes asking for subtle interaction between user and interface and sometimes asking for `brute force' exertion interaction between user and interface. In these interfaces it is often the case that the interface mediates between players of a game. Obviously, one of the players may be a virtual human. We provide a `state of the art survey' of such interfaces and in particular look at intelligent exertion interfaces, interfaces that know about their users and even try to anticipate what their users prepare to do. That is, we embed this interface research in ambient intelligence and entertainment computing research, and the interfaces we consider are not only mediating, but they also `add' intelligence to the game. Other issues that will be discussed are `flow' and `engagement' for exertion interfaces. Intelligent exertion interfaces, being able to know and learn about their users, should also be able to provide means to keep their users engaged and in the flow of the game and entertainment experience. Unlike the situation with traditional desktop game research where we can observe lots of research activity trying to define, interpret and evaluate issues such as `flow' and `immersion', in movement-based interfaces these concepts need to be reconsidered and new ways of evaluation have to be defined.

[1]  James A. Landay,et al.  Design requirements for technologies that encourage physical activity , 2006, CHI.

[2]  Ji-Young Park Ji-Young Park, and June-Ho Yi Gesture Recognition Based Interactive Boxing Game , 2006 .

[3]  J. Murray Hamlet on the Holodeck , 1997 .

[4]  Rosalind W. Picard,et al.  Evaluating affective interactions: Alternatives to asking what users feel , 2005 .

[5]  Anna L. Cox,et al.  Quantifying the experience of immersion in games. , 2006 .

[6]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[7]  Yvonne de Kort,et al.  Fun and Sports: Enhancing the Home Fitness Experience , 2004, ICEC.

[8]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[9]  M. Csíkszentmihályi,et al.  Flow in sports: The keys to optimal experiences and performances. , 1999 .

[10]  F. Tanaka,et al.  Dance interaction with QRIO: a case study for non-boring interaction by using an entrainment ensemble model , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[11]  S. Benford,et al.  Sensible , sensable and desirable : a framework for designing physical interfaces , 2003 .

[12]  Frans Mäyrä,et al.  Fundamental Components of the Gameplay Experience: Analysing Immersion , 2005, DiGRA Conference.

[13]  Masa Inakage,et al.  miXer: the communication entertainment content by using "entrainment phenomenon" and "bio-feedback" , 2007, ACE '07.

[14]  Taku Komura,et al.  NiceMeetVR: facing professional baseball pitchers in the virtual batting cage , 2002, SAC '02.

[15]  H. van Welbergen,et al.  On the timing of gestures of a Virtual Physiotherapist , 2006 .

[16]  James W. Davis,et al.  Virtual PAT: A Virtual Personal Aerobics Trainer , 1998 .

[17]  Perttu Hämäläinen,et al.  Shadow boxer: a physically interactive fitness game , 2004, NordiCHI '04.

[18]  Benjamin Lok,et al.  Virtual Human Physiotherapist Framework for Personalized Training and Rehabilitation , 2005 .

[19]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Desney S. Tan,et al.  Playing with your brain: brain-computer interfaces and games , 2007, ACE '07.

[21]  Antinus Nijholt,et al.  Don’t Give Yourself Away: Cooperation Revisited , 2008 .

[22]  Stefan Agamanolis,et al.  Exertion interfaces , 2008, CHI Extended Abstracts.

[23]  M. Csíkszentmihályi Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[24]  Anton Nijholt,et al.  Towards Bi-directional Dancing Interaction , 2006, ICEC.

[25]  Rik Van de Walle,et al.  Multichannel distribution for universal multimedia access in home media gateways , 2006 .

[26]  Adrian David Cheok,et al.  Age Invaders: Inter-generational Mixed Reality Family Game , 2006, Int. J. Virtual Real..

[27]  Stefan Agamanolis,et al.  Exertion interfaces: sports over a distance for social bonding and fun , 2003, CHI '03.

[28]  Masa Inakage,et al.  MiXer: the communication entertainment content by using "entrainment phenomenon" and "bio-feedback" , 2007 .

[29]  Jasper Bragt Do Exertion Interfaces Provide Better Exercise Environments , 2005 .

[30]  Marek P. Michalowski,et al.  A dancing robot for rhythmic social interaction , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[31]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[32]  Juhani Heinilä,et al.  Fitness computer game with a bodily user interface , 2003, ICEC.

[33]  Anton Nijholt,et al.  Playing and Cheating in Ambient Entertainment , 2007, ICEC.

[34]  Jenny Edwards,et al.  Introduction to the special issue on movement-based interaction , 2007, Personal and Ubiquitous Computing.

[35]  Philip Hingston,et al.  Considerations for the design of exergames , 2007, GRAPHITE '07.

[36]  Matthias Rauterberg,et al.  Entertainment Computing – ICEC 2007 , 2007, Lecture Notes in Computer Science.

[37]  Anton Nijholt,et al.  Mutually Coordinated Anticipatory Multimodal Interaction , 2008, COST 2102 Workshop.

[38]  Martin R. Gibbs,et al.  Remote impact: shadowboxing over a distance , 2009, CHI Extended Abstracts.

[39]  Anton Nijholt,et al.  Beyond the beat: modelling intentions in a virtual conductor , 2008, INTETAIN '08.

[40]  Hanna Strömberg,et al.  A group game played in interactive virtual space: design and evaluation , 2002, DIS '02.