A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies

The popularity of computer games has exploded in recent years, yet methods of evaluating user emotional state during play experiences lag far behind. There are few methods of assessing emotional state, and even fewer methods of quantifying emotion during play. This paper presents a novel method for continuously modeling emotion using physiological data. A fuzzy logic model transformed four physiological signals into arousal and valence. A second fuzzy logic model transformed arousal and valence into five emotional states relevant to computer game play: boredom, challenge, excitement, frustration, and fun. Modeled emotions compared favorably with a manual approach, and the means were also evaluated with subjective self-reports, exhibiting the same trends as reported emotions for fun, boredom, and excitement. This approach provides a method for quantifying emotional states continuously during a play experience.

[1]  Catherine C. Marshall,et al.  Designing Qualitative Research , 1996 .

[2]  Peter C. Wright,et al.  Funology: from usability to enjoyment , 2005 .

[3]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[4]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[5]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[6]  T H HOWELL,et al.  The cardiovascular system in old age. , 1949, Medical world.

[7]  J. Lagopoulos.  Electrodermal activity , 2007, Acta Neuropsychiatrica.

[8]  Penelope M. Sanderson,et al.  Exploratory sequential data analysis: exploring continuous observational data , 1996, INTR.

[9]  G. Vossel,et al.  Finally, After Two Decades , 2001 .

[10]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.

[11]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[12]  N. Simionescu,et al.  The Cardiovascular System , 1983 .

[13]  R. Krauss,et al.  Facial and autonomic manifestations of the dimensional structure of emotion , 1984 .

[14]  Donald A. Norman,et al.  Emotion & design: attractive things work better , 2002, INTR.

[15]  Randy J. Pagulayan,et al.  User-centered design in games , 2012 .

[16]  Boriana L. Milenova,et al.  Fuzzy and neural approaches in engineering , 1997 .

[17]  Pieter Desmet,et al.  Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2005, Funology.

[18]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[19]  E. Cox,et al.  Fuzzy fundamentals , 1992, IEEE Spectrum.

[20]  R. Levenson.  Autonomic Nervous System Differences among Emotions , 1992 .

[21]  Continuous and , .

[22]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[23]  Veikko Surakka,et al.  Person-independent estimation of emotional experiences from facial expressions , 2005, IUI '05.

[24]  Charlotte Wiberg,et al.  A Measure of Fun: Extending the scope of web usability , 2003 .

[25]  J. E. Rose,et al.  Autonomic Nervous System Activity Distinguishes Among Emotions , 2009 .

[26]  J. Cacioppo,et al.  Principles of psychophysiology : physical, social, and inferential elements , 1990 .

[27]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[28]  Robert D. Ward,et al.  Physiological responses to different WEB page designs , 2003, Int. J. Hum. Comput. Stud..

[29]  Roel Vertegaal,et al.  Using mental load for managing interruptions in physiologically attentive user interfaces , 2004, CHI EA '04.

[30]  John L. Sibert,et al.  Heart rate variability: indicator of user state as an aid to human-computer interaction , 1998, CHI.

[31]  L. F. Barrett,et al.  Handbook of Emotions , 1993 .

[32]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[33]  Regan L. Mandryk,et al.  Physiological indicators for the evaluation of co-located collaborative play , 2004, CSCW.

[34]  P. De Silva,et al.  Handbook of Cognition and Emotion , 2001 .

[35]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[36]  Gm Wilson,et al.  Investigating the impact of audio degradations on users: subjective vs objective assessment methods , 2000 .

[37]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[38]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  R. Mandryk.  Modeling user emotion in interactive play environments: a fuzzy physiological approach , 2005 .

[40]  A. J. Fridlund,et al.  Guidelines for human electromyographic research. , 1986, Psychophysiology.

[41]  Veikko Surakka,et al.  The effects of affective interventions in human-computer interaction , 2004, Interact. Comput..

[42]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[43]  K. J. Vicente,et al.  Spectral Analysis of Sinus Arrhythmia: A Measure of Mental Effort , 1987, Human factors.

[44]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.