QUANTITATIVE EVALUATION OF GROUP USER EXPERIENCE IN SMART SPACES

This paper explores the problem of user experience evaluation, in particular the quantitative evaluation of group user experience, in smart spaces. First, the classification and definition of four different categories of user groups are proposed, and the notion of group user experience is introduced. Second, we analyze the quantitative evaluation of group user experience for different types of user groups and establish an evaluation model for group user experience. Particularly, we employ two quantitative social metrics, user rating and user attention duration, as the main criteria for evaluating user experience. Other social factors, such as group interaction and the diversity of group members, are also taken into account to form a general quantitative evaluation model of group user experience for different user groups. Finally, we evaluate the effectiveness of the proposed model with preliminary experiments in a smart museum.

[1]  Sascha Mahlke,et al.  Studying antecedents of emotional experiences in interactive contexts , 2007, CHI.

[2]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[3]  Judith Masthoff,et al.  Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers , 2004, User Modeling and User-Adapted Interaction.

[4]  Linda Hole,et al.  Emotion Sampling and the Product Development Life Cycle , 2008 .

[5]  Dan Cosley,et al.  ArtLinks: fostering social awareness and reflection in museums , 2008, CHI.

[6]  Constantine Stephanidis,et al.  A User-Orientation Evaluation Framework: Assessing Accessibility Throughout the User Experience Lifecycle , 2006, ICCHP.

[7]  R Schulz,et al.  Long-term effects of control and predictability-enhancing interventions: findings and ethical issues. , 1978, Journal of personality and social psychology.

[8]  Richard H. Gutsche.  User experience , 1976, PERV.

[9]  Phoebe Sengers,et al.  The disenchantment of affect , 2008, Personal and Ubiquitous Computing.

[10]  Antonella De Angeli,et al.  A user-centered approach to user modeling , 1999 .

[11]  D. Gilbert,et al.  Focalism: a source of durability bias in affective forecasting. , 2000, Journal of personality and social psychology.

[12]  Uwe Flick,et al.  Designing Qualitative Research , 2008 .

[13]  Timothy D. Wilson,et al.  Miswanting: Some Problems in the Forecasting of Future Affective States , 2000 .

[14]  Virpi Roto,et al.  Towards a shared definition of user experience , 2008, CHI Extended Abstracts.

[15]  William T. Niu,et al.  Smart Environments and their Applications to Cultural Heritage , 2005 .

[16]  Jakob E. Bardram,et al.  The AWARE architecture: supporting context-mediated social awareness in mobile cooperation , 2004, CSCW.

[17]  Judith Masthoff,et al.  In pursuit of satisfaction and the prevention of embarrassment: affective state in group recommender systems , 2006, User Modeling and User-Adapted Interaction.

[18]  Lauralee Alben,et al.  Quality of experience: defining the criteria for effective interaction design , 1996, INTR.

[19]  Jakob E. Bardram,et al.  AwareMedia: a shared interactive display supporting social, temporal, and spatial awareness in surgery , 2006, CSCW '06.

[20]  Gm Wilson,et al.  Investigating the impact of audio degradations on users: subjective vs objective assessment methods , 2000 .

[21]  Andrew Vande Moere,et al.  A Conceptual Model for Evaluating Aesthetic Effect within the User Experience of Information Visualization , 2006, Tenth International Conference on Information Visualisation (IV'06).

[22]  Liliana Ardissono,et al.  Tailoring the Recommendation of Tourist Information to Heterogeneous User Groups , 2001, OHS-7/SC-3/AH-3.

[23]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[24]  B. Hanusa,et al.  Long-term effects of control and predictability-enhancing interventions: findings and ethical issues. , 1978, Journal of personality and social psychology.