Developing practical tools for user experience evaluation: a case from mobile news journalism

We present a questionnaire called Attrak-Work to support the evaluation of user experience of mobile systems in the context of mobile news journalism. We discuss theoretical background of the questionnaire and describe the development process including the field study within which the questionnaire was developed. The presented questionnaire assesses user's perception of the pragmatic (usability and task and goal achievement) and hedonic (stimulation and identification) qualities and an overall judgment of appeal. We used the questionnaire as part of a field study to corroborate and expand the findings of observations and interviews. We found the Attrak-Work questionnaire a useful tool to be used in this manner especially for the evaluation of the hedonic qualities.

[1]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[2]  Steve Benford,et al.  From interaction to trajectories: designing coherent journeys through user experiences , 2009, CHI.

[3]  J. Shim,et al.  AN EMPIRICAL STUDY ON USER SATISFACTION WITH MOBILE BUSINESS APPLICATIONS USE AND HEDONISM , 2006 .

[4]  Michael Burmester,et al.  Hedonic and ergonomic quality aspects determine a software's appeal , 2000, CHI.

[5]  Michael Burmester,et al.  AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität , 2003, MuC.

[6]  Manfred Max Bergman,et al.  7 Quality of Inferences in Mixed Methods Research: Calling for an Integrative Framework , 2008 .

[7]  Pieter Desmet,et al.  Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2005, Funology.

[8]  Robin L. Wakefield,et al.  Mobile computing: a user study on hedonic/utilitarian mobile device usage , 2006, Eur. J. Inf. Syst..

[9]  Sascha Mahlke,et al.  Studying antecedents of emotional experiences in interactive contexts , 2007, CHI.

[10]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[11]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[12]  Young Sam Ryu,et al.  Development of Usability Questionnaires for Electronic Mobile Products and Decision Making Methods , 2005 .

[13]  Heli Väätäjä,et al.  Dimensions of Context Affecting User Experience in Mobile Work , 2009, INTERACT.

[14]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[15]  J. M. Kittross.  The measurement of meaning , 1959 .

[16]  Kevin E. Voss,et al.  Measuring the Hedonic and Utilitarian Dimensions of Attitude: a Generally Applicable Scale , 1997 .

[17]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[18]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[19]  Hans van der Heijden,et al.  Measuring attitudes towards mobile information services: an empirical validation of the HED/UT scale , 2003, ECIS.

[20]  Gilbert Cockton,et al.  Putting Value into E-valu-ation , 2008, Maturing Usability.