Is there a universal instrument for measuring interactive information retrieval?: the case of the user engagement scale

This paper examines the validity of the User Engagement Scale (UES). Originally developed and tested in e-shopping, the scale was administered to users of a multimedia webcast system in an experimental setting. Factor analysis examined the structure and loadings of 31 items. As in previous research, a six-factor solution was found. However, the number of items was reduced and one of the original sub-scales (Felt Involvement) was eliminated. These results are examined contextually by comparing the current study with previous research. The findings discuss the feasibility of a universal measure of user engagement in Interactive Information Retrieval (IIR).

[1]  E. Toms,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[2]  Joseph J. Martocchio,et al.  Microcomputer playfulness: development of a measure with workplace implications , 1992 .

[3]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[4]  Heather O'Brien,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[5]  Steven Pace,et al.  A grounded theory of the flow experiences of Web users , 2004, Int. J. Hum. Comput. Stud..

[6]  Subhash Sharma,et al.  Assessing generalizability of scales used in cross-national research , 2003 .

[7]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[8]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[9]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[10]  Jane Webster,et al.  Perceived disorientation: an examination of a new measure to assess web design effectiveness , 2001, Interact. Comput..

[11]  R. Peterson.  Constructing Effective Questionnaires , 1999 .

[12]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[13]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[14]  T. E. Dinero.  Scale development. , 1996, Journal of health & social policy.