Developing and evaluating a reliable measure of user engagement

Increased emphasis on user experiences with technology demonstrates that systems must be not only usable, but engaging. Engagement, defined as a quality of user experience, is a multidimensional construct characterized by aesthetic appeal, novelty, perceived challenge, feedback and control, attention, motivation, and affect. To measure engagement, we developed a multidimensional instrument and surveyed 440 online shoppers to assess its reliability and construct validity. Results of exploratory factor analysis showed that engagement is comprised of six distinct factors: perceived usability, aesthetics, focused attention, involvement, novelty, and endurability.

[1]  Carol Collier Kuhlthau.  Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[2]  Jinwoo Kim,et al.  Critical factors for the aesthetic fidelity of web pages: empirical studies with professional web designers and users , 2004, Interact. Comput..

[3]  Marcel Creemers,et al.  Understanding online purchase intentions: contributions from technology and trust perspectives , 2003, Eur. J. Inf. Syst..

[4]  J. B. Kernan,et al.  On the Meaning of Leisure: An Investigation of Some Determinants of the Subjective Experience , 1983 .

[5]  Yuping Liu,et al.  Developing a scale to measure the interactivity of websites , 2003, Journal of Advertising Research.

[6]  Yu-Chen Chen,et al.  Extrinsic versus intrinsic motivations for consumers to shop on-line , 2005, Inf. Manag..

[7]  T. Reio.  EFFECTS OF CURIOSITY ON SOCIALIZATION-RELATED LEARNING AND JOB PERFORMANCE IN ADULTS , 1997 .

[8]  K. Ruyter,et al.  What drives consumers to shop online? A literature review , 2004 .

[9]  Tom Carey,et al.  Engagement as a Design Concept for Multimedia , 1995 .

[10]  Ming-Hui Huang,et al.  Designing website attributes to induce experiential encounters , 2003, Comput. Hum. Behav..

[11]  R. Vallerand,et al.  On the Assessment of Situational Intrinsic and Extrinsic Motivation: The Situational Motivation Scale (SIMS) , 2000 .

[12]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[13]  Jinwoo Kim,et al.  Why People Continue to Play Online Games: In Search of Critical Design Factors to Increase Customer Loyalty to Online Contents , 2004, Cyberpsychology Behav. Soc. Netw..

[14]  Terry L. Childers,et al.  HEDONIC AND UTILITARIAN MOTIVATIONS FOR ONLINE RETAIL SHOPPING BEHAVIOR , 2001 .

[15]  Edward E. Rigdon,et al.  Experiential value: Conceptualization, measurement and application in the catalog and Internet shopping environment. , 2001 .

[16]  Edward E. Rigdon,et al.  Play, Flow, and the Online Search Experience , 2004 .

[17]  L. Marsch,et al.  Development and Validation of the Situational Self-Awareness Scale , 2001, Consciousness and Cognition.

[18]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[19]  E. Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[20]  Ping Zhang,et al.  Satisfiers and dissatisfiers: a two-factor model for website design and evaluation , 2000 .

[21]  Clifford Nass,et al.  Seductive interfaces: satisfying a mass audience , 1994, CHI Conference Companion.

[22]  Jordan Litman,et al.  Measuring Epistemic Curiosity and Its Diversive and Specific Components , 2003, Journal of personality assessment.

[23]  Steven Pace,et al.  A grounded theory of the flow experiences of Web users , 2004, Int. J. Hum. Comput. Stud..

[24]  Jane Webster,et al.  Enhancing the Design of Web Navigation Systems: The Influence of User Disorientation on Engagement and Performance , 2006, MIS Q..

[25]  Noam Tractinsky,et al.  Assessing dimensions of perceived visual aesthetics of web sites , 2004 .

[26]  Lina Zhou,et al.  ONLINE SHOPPING ACCEPTANCE MODEL — A CRITICAL SURVEY OF CONSUMER FACTORS IN ONLINE SHOPPING , 2007 .

[27]  J. Webster,et al.  The Dimensionality and Correlates of Flow in Human-Computer Interactions. , 1993 .

[28]  Donna L. Hoffman,et al.  Measuring the Customer Experience in Online Environments: A Structural Modeling Approach , 2000 .

[29]  Valerie J. Trifts,et al.  Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids , 2000 .

[30]  Caroline Hummels,et al.  Let's Make Things Engaging , 2005, Funology.

[31]  Jane Webster,et al.  Audience engagement in multimedia presentations , 1997, DATB.

[32]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[33]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .