The User Affective Experience Scale: A Measure of Emotions Anticipated in Response to Pop-Up Computer Warnings

ABSTRACT We measured reported User Affective Experience (UAX) anticipated to pop-up warnings that unexpectedly appear during computer use. Such warnings, designed to protect the user, are often ignored, suggesting the influence of nonrational factors. Emotions can both enhance and undermine effective decision-making, but in the decision literature they are typically defined and measured simply in terms of positive and negative valence. We examined discrete emotions anticipated when pop-up warnings appear, including specific positive, negative, individualist, and prosocial emotions based upon affective neuroscience. Forty-five emotions associated with receiving warnings associated with failing to update software, both in relaxed online sessions and sessions involving time and attention pressures, were assessed for underlying measurement structure. Four hundred participants were recruited via Mechanical Turk and reported about specific emotions presented in random order. Exploratory structural equation modeling analyses revealed four reliable latent factors for relaxed (R) and pressured (P) conditions: Positive Affect, Anxiety, Hostility, and Loneliness. P conditions were higher in reported Anxiety, Hostility, and Loneliness and lower in reported Positive Affect. Men reported higher feelings of Hostility and Loneliness; women reported higher Anxiety. Implications are discussed for designing pop-up warnings and also more generally regarding conceptualizing and measuring user experience.

[1]  Stefan Savage,et al.  Manufacturing compromise: the emergence of exploit-as-a-service , 2012, CCS.

[2]  Brian B. Kelly Investing in a Centralized Cybersecurity Infrastructure: Why "Hacktivism" Can and Should Influence Cybersecurity Reform , 2012 .

[3]  Paul van Schaik,et al.  Attitudes towards user experience (UX) measurement , 2014, Int. J. Hum. Comput. Stud..

[4]  Jussi P. P. Jokinen Emotional user experience: Traits, events, and states , 2015, Int. J. Hum. Comput. Stud..

[5]  N. Srinivasan,et al.  Role of affect in decision making. , 2013, Progress in brain research.

[6]  Alexandre N. Tuch,et al.  Trust and distrust on the web: User experiences and website characteristics , 2015, Comput. Hum. Behav..

[7]  Rick Wash,et al.  Out of the Loop: How Automated Software Updates Cause Unintended Security Consequences , 2014, SOUPS.

[8]  Lorrie Faith Cranor,et al.  Anti-Phishing Phil: the design and evaluation of a game that teaches people not to fall for phish , 2007, SOUPS '07.

[9]  Richard W. Homan,et al.  Differential hemispheric lateralization of primary and social emotions: implications for developing a comprehensive neurology for emotions, repression, and the subconscious , 1994 .

[10]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[11]  Mohammad Maifi Hasan Khan,et al.  An investigation into users’ considerations towards using password managers , 2017, Human-centric Computing and Information Sciences.

[12]  Brock Bastian,et al.  The Discrete Emotions Questionnaire: A New Tool for Measuring State Self-Reported Emotions , 2016, PloS one.

[13]  Markus Jakobsson,et al.  Phishing and Countermeasures , 2006 .

[14]  Eugen Iordache,et al.  Comparisons of CES‐D depression scoring methods in two older adults ethnic groups. The emergence of an ethnic‐specific brief three‐item CES‐D scale , 2013, International journal of geriatric psychiatry.

[15]  Robin Zondervan,et al.  Motivating and achievement-eliciting pop-ups in online environments: A user experience perspective , 2015, Comput. Hum. Behav..

[16]  Christopher K. Hsee,et al.  Risk as Feelings , 2001, Psychological bulletin.

[17]  Ross Buck,et al.  Communicative Genes in the Evolution of Empathy and Altruism , 2011, Behavior genetics.

[18]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[19]  Mohammad Maifi Hasan Khan,et al.  A study of users' experiences and beliefs about software update messages , 2015, Comput. Hum. Behav..

[20]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[21]  R. Buck Emotion: A Biosocial Synthesis , 2014 .

[22]  Salvatore J. Stolfo,et al.  When Firmware Modifications Attack: A Case Study of Embedded Exploitation , 2013, NDSS.

[23]  Vincent Koenig,et al.  User experience: A concept without consensus? Exploring practitioners' perspectives through an international survey , 2015, Comput. Hum. Behav..

[24]  C. McLean,et al.  Brave men and timid women? A review of the gender differences in fear and anxiety. , 2009, Clinical psychology review.

[25]  R. Pieters,et al.  Goal-directed Emotions , 1998 .

[26]  Ross Buck,et al.  The Genetics and Biology of True Love: Prosocial Biological Affects and the Left Hemisphere , 2002 .

[27]  Min Wu,et al.  Do security toolbars actually prevent phishing attacks? , 2006, CHI.

[28]  Ross Buck,et al.  Emotion, Warnings, and the Ethics of Risk Communication , 2012 .

[29]  Nhan Nguyen,et al.  How does this message make you feel? A study of user perspectives on software update/warning message design , 2015, Human-centric Computing and Information Sciences.

[30]  Ross Buck,et al.  Marketing Risk: Emotional Appeals Can Promote the Mindless Acceptance of Risk , 2010 .

[31]  Rick Wash,et al.  Betrayed by updates: how negative experiences affect future security , 2014, CHI.

[32]  Lorrie Faith Cranor,et al.  Timing is everything?: the effects of timing and placement of online privacy indicators , 2009, CHI.

[33]  Kenneth R. Laughery,et al.  Behavioral Effectiveness of Warnings , 1985 .

[34]  J. Archer Sex Differences in Aggression in Real-World Settings: A Meta-Analytic Review , 2004 .

[35]  Timothy D. Wilson,et al.  Prospection: Experiencing the Future , 2007, Science.

[36]  R. Buck,et al.  The biological affects: a typology. , 1999, Psychological review.

[37]  K Rivet Amico,et al.  Pilot test of an emotional education intervention component for sexual risk reduction. , 2011, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[38]  Andrew J. Martin,et al.  Methodological Measurement Fruitfulness of Exploratory Structural Equation Modeling (ESEM): New Approaches to Key Substantive Issues in Motivation and Engagement , 2011 .

[39]  R. Buck,et al.  Emotion and reason in persuasion: Applying the ARI model and the CASC Scale☆ , 2004 .

[40]  Markus Jakobsson,et al.  Phishing and Countermeasures: Understanding the Increasing Problem of Electronic Identity Theft , 2006 .

[41]  Oliver P. John,et al.  Measurement: Reliability, construct validation, and scale construction. , 2000 .

[42]  H. Yau,et al.  Gender Difference of Confidence in Using Technology for Learning , 2012 .

[43]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[44]  B. Muthén,et al.  Exploratory Structural Equation Modeling , 2009 .