Follow Your Heart or Mind? Measuring Neurophysiological Responses and Subjective Judgments for Visual Aesthetics

This research-in-progress explores measurement of affective responses to visual stimuli by two methods: objective neurophysiological measures (galvanic skin conductance and facial electromyography) and subjective psychometric measures (self-report using survey). We aim to argue that neurophysiological measures can supplement traditional measures to capture effectively emotional responses to aesthetically manipulated visual design interfaces. Besides that, we also establish links between emotional responses: valence and arousal and aesthetics: classical and expressive to better understand the impact on design parameters on subconscious information processing.

[1]  David Chek Ling Ngo,et al.  Application of an aesthetic evaluation model to data entry screens , 2001, Comput. Hum. Behav..

[2]  James J Gross,et al.  Predicting affective choice. , 2013, Journal of experimental psychology. General.

[3]  Marc Hassenzahl,et al.  Emotions can be quite ephemeral; we cannot design them , 2004, INTR.

[4]  M. Bradley,et al.  Looking at facial expressions: Dysphoria and facial EMG , 2002, Biological Psychology.

[5]  F. Ginsburg.  Embedded Aesthetics: Creating a Discursive Space for Indigenous Media , 1994 .

[6]  A. Isen,et al.  Affect, accessibility of material in memory, and behavior: a cognitive loop? , 1978, Journal of personality and social psychology.

[7]  Angelika Dimoka,et al.  On the Use of Neuropyhsiological Tools in IS Research: Developing a Research Agenda for NeuroIS , 2012, MIS Q..

[8]  James J. Gross,et al.  Emotion regulation and successful aging , 2012, Trends in Cognitive Sciences.

[9]  Gitte Lindgaard,et al.  Attention web designers: You have 50 milliseconds to make a good first impression! , 2006, Behav. Inf. Technol..

[10]  Klarissa Ting-Ting Chang,et al.  Icon Types, Classical and Expressive Aesthetics, Pleasurable Interaction and Satisfaction with the Process of Semi-literate Users , 2014 .

[11]  Rita Strebe.  Visual Aesthetics of Websites: The Visceral Level of Perception and Its Influence on User Behaviour , 2011, TPDL.

[12]  Andreas Sonderegger,et al.  The influence of design aesthetics in usability testing: effects on user performance and perceived usability. , 2010, Applied ergonomics.

[13]  Hans van der Heijden,et al.  Factors influencing the usage of websites: the case of a generic portal in The Netherlands , 2003, Inf. Manag..

[14]  Ian M. Thornton,et al.  Representation of Change: Separate Electrophysiological Markers of Attention, Awareness, and Implicit Processing , 2003, Journal of Cognitive Neuroscience.

[15]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[16]  Bo N. Schenkman,et al.  Aesthetics and preferences of web pages , 2000, Behav. Inf. Technol..

[17]  Paul Guyer,et al.  The psychology of Kant's aesthetics. , 2008, Studies in history and philosophy of science.

[18]  K. Scherer.  Psychological models of emotion. , 2000 .

[19]  Na Li,et al.  Love at First Sight or Sustained Effect? The Role of Perceived Affective Quality on Users' Cognitive Reactions to Information Technology , 2004, ICIS.

[20]  Jinwoo Kim,et al.  Visualizing E-Brand Personality: Exploratory Studies on Visual Attributes and E-Brand Personalities in Korea , 2005, Int. J. Hum. Comput. Interact..

[21]  D. Cicchetti.  Emotion and Adaptation , 1993 .

[22]  Anindya Datta,et al.  Serendipitous Recommendation for Mobile Apps Using Item-Item Similarity Graph , 2013, AIRS.

[23]  Noam Tractinsky,et al.  Toward the Study of Aesthetics in Information Technology , 2004, ICIS.

[24]  Donald A. Norman,et al.  Introduction to This Special Section on Beauty, Goodness, and Usability , 2004, Hum. Comput. Interact..

[25]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[26]  Gitte Lindgaard,et al.  What is this evasive beast we call user satisfaction? , 2003, Interact. Comput..

[27]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[28]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[29]  Michael Minge,et al.  Measuring multiple components of emotions in interactive contexts , 2006, CHI Extended Abstracts.

[30]  Heshan Sun,et al.  The role of moderating factors in user technology acceptance , 2006, Int. J. Hum. Comput. Stud..

[31]  Lynne M. Coventry,et al.  Human Factors , 2010, Handbook of Financial Cryptography and Security.

[32]  Ming-Chuen Chuang,et al.  Exploration in Emotion and Visual Information Uncertainty of Websites in Culture Relations , 2008 .

[33]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[34]  Noam Tractinsky,et al.  Assessing dimensions of perceived visual aesthetics of web sites , 2004 .

[35]  Mel Yamamoto,et al.  The impact of product aesthetics on the evaluation of industrial products , 1994 .

[36]  T. Olive,et al.  Evidence that dissonance arousal is initially undifferentiated and only later labeled as negative , 2013 .

[37]  W. Tschacher,et al.  Physiological Correlates of Aesthetic Perception of Artworks in a Museum , 2012 .

[38]  J. Elster.  Emotions and Economic Theory , 1998 .

[39]  Klarissa Ting-Ting Chang,et al.  Role of Emotions and Aesthetics in ICT Usage for Underserved Communities: A NeuroIS Investigation , 2014, ICIS.

[40]  Anne Beaudry,et al.  The Other Side of Acceptance: Studying the Direct and Indirect Effects of Emotions on Information Technology Use , 2010, MIS Q..

[41]  R. Zajonc,et al.  Affective and Cognitive Factors in Preferences , 1982 .

[42]  Soussan Djamasbi,et al.  Moods and Their Relevance to Systems Usage Models within Organizations: An Extended Framework , 2010 .

[43]  Fred D. Davis,et al.  Psychophysiological Measures of Cognitive Absorption , 2010 .

[44]  Bengisu Tulu,et al.  Can a Reasonable Time Limit Improve the Effective Usage of a Computerized Decision Aid? , 2008, Commun. Assoc. Inf. Syst..

[45]  Jan Hartmann,et al.  Assessing the attractiveness of interactive systems , 2006, CHI Extended Abstracts.

[46]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[47]  Joel B. Cohen,et al.  Affect Monitoring and the Primacy of Feelings in Judgment , 2001 .