Effects of model eye gaze direction on consumer visual processing: Evidence from China and America

Abstract The question of how to design attractive model in online advertising is especially important for online operators of electronic commerce websites. This study examines how a model’s eye gaze direction influences consumers’ visual processing, taking into consideration smiling facial expressions for both Chinese and American consumers. Drawing on shared signal theory and cultural differences, a set of eye-tracking experiments was performed. The results show that consumer arousal is much higher when the model has a smiling facial expression paired with a direct eye gaze, compared to an averted eye gaze. This effect is much stronger for Chinese consumers than American consumers. However, for cognitive information processing, we found that consumers process product information on a deeper level when the model has a smiling facial expression paired with an averted eye gaze, compared to a direct eye gaze. Although there is a significant difference between Chinese and American consumers in processing the product brand, no significant differences were identified in their processing of the text. Theoretical and practical implications are discussed.

[1]  Matthew G. Rhodes,et al.  Modes of cognitive control in recognition and source memory: Depth of retrieval , 2005, Psychonomic bulletin & review.

[2]  J. Hietanen,et al.  Attention to Eye Contact in the West and East: Autonomic Responses and Evaluative Ratings , 2013, PloS one.

[3]  Sangwon Lee,et al.  Users’ Emotional Valence, Arousal, and Engagement Based on Perceived Usability and Aesthetics for Web Sites , 2015, Int. J. Hum. Comput. Interact..

[4]  P. Tomalski,et al.  Gaze-cueing effect depends on facial expression of emotion in 9- to 12-month-old infants , 2015, Front. Psychol..

[5]  Michel Wedel,et al.  The Buffer Effect: The Role of Color When Advertising Exposures Are Brief and Blurred , 2015, Mark. Sci..

[6]  S. Tipper,et al.  Gaze cueing of attention: visual attention, social cognition, and individual differences. , 2007, Psychological bulletin.

[7]  David Matsumoto,et al.  The contribution of individualism vs. collectivism to cross-national differences in display rules* , 1998 .

[8]  Gillian Rhodes,et al.  Have you got the look? Gaze direction affects judgements of facial attractiveness , 2010 .

[9]  Ze Wang,et al.  Smile Big or Not? Effects of Smile Intensity on Perceptions of Warmth and Competence , 2016 .

[10]  Milena M. Head,et al.  Exploring human images in website design: a multi-method approach , 2009 .

[11]  Frank Biocca,et al.  Attention Issues in Spatial Information Systems: Directing Mobile Users' Visual Attention Using Augmented Reality , 2007, J. Manag. Inf. Syst..

[12]  Steven P. Tipper,et al.  Affective evaluations of objects are influenced by observed gaze direction and emotional expression , 2007, Cognition.

[13]  Mark H Johnson,et al.  The shared signal hypothesis: effects of emotion-gaze congruency in infant and adult visual preferences. , 2013, The British journal of developmental psychology.

[14]  S. Gunnery,et al.  Perceptions of Duchenne and non-Duchenne smiles: A meta-analysis , 2016, Cognition & emotion.

[15]  Woojin Lee,et al.  The effect of Facebook users’ arousal and valence on intention to go to the festival: Applying an extension of the technology acceptance model , 2012 .

[16]  Linden J. Ball,et al.  The influence of banner advertisements on attention and memory: human faces with averted gaze can enhance advertising effectiveness , 2014, Front. Psychol..

[17]  Sandra E. Moriarty,et al.  Abduction: A Theory of Visual Interpretation , 1996 .

[18]  Hao Shen,et al.  Looks good to me: How eye movements influence product evaluation , 2016 .

[19]  C. Kleinke,et al.  Affective and emotional responses as a function of other person's gaze and cooperativeness in a two-person game. , 1971, Journal of personality and social psychology.

[20]  G. Fink,et al.  Being with virtual others: Neural correlates of social interaction , 2006, Neuropsychologia.

[21]  Alan Kingstone,et al.  The eyes have it!: An fMRI investigation , 2004, Brain and Cognition.

[22]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[23]  Benjamin G. Voyer,et al.  The effect of culture on perception and cognition: A conceptual framework , 2014 .

[24]  Morris B. Holbrook,et al.  Beyond Attitude Structure: Toward the Informational Determinants of Attitude: , 1978 .

[25]  Han-Seok Seo,et al.  Visual attention toward food-item images can vary as a function of background saliency and culture: An eye-tracking study , 2015 .

[26]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[27]  Pia Rotshtein,et al.  Differential interactions between identity and emotional expression in own and other-race faces: effects of familiarity revealed through redundancy gains. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[28]  Alan Kingstone,et al.  Does gaze direction really trigger a reflexive shift of spatial attention? , 2005, Brain and Cognition.

[29]  S. Adam Brasel,et al.  Nonconscious drivers of visual attention in interactive media environments , 2011 .

[30]  Leon G. Schiffman,et al.  Sociocultural meanings in visually standardized print ads , 2004 .

[31]  Ze Wang,et al.  Examining the Effect of Smile Intensity on Age Perceptions , 2015, Psychological reports.

[32]  A. Little,et al.  Integrating Gaze Direction and Expression in Preferences for Attractive Faces , 2006, Psychological science.

[33]  Alicia Kulczynski,et al.  When Your Source Is Smiling, Consumers May Automatically Smile with You: Investigating the Source Expressive Display Hypothesis , 2016 .

[34]  R. Kleck,et al.  Effects of direct and averted gaze on the perception of facially communicated emotion. , 2005, Emotion.

[35]  J. Kruschke Bayesian estimation supersedes the t test. , 2013, Journal of experimental psychology. General.

[36]  Michel Wedel,et al.  BANOVA: An R Package for Hierarchical Bayesian ANOVA , 2014 .

[37]  S. Yoshikawa,et al.  Effects of facial expression and gaze direction on approach–avoidance behaviour , 2012, Cognition & emotion.

[38]  B. Velichkovsky Heterarchy of cognition: The depths and the highs of a framework for memory research , 2002, Memory.

[39]  Lenita M. Davis,et al.  Empirical testing of a model of online store atmospherics and shopper responses , 2003 .

[40]  Guang Zhao,et al.  Trait Anxiety Impacts the Perceived Gaze Direction of Fearful But Not Angry Faces , 2017, Front. Psychol..

[41]  Hiroshi Yamada,et al.  American-Japanese cultural differences in judgements of emotional expressions of different intensities , 2002 .

[42]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[43]  Jae-Hyeon Ahn,et al.  Attention to Banner Ads and Their Effectiveness: An Eye-Tracking Approach , 2012, Int. J. Electron. Commer..

[44]  Jean-Claude Usunier,et al.  Cultural, National, and Industry-Level Differences in B2B Web Site Design and Content , 2009, Int. J. Electron. Commer..

[45]  Panos Athanasopoulos,et al.  Searching for Happiness Across Cultures , 2010 .

[46]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[47]  Daniel Baack,et al.  Creativity and Memory Effects: Recall, Recognition, and an Exploration of Nontraditional Media , 2008 .

[48]  J. Russell A circumplex model of affect. , 1980 .

[49]  Marius B. Müller,et al.  Auction Fever! How Time Pressure and Social Competition Affect Bidders’ Arousal and Bids in Retail Auctions , 2015 .

[50]  A. Senju,et al.  Direct gaze captures visuospatial attention , 2005 .

[51]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[52]  F. Kardes,et al.  The Effects of Physiological Arousal on Information Processing and Persuasion , 1988 .

[53]  T. Postmes,et al.  Social Cues and Impression Formation in CMC , 2003 .

[54]  Yi Yang,et al.  The effect of human image in B2C website design: an eye-tracking study , 2014, Enterp. Inf. Syst..

[55]  P. Aggarwal,et al.  Is That Car Smiling at Me? Schema Congruity as a Basis for Evaluating Anthropomorphized Products , 2007 .

[56]  S. B. Hutton,et al.  The effect of gaze cues on attention to print advertisements , 2011 .

[57]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[58]  M. Mason,et al.  The Look of Love , 2005, Psychological science.

[59]  Willem Verbeke,et al.  Preference Inferences from Eye-Related Cues in Sales-Consumer Settings: ERP Timing and Localization in Relation to Inferring Performance and Oxytocin Receptor (OXTR) Gene Polymorphisms , 2016 .

[60]  Charles E. Gengler,et al.  Emotional Contagion Effects on Product Attitudes , 2001 .

[61]  Craig J. Thompson,et al.  Emotional Branding and the Strategic Value of the Doppelgänger Brand Image , 2006 .

[62]  Christopher P. Puto,et al.  Informational and Transformational Advertising: the Differential Effects of Time , 1984 .

[63]  Samuel Garcia,et al.  Emotional communication in the context of joint attention for food stimuli: Effects on attentional and affective processing , 2015, Biological Psychology.

[64]  Xiaojing Yang,et al.  Modeling the Determinants and Effects of Creativity in Advertising , 2007 .

[65]  M. Holbrook,et al.  Consumer Responses to Advertising: The Effects of Ad Content, Emotions, and Attitude toward the Ad on Viewing Time , 1991 .

[66]  Florin Dolcos,et al.  Dissociable effects of arousal and valence on prefrontal activity indexing emotional evaluation and subsequent memory: an event-related fMRI study , 2004, NeuroImage.

[67]  Jan B. Engelmann,et al.  Cultural Differences in Affect Intensity Perception in the Context of Advertising , 2011, Front. Psychology.

[68]  M. Bindemann,et al.  Faces retain attention , 2005, Psychonomic bulletin & review.

[69]  Alan Kingstone,et al.  A new look at social attention: orienting to the eyes is not (entirely) under volitional control. , 2012, Journal of experimental psychology. Human perception and performance.

[70]  M. Yuki,et al.  Are the windows to the soul the same in the East and West? Cultural differences in using the eyes and mouth as cues to recognize emotions in Japan and the United States , 2007 .

[71]  D. MacInnis,et al.  Understanding Program-Induced Mood Effects: Decoupling Arousal from Valence , 2002 .

[72]  Adam S. Greenberg,et al.  The Role of Visual Attention In Internet Advertising , 2012, Journal of Advertising Research.

[73]  P. Niedenthal,et al.  When Your Smile Fades Away , 2011 .

[74]  Jari K. Hietanen,et al.  Eye contact and arousal: The effects of stimulus duration , 2011, Biological Psychology.

[75]  Oded Netzer,et al.  Extending Compromise Effect Models to Complex Buying Situations and Other Context Effects , 2004 .

[76]  A. Little,et al.  Evidence for adaptive design in human gaze preference , 2008, Proceedings of the Royal Society B: Biological Sciences.

[77]  Reginald B. Adams,et al.  What’s in a Smile? Cultural Differences in the Effects of Smiling on Judgments of Trustworthiness , 2010 .

[78]  Silvia Rigato,et al.  The Role of Gaze in the Processing of Emotional Facial Expressions , 2013 .

[79]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[80]  M. Cha,et al.  Cross-Cultural Comparison of Nonverbal Cues in Emoticons on Twitter: Evidence from Big Data Analysis , 2014 .

[81]  Rik Pieters,et al.  Attention Capture and Transfer in Advertising: Brand, Pictorial, and Text-Size Effects , 2004 .

[82]  Chuan-Hoo Tan,et al.  Comprehension and Assessment of Product Reviews: A Review-Product Congruity Proposition , 2013, J. Manag. Inf. Syst..

[83]  John R. Hauser,et al.  Rejoinder - Response to Comments on "Website Morphing" , 2009, Mark. Sci..

[84]  V. Bruce,et al.  Do the eyes have it? Cues to the direction of social attention , 2000, Trends in Cognitive Sciences.

[85]  A. Milton Jenkins,et al.  What the information analyst should know about body language , 1977 .