Eye contact with neutral and smiling faces: effects on autonomic responses and frontal EEG asymmetry

In our previous studies we have shown that seeing another person “live” with a direct vs. averted gaze results in enhanced skin conductance responses (SCRs) indicating autonomic arousal and in greater relative left-sided frontal activity in the electroencephalography (asymmetry in the alpha-band power), associated with approach motivation. In our studies, however, the stimulus persons had a neutral expression. In real-life social interaction, eye contact is often associated with a smile, which is another signal of the sender's approach-related motivation. A smile could, therefore, enhance the affective-motivational responses to eye contact. In the present study, we investigated whether the facial expression (neutral vs. social smile) would modulate autonomic arousal and frontal EEG alpha-band asymmetry to seeing a direct vs. an averted gaze in faces presented “live” through a liquid crystal (LC) shutter. The results showed that the SCRs were greater for the direct than the averted gaze and that the effect of gaze direction was more pronounced for a smiling than a neutral face. However, in this study, gaze direction and facial expression did not affect the frontal EEG asymmetry, although, for gaze direction, we found a marginally significant correlation between the degree of an overall bias for asymmetric frontal activity and the degree to which direct gaze elicited stronger left-sided frontal activity than did averted gaze.

[1]  Andrew D. Engell,et al.  Facial expression and gaze-direction in human superior temporal sulcus , 2007, Neuropsychologia.

[2]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[3]  R. Davidson,et al.  The functional neuroanatomy of emotion and affective style , 1999, Trends in Cognitive Sciences.

[4]  Mark H. Johnson,et al.  The shared signal hypothesis and neural responses to expressions and gaze in infants and adults , 2009, Social cognitive and affective neuroscience.

[5]  Antony J. Chapman,et al.  EEG correlates of eye contact and interpersonal distance , 1975, Biological Psychology.

[6]  H. Semlitsch,et al.  A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. , 1986, Psychophysiology.

[7]  R. Kleck,et al.  Effects of direct and averted gaze on the perception of facially communicated emotion. , 2005, Emotion.

[8]  M. Argyle,et al.  Observer of observed? A reversible perspective in person perception. , 1969, Sociometry.

[9]  Philip A. Gable,et al.  The role of asymmetric frontal cortical activity in emotion-related phenomena: A review and update , 2010, Biological Psychology.

[10]  J. Hietanen,et al.  The observer observed: frontal EEG asymmetry and autonomic responses differentiate between another person's direct and averted gaze when the face is seen live. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  U. Hess,et al.  You smile–I smile: Emotion expression in social interaction , 2010, Biological Psychology.

[12]  M. Balconi,et al.  Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues. ERS/ERD and coherence measures of alpha band. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[13]  Paul J. Whalen,et al.  The uncertainty of it all , 2007, Trends in Cognitive Sciences.

[14]  Joseph E LeDoux.  Emotion circuits in the brain. , 2009, Annual review of neuroscience.

[15]  Elliot T. Berkman,et al.  Approaching the Bad and Avoiding the Good: Lateral Prefrontal Cortical Asymmetry Distinguishes between Action and Valence , 2010, Journal of Cognitive Neuroscience.

[16]  G. Stemmler,et al.  Trait BIS predicts alpha asymmetry and P300 in a Go/No‐Go task , 2009 .

[17]  A. Calder,et al.  Personality influences the neural responses to viewing facial expressions of emotion , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  John J. B. Allen,et al.  Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion , 2004, Biological Psychology.

[19]  W. Martin,et al.  The Relative Effects of Eye-Gaze and Smiling on Arousal in Asocial Situations , 1979 .

[20]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[21]  P. Ekman,et al.  Behavioral markers and recognizability of the smile of enjoyment. , 1993, Journal of personality and social psychology.

[22]  Christian Büchel,et al.  Processing of facial expressions and their significance for the observer in subregions of the human amygdala , 2011, NeuroImage.

[23]  D. Perrett,et al.  Emotional expression modulates perceived gaze direction. , 2008, Emotion.

[24]  Sakiko Yoshikawa,et al.  The amygdala processes the emotional significance of facial expressions: an fMRI investigation using the interaction between expression and face direction , 2004, NeuroImage.

[25]  M. Patterson.  An arousal model of interpersonal intimacy. , 1976 .

[26]  C. Mangina,et al.  Direct electrical stimulation of specific human brain structures and bilateral electrodermal activity. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[27]  M. Dawson,et al.  The electrodermal system , 2007 .

[28]  Jari K. Hietanen,et al.  Seeing direct and averted gaze activates the approach–avoidance motivational brain systems , 2008, Neuropsychologia.

[29]  Jari K. Hietanen,et al.  Eye contact and arousal: The effects of stimulus duration , 2011, Biological Psychology.

[30]  R. Davidson,et al.  Prefrontal Brain Asymmetry: A Biological Substrate of the Behavioral Approach and Inhibition Systems , 1997 .

[31]  Anna S. Engels,et al.  Specificity of regional brain activity in anxiety types during emotion processing , 2008, Brain and Cognition.

[32]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[33]  N. Fox,et al.  Asymmetrical brain activity discriminates between positive and negative affective stimuli in human infants. , 1982, Science.

[34]  Patrik Vuilleumier,et al.  Self-relevance processing in the human amygdala: gaze direction, facial expression, and emotion intensity. , 2009, Emotion.

[35]  G. Alpers,et al.  Is eye to eye contact really threatening and avoided in social anxiety?--An eye-tracking and psychophysiology study. , 2009, Journal of anxiety disorders.

[36]  J. Cohn,et al.  All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous , 2009, Journal of nonverbal behavior.

[37]  C. Kleinke,et al.  Effects of Mutual Gaze and Touch on Attraction, Mood, and Cardiovascular Reactivity , 1993 .

[38]  Sakiko Yoshikawa,et al.  Amygdala integrates emotional expression and gaze direction in response to dynamic facial expressions , 2010, NeuroImage.

[39]  R. Davidson.  Cerebral asymmetry, emotion, and affective style. , 1995 .

[40]  M. Raichle,et al.  Integration of emotion and cognition in the lateral prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Dennis J.L.G. Schutter,et al.  From Affective Valence to Motivational Direction , 2006, Psychological science.

[42]  The world smiles at me: Self-referential positivity bias when interpreting direction of attention , 2011, Cognition & emotion.

[43]  R. Davidson.  What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research , 2004, Biological Psychology.

[44]  E. Gordon,et al.  Social phobics do not see eye to eye: a visual scanpath study of emotional expression processing. , 2003, Journal of anxiety disorders.

[45]  U. Dimberg,et al.  Speech anxiety and rapid emotional reactions to angry and happy facial expressions. , 2007, Scandinavian journal of psychology.

[46]  L. Williams,et al.  Investigating models of affect: relationships among EEG alpha asymmetry, depression, and anxiety. , 2008, Emotion.

[47]  S. Lau.  The Effect of Smiling on Person Perception , 1982 .

[48]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[49]  G. Stemmler,et al.  Is running away right? The behavioral activation-behavioral inhibition model of anterior asymmetry. , 2008, Emotion.

[50]  A. Lüthi,et al.  Processing of Temporal Unpredictability in Human and Animal Amygdala , 2007, The Journal of Neuroscience.

[51]  Shelly L. Gable,et al.  What You Want (and Do Not Want) Affects What You See (and Do Not See): Avoidance Social Goals and Social Events , 2006, Personality & social psychology bulletin.

[52]  A. Elliot,et al.  Approach-avoidance motivation in personality: approach and avoidance temperaments and goals. , 2002, Journal of personality and social psychology.

[53]  Charles Tijus,et al.  The mere perception of eye contact increases arousal during a word-spelling task , 2010, Social neuroscience.

[54]  M. Bindemann,et al.  How do eye gaze and facial expression interact? , 2008 .

[55]  D. Matsumoto,et al.  American-Japanese cultural differences in attributions of personality based on smiles , 1993 .

[56]  John J. B. Allen,et al.  Frontal EEG asymmetry, emotion, and psychopathology: the first, and the next 25 years , 2004, Biological Psychology.

[57]  Nancy L. Kocovski,et al.  Social anxiety, self‐regulation, and fear of negative evaluation , 2000 .

[58]  M. Patterson,et al.  Effects of nonverbal intimacy on arousal and behavioral adjustment , 1981 .

[59]  Mike Rinck,et al.  Gaze direction differentially affects avoidance tendencies to happy and angry faces in socially anxious individuals. , 2010, Behaviour research and therapy.

[60]  Eva-Lotta Sallnäs,et al.  Effects of Communication Mode on Social Presence, Virtual Presence, and Performance in Collaborative Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[61]  Andrew H. Kemp,et al.  Distinct amygdala–autonomic arousal profiles in response to fear signals in healthy males and females , 2005, NeuroImage.

[62]  W. Heller,et al.  The puzzle of regional brain activity in depression and anxiety: The importance of subtypes and comorbidity. , 1998 .

[63]  Nicolas Guéguen,et al.  Direct Look Versus Evasive Glance and Compliance With a Request , 2002, The Journal of social psychology.

[64]  K. Scherer,et al.  Interaction effects of perceived gaze direction and dynamic facial expression: Evidence for appraisal theories of emotion , 2007 .

[65]  B. Champness,et al.  Eye gaze and the GSR , 1971 .

[66]  Nouchine Hadjikhani,et al.  Pointing with the eyes: The role of gaze in communicating danger , 2008, Brain and Cognition.

[67]  C. Carver,et al.  Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales , 1994 .

[68]  Thomas Straube,et al.  Increased amygdala activation to averted versus direct gaze in humans is independent of valence of facial expression , 2010, NeuroImage.

[69]  H. Critchley.  Electrodermal responses: what happens in the brain. , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[70]  Christopher M Laine,et al.  Behavioral triggers of skin conductance responses and their neural correlates in the primate amygdala. , 2009, Journal of neurophysiology.

[71]  P. Beek,et al.  Walk to me when I smile, step back when I’m angry: emotional faces modulate whole-body approach–avoidance behaviors , 2011, Experimental Brain Research.

[72]  Justin W. Weeks,et al.  Exploring the relationship between fear of positive evaluation and social anxiety. , 2008, Journal of anxiety disorders.

[73]  N. Ambady,et al.  Effects of Gaze on Amygdala Sensitivity to Anger and Fear Faces , 2003, Science.

[74]  Reginald B. Adams,et al.  Amygdala responses to averted vs direct gaze fear vary as a function of presentation speed. , 2012, Social cognitive and affective neuroscience.