Visual search for faces with emotional expressions.

The goal of this review is to critically examine contradictory findings in the study of visual search for emotionally expressive faces. Several key issues are addressed: Can emotional faces be processed preattentively and guide attention? What properties of these faces influence search efficiency? Is search moderated by the emotional state of the observer? The authors argue that the evidence is consistent with claims that (a) preattentive search processes are sensitive to and influenced by facial expressions of emotion, (b) attention guidance is influenced by a dynamic interplay of emotional and perceptual factors, and (c) visual search for emotional faces is influenced by the emotional state of the observer to some extent. The authors also argue that the way in which contextual factors interact to determine search performance needs to be explored further to draw sound conclusions about the precise influence of emotional expressions on search efficiency. Methodological considerations (e.g., set size, distractor background, task set) and ecological limitations of the visual search task are discussed. Finally, specific recommendations are made for future research directions.

[1]  C. H. Hansen,et al.  Finding the face in the crowd: an anger superiority effect. , 1988, Journal of personality and social psychology.

[2]  James T. Enns,et al.  Relax! Cognitive strategy influences visual search , 2006 .

[3]  E. Fox Processing emotional facial expressions: The role of anxiety and awareness , 2002, Cognitive, affective & behavioral neuroscience.

[4]  M White Representation of facial expressions of emotion. , 1999, The American journal of psychology.

[5]  E. Fox,et al.  Attentional bias for threat: Evidence for delayed disengagement from emotional faces , 2002, Cognition & emotion.

[6]  J. M. Carroll,et al.  Do facial expressions signal specific emotions? Judging emotion from the face in context. , 1996, Journal of personality and social psychology.

[7]  N. Ambady,et al.  Effects of Gaze on Amygdala Sensitivity to Anger and Fear Faces , 2003, Science.

[8]  F. Esteves Attentional bias to emotional facial expressions , 1999 .

[9]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[10]  J. Mattingley,et al.  Look at me, I'm smiling: Visual search for threatening and nonthreatening facial expressions , 2005 .

[11]  D. Purcell,et al.  It Takes a Confounded Face to Pop Out of a Crowd , 1996, Perception.

[12]  Raymond M. Klein,et al.  Does the inspector have a memory? , 2006 .

[13]  P. Niedenthal,et al.  The heart's eye: Emotional influences in perception and attention. , 1994 .

[14]  Andreas A. Ioannides,et al.  Single Trial Analysis of Neurophysiological Correlates of the Recognition of Complex Objects and Facial Expressions of Emotion , 2004, Brain Topography.

[15]  S. Gronlund,et al.  Top-down guidance in visual search for facial expressions , 2007, Psychonomic bulletin & review.

[16]  R. Dolan,et al.  Distinct spatial frequency sensitivities for processing faces and emotional expressions , 2003, Nature Neuroscience.

[17]  E. Callaway,et al.  Narrowed attention; a psychological phenomenon that accompanies a certain physiological change. , 1958, A.M.A. archives of neurology and psychiatry.

[18]  J. Eastwood,et al.  Negative facial expression captures attention and disrupts performance , 2003, Perception & psychophysics.

[19]  L. Weiskrantz,et al.  Differential extrageniculostriate and amygdala responses to presentation of emotional faces in a cortically blind field. , 2001, Brain : a journal of neurology.

[20]  G. R. J. Hockey Effect of Loud Noise on Attentional Selectivity , 1970 .

[21]  A. Kingstone,et al.  Cognitive Ethology and exploring attention in real-world scenes , 2006, Brain Research.

[22]  Michael G. Reynolds,et al.  Monitoring eye movements while searching for affective faces , 2009 .

[23]  S. Rauch,et al.  Masked Presentations of Emotional Facial Expressions Modulate Amygdala Activity without Explicit Knowledge , 1998, The Journal of Neuroscience.

[24]  C. Rovee-Collier,et al.  The development of visual search in infants and very young children. , 2002, Journal of experimental child psychology.

[25]  J. Eastwood,et al.  Differential attentional guidance by unattended faces expressing positive and negative emotion , 2001, Perception & psychophysics.

[26]  A. Calder,et al.  Configural coding of facial expressions: The impact of inversion and photographic negative , 2005 .

[27]  Volker Arolt,et al.  Spatial processing of facial emotion in patients with unipolar depression: a longitudinal study. , 2004, Journal of affective disorders.

[28]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[29]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[30]  L. Nummenmaa,et al.  Detection of emotional faces: salient physical features guide effective visual search. , 2008, Journal of experimental psychology. General.

[31]  A. Young,et al.  Recognition of facial emotion in nine individuals with bilateral amygdala damage , 1999, Neuropsychologia.

[32]  E. Fox,et al.  Do threatening stimuli draw or hold visual attention in subclinical anxiety? , 2001, Journal of experimental psychology. General.

[33]  M. Behrmann,et al.  Patterns of eye movements during parallel and serial visual search tasks. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[34]  H. Nothdurft Faces and Facial Expressions do not Pop Out , 1993, Perception.

[35]  Y. Bar-Haim,et al.  Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. , 2007, Psychological bulletin.

[36]  K. Cave,et al.  Abstract stimuli associated with threat through conditioning cannot be detected preattentively. , 2005, Emotion.

[37]  Leslie G. Ungerleider,et al.  Attentional control of the processing of neural and emotional stimuli. , 2002, Brain research. Cognitive brain research.

[38]  Gernot Horstmann,et al.  Preattentive face processing: What do visual search experiments with schematic faces tell us? , 2007 .

[39]  E. Fox,et al.  Facial Expressions of Emotion: Are Angry Faces Detected More Efficiently? , 2000, Cognition & emotion.

[40]  Daniel Lundqvist,et al.  Looking for foes and friends: perceptual and emotional factors when finding a face in the crowd. , 2005, Emotion.

[41]  K. Mogg,et al.  Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness , 1999 .

[42]  R. Ritchie Momentary affect and attention allocation , 1986 .

[43]  Marte Fallshore,et al.  Recognition of Emotion from Inverted Schematic Drawings of Faces , 2003, Perceptual and motor skills.

[44]  G. Gendolla,et al.  Detecting emotional faces and features in a visual search paradigm: are faces special? , 2006, Emotion.

[45]  Kyle R. Cave,et al.  From searching for features to searching for threat: Drawing the boundary between preattentive and attentive vision , 2006 .

[46]  J. Theeuwes Perceptual selectivity is task dependent: evidence from selective search. , 1990, Acta psychologica.

[47]  J. Eastwood,et al.  Does unattended information facilitate change detection? , 2000, Journal of experimental psychology. Human perception and performance.

[48]  M. Eysenck,et al.  Anxiety and cognitive performance: attentional control theory. , 2007, Emotion.

[49]  A. Kingstone,et al.  Cognitive Ethology: a new approach for studying human cognition. , 2008, British journal of psychology.

[50]  D. Smilek,et al.  Revisiting the category effect: The influence of meaning and search strategy on the efficiency of visual search , 2006, Brain Research.

[51]  Jeffrey S. Maxwell,et al.  Human Amygdala Responsivity to Masked Fearful Eye Whites , 2004, Science.

[52]  R. Dolan,et al.  Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study , 2002, Neuropsychologia.

[53]  Lauri Nummenmaa,et al.  Visual search of emotional faces. Eye-movement assessment of component processes. , 2008, Experimental psychology.

[54]  Stefanie I. Becker,et al.  Attentional effects of negative faces: Top-down contingent or involuntary? , 2008, Perception & psychophysics.

[55]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[56]  L. Damjanovic,et al.  The eyes are sufficient to produce a threat superiority effect. , 2006, Emotion.

[57]  Francisco Esteves,et al.  The Face of Wrath: Critical Features for Conveying Facial Threat , 1999 .

[58]  A. Isen,et al.  The influence of affect on categorization. , 1984 .

[59]  S. McKelvie Emotional expression in upside-down faces: evidence for configurational and componential processing. , 1995, The British journal of social psychology.

[60]  Michael W. Eysenck,et al.  Trait anxiety, anxious mood, and threat detection. , 1995 .

[61]  Volker Arolt,et al.  Detection of facial expressions of emotions in schizophrenia , 2003, Schizophrenia Research.

[62]  S. Yantis,et al.  Abrupt visual onsets and selective attention: voluntary versus automatic allocation. , 1990, Journal of experimental psychology. Human perception and performance.

[63]  Patrik Vuilleumier,et al.  Emotional facial expressions capture attention , 2001, Neurology.

[64]  Joseph E. LeDoux,et al.  How danger is encoded: towards a systems, cellular, and computational understanding of cognitive-emotional interactions , 1999 .

[65]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[66]  Daniel Lundqvist,et al.  Emotion regulates attention: The relation between facial configurations, facial emotion, and visual attention , 2005 .

[67]  Francisco Esteves,et al.  The face of wrath: The role of features and configurations in conveying social threat , 2004, Cognition & emotion.

[68]  S. Yantis,et al.  Uniqueness of abrupt visual onset in capturing attention , 1988, Perception & psychophysics.

[69]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[70]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[71]  T. Suslow,et al.  Detection of Facial Expressions of Emotions in Depression , 2001, Perceptual and motor skills.

[72]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[73]  N. Sagiv,et al.  Structural Encoding of Human and Schematic Faces: Holistic and Part-Based Processes , 2001, Journal of Cognitive Neuroscience.

[74]  Michael G. Reynolds,et al.  What influences visual search efficiency? Disentangling contributions of preattentive and postattentive processes , 2007, Perception & psychophysics.

[75]  Daniel Smilek,et al.  Visual search is not blind to emotion , 2008, Perception & psychophysics.

[76]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[77]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[78]  Svein Magnussen,et al.  Patterns of Perceptual Asymmetry in Processing Facial Expression , 1994, Cortex.

[79]  G. Rhodes,et al.  Are you always on my mind? A review of how face perception and attention interact , 2007, Neuropsychologia.

[80]  S. Hofmann,et al.  Information processing in social phobia: a critical review. , 2001, Clinical psychology review.

[81]  Asaid Khateb,et al.  Discriminating emotional faces without primary visual cortices involves the right amygdala , 2005, Nature Neuroscience.

[82]  Norihiro Sadato,et al.  Dissociable neural responses in the hippocampus to the retrieval of facial identity and emotion: An event‐related fMRI study , 2003, Hippocampus.

[83]  A. Kingstone,et al.  Attention, Researchers! It Is Time to Take a Look at the Real World , 2003 .

[84]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[85]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[86]  Andrew W Young,et al.  The eyebrow frown: a salient social signal. , 2002, Emotion.

[87]  R. J. Dolan,et al.  Human Amygdala Responses to Fearful Eyes , 2002, NeuroImage.

[88]  Karl J. Friston,et al.  A neuromodulatory role for the human amygdala in processing emotional facial expressions. , 1998, Brain : a journal of neurology.

[89]  G. Horstmann,et al.  Search asymmetries with real faces: testing the anger-superiority effect. , 2006, Emotion.

[90]  R. Yin Looking at Upside-down Faces , 1969 .

[91]  A. Öhman,et al.  Automatically elicited fear: Conditioned skin conductance responses to masked facial expressions , 1994 .

[92]  Deborah J. Hellawell,et al.  Facial expression processing after amygdalotomy , 1996, Neuropsychologia.

[93]  J. Findlay Saccade Target Selection During Visual Search , 1997, Vision Research.

[94]  Arne Öhman,et al.  Behold the wrath: Psychophysiological responses to facial stimuli , 1996 .

[95]  Curt A. Carlson,et al.  Aging and visual search: automatic and controlled attentional bias to threat faces. , 2006, Acta psychologica.

[96]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[97]  A. Isen,et al.  The influence of positive affect on the unusualness of word associations. , 1985, Journal of personality and social psychology.

[98]  D. Tucker,et al.  Motivating the focus of attention. , 1994 .

[99]  J. Wolfe,et al.  What Can 1 Million Trials Tell Us About Visual Search? , 1998 .

[100]  C. Izard,et al.  The 5-month-old's ability to discriminate facial expressions of emotion , 1985 .

[101]  M. Junghöfer,et al.  Attention and emotion: an ERP analysis of facilitated emotional stimulus processing , 2003, Neuroreport.

[102]  J. Wolfe Moving towards solutions to some enduring controversies in visual search , 2003, Trends in Cognitive Sciences.

[103]  J. Eastwood,et al.  Functional consequences of perceiving facial expressions of emotion without awareness , 2005, Consciousness and Cognition.

[104]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[105]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[106]  Mirja Tenhunen,et al.  Faster Choice-Reaction Times to Positive than to Negative Facial Expressions: The Role of Cognitive , 2003 .

[107]  J. Eastwood,et al.  Individuals with social phobia are biased to become aware of negative faces , 2005 .

[108]  Ulrich Ansorge,et al.  More efficient rejection of happy than of angry face distractors in visual search , 2006, Psychonomic bulletin & review.

[109]  Murray White,et al.  Preattentive analysis of facial expressions of emotion , 1995 .

[110]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[111]  P Vuilleumier,et al.  Neural response to emotional faces with and without awareness: event-related fMRI in a parietal patient with visual extinction and spatial neglect , 2002, Neuropsychologia.

[112]  E. Callaway,et al.  Sympathetic Activity and Perception: An Approach to the Relationships between Autonomic Activity and Personality , 1953, Psychosomatic medicine.

[113]  Edna B. Foa,et al.  Attentional Biases for Facial Expressions in Social Phobia: The Face-in-the-Crowd Paradigm , 1999 .