A small-world network model of facial emotion recognition

Various models have been proposed to increase understanding of the cognitive basis of facial emotions. Despite those efforts, interactions between facial emotions have received minimal attention. If collective behaviours relating to each facial emotion in the comprehensive cognitive system could be assumed, specific facial emotion relationship patterns might emerge. In this study, we demonstrate that the frameworks of complex networks can effectively capture those patterns. We generate 81 facial emotion images (6 prototypes and 75 morphs) and then ask participants to rate degrees of similarity in 3240 facial emotion pairs in a paired comparison task. A facial emotion network constructed on the basis of similarity clearly forms a small-world network, which features an extremely short average network distance and close connectivity. Further, even if two facial emotions have opposing valences, they are connected within only two steps. In addition, we show that intermediary morphs are crucial for maintaining full network integration, whereas prototypes are not at all important. These results suggest the existence of collective behaviours in the cognitive systems of facial emotions and also describe why people can efficiently recognize facial emotions in terms of information transmission and propagation. For comparison, we construct three simulated networks—one based on the categorical model, one based on the dimensional model, and one random network. The results reveal that small-world connectivity in facial emotion networks is apparently different from those networks, suggesting that a small-world network is the most suitable model for capturing the cognitive basis of facial emotions.

[1]  A. Fischer,et al.  What Drives the Smile and the Tear: Why Women Are More Emotionally Expressive Than Men , 2015 .

[2]  Bruno Gonçalves,et al.  Links that speak: The global language network and its association with global fame , 2014, Proceedings of the National Academy of Sciences.

[3]  Yue Chen,et al.  Greater Perceptual Sensitivity to Happy Facial Expression , 2014, Perception.

[4]  Rutger Goekoop,et al.  A Network View on Psychiatric Disorders: Network Clusters of Symptoms as Elementary Syndromes of Psychopathology , 2014, PloS one.

[5]  Michael S. Vitevitch,et al.  The influence of clustering coefficient on word-learning: how groups of similar sounding words facilitate acquisition , 2014, Front. Psychol..

[6]  Naoto Suzuki,et al.  Scaling laws in emotion-associated words and corresponding network topology , 2014, Cognitive Processing.

[7]  Paulo R. Guimarães,et al.  Assembly of complex plant–fungus networks , 2014, Nature Communications.

[8]  Hong Li,et al.  Enhanced brain small‐worldness after sleep deprivation: a compensatory effect , 2014, Journal of sleep research.

[9]  Jonathan D. Power,et al.  Network measures predict neuropsychological outcome after brain injury , 2014, Proceedings of the National Academy of Sciences.

[10]  E. Tolosa,et al.  Functional brain networks and cognitive deficits in Parkinson's disease , 2014, Human brain mapping.

[11]  Chung-Pin Chou,et al.  Network Robustness: Detecting Topological Quantum Phases , 2014, Scientific Reports.

[12]  T. Kochiyama,et al.  Sex Differences in the Rapid Detection of Emotional Facial Expressions , 2014, PloS one.

[13]  Albert Solé-Ribalta,et al.  Navigability of interconnected networks under random failures , 2013, Proceedings of the National Academy of Sciences.

[14]  N. Suzuki,et al.  The relationship between fractal dimension and other-race and inversion effects in recognising facial emotions , 2013, Cognition & emotion.

[15]  N. Tottenham,et al.  A negativity bias for ambiguous facial-expression valence during childhood: converging evidence from behavior and facial corrugator muscle responses. , 2013, Emotion.

[16]  Jennifer M. B. Fugate Categorical Perception for Emotional Faces , 2013, Emotion review : journal of the International Society for Research on Emotion.

[17]  Richard J. Harris,et al.  Morphing between expressions dissociates continuous from categorical representations of facial expression in the human brain , 2012, Proceedings of the National Academy of Sciences.

[18]  Gouhei Tanaka,et al.  Dynamical robustness in complex networks: the crucial role of low-degree nodes , 2012, Scientific Reports.

[19]  Verena D. Schmittmann,et al.  The Small World of Psychopathology , 2011, PloS one.

[20]  Daniel B M Haun,et al.  Categorical perception of emotional facial expressions does not require lexical categories. , 2011, Emotion.

[21]  Yoed N. Kenett,et al.  Global and Local Features of Semantic Networks: Evidence from the Hebrew Mental Lexicon , 2011, PloS one.

[22]  K. Katahira,et al.  Categorical and dimensional perceptions in decoding emotional facial expressions , 2011, Cognition & emotion.

[23]  Alexandre Arenas,et al.  Semantic Networks: Structure and Dynamics , 2010, Entropy.

[24]  W. Sato,et al.  Detection of emotional facial expressions and anti-expressions , 2010 .

[25]  Claus-Christian Carbon,et al.  Recognition of Emotional Expressions is Affected by Inversion and Presentation Time , 2009, Perception.

[26]  Rachael E. Jack,et al.  Cultural Confusions Show that Facial Expressions Are Not Universal , 2009, Current Biology.

[27]  F. Jordán Keystone species and food webs , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Thomas T. Hills,et al.  Longitudinal Analysis of Early Semantic Networks , 2009, Psychological science.

[29]  O. Lipp,et al.  No effect of inversion on attentional and affective processing of facial expressions. , 2009, Emotion.

[30]  P. Viviani,et al.  Perceiving facial expressions , 2009 .

[31]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[32]  Mark E. J. Newman,et al.  Structure and Dynamics of Networks , 2009 .

[33]  Georgia Panayiotou,et al.  Emotional dimensions reflected in ratings of affective scripts , 2008 .

[34]  Ulrik Brandes,et al.  On variants of shortest-path betweenness centrality and their generic computation , 2008, Soc. Networks.

[35]  K. Gurney,et al.  Network ‘Small-World-Ness’: A Quantitative Method for Determining Canonical Network Equivalence , 2008, PloS one.

[36]  M. Milders,et al.  Minimum presentation time for masked facial expression discrimination , 2008 .

[37]  Thomas W. Valente,et al.  Structural Comparison of Cognitive Associative Networks in Two Populations , 2007 .

[38]  Marco Janssen,et al.  Diffusion dynamics in small-world networks with heterogeneous consumers , 2007, Comput. Math. Organ. Theory.

[39]  N. Suzuki,et al.  The fractal property of internal structure of facial affect recognition: A complex system approach , 2007 .

[40]  Ernesto Estrada,et al.  Characterization of topological keystone species: Local, global and “meso-scale” centralities in food webs , 2007 .

[41]  M. Mendolia,et al.  Explicit Use of Categorical and Dimensional Strategies to Decode Facial Expressions of Emotion , 2007 .

[42]  Danielle Smith Bassett,et al.  Small-World Brain Networks , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[43]  Martin G. Everett,et al.  A Graph-theoretic perspective on centrality , 2006, Soc. Networks.

[44]  R. Solé,et al.  Ecological networks and their fragility , 2006, Nature.

[45]  G. Paramei,et al.  Facial-Expression Affective Attributes and their Configural Correlates: Components and Categories , 2006, The Spanish Journal of Psychology.

[46]  L. F. Barrett Are Emotions Natural Kinds? , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[47]  L. F. Barrett Valence is a basic building block of emotional life , 2006 .

[48]  E. Bullmore,et al.  A Resilient, Low-Frequency, Small-World Human Brain Functional Network with Highly Connected Association Cortical Hubs , 2006, The Journal of Neuroscience.

[49]  Jens M. Olesen,et al.  The Dense and Highly Connected World of Greenland's Plants and Their Pollinators , 2005 .

[50]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[51]  Jari Saramäki,et al.  Modelling development of epidemics with dynamic small-world networks. , 2005, Journal of theoretical biology.

[52]  R. Guimerà,et al.  Functional cartography of complex metabolic networks , 2005, Nature.

[53]  J. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2005, Cogn. Sci..

[54]  J. White,et al.  Epilepsy in Small-World Networks , 2004, The Journal of Neuroscience.

[55]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[56]  María Guadalupe Ramírez Ortiz,et al.  The social networks of academic performance in a student context of poverty in Mexico , 2004, Soc. Networks.

[57]  Diane J. Schiano,et al.  Categorical imperative NOT: facial affect is perceived continuously , 2004, CHI.

[58]  R. Guimerà,et al.  The worldwide air transportation network: Anomalous centrality, community structure, and cities' global roles , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[59]  D. Watts,et al.  An Experimental Study of Search in Global Social Networks , 2003, Science.

[60]  David Lusseau,et al.  The emergent properties of a dolphin social network , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[61]  Michael B. Lewis,et al.  Locating the neutral expression in the facial-emotion space , 2003 .

[62]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[63]  Glenda C. Prkachin,et al.  The effects of orientation on detection and identification of facial expressions of emotion. , 2003, British journal of psychology.

[64]  K. Goh,et al.  Betweenness centrality correlation in social networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  Andrew W. Young,et al.  Anxiety-related Bias in the Classification of Emotionally Ambiguous Facial Expressions , 2002 .

[66]  Neo D. Martinez,et al.  Network structure and biodiversity loss in food webs: robustness increases with connectance , 2002, Ecology Letters.

[67]  Y. Lai,et al.  Topology of the conceptual network of language. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[68]  Mark Buchanan,et al.  Nexus: Small Worlds and the Groundbreaking Science of Networks , 2002 .

[69]  V. Latora,et al.  Economic small-world behavior in weighted networks , 2002, cond-mat/0204089.

[70]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[71]  Naoto Suzuki,et al.  FRACTALS IN EMOTIONAL FACIAL EXPRESSION RECOGNITION , 2002 .

[72]  S. N. Dorogovtsev,et al.  Pseudofractal scale-free web. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[73]  N. Suzuki,et al.  Robustness of the Two-Dimensional Structure of Recognition of Facial Expression: Evidence under Different Intensities of Emotionality , 2001, Perceptual and motor skills.

[74]  Ramon Ferrer i Cancho,et al.  The small world of human language , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[75]  David Bimler,et al.  Categorical perception of facial expressions of emotion: Evidence from multidimensional scaling , 2001 .

[76]  L. Amaral,et al.  The web of human sexual contacts , 2001, Nature.

[77]  S. N. Dorogovtsev,et al.  Evolution of networks , 2001, cond-mat/0106144.

[78]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[79]  A. Barabasi,et al.  Lethality and centrality in protein networks , 2001, Nature.

[80]  A. Young,et al.  A principal component analysis of facial expressions , 2001, Vision Research.

[81]  V. Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[82]  Jose M. Montoya Ricard V. Sole,et al.  Small world patterns in food webs. , 2000, Journal of theoretical biology.

[83]  Ricard V. Solé,et al.  Complexity and fragility in ecological networks , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[84]  Alessandro Vespignani,et al.  Epidemic spreading in scale-free networks. , 2000, Physical review letters.

[85]  R. Albert,et al.  The large-scale organization of metabolic networks , 2000, Nature.

[86]  D. Perrett,et al.  Caricaturing facial expressions , 2000, Cognition.

[87]  A. Barabasi,et al.  Error and attack tolerance of complex networks , 2000, Nature.

[88]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[89]  Albert-László Barabási,et al.  Internet: Diameter of the World-Wide Web , 1999, Nature.

[90]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[91]  N. Suzuki,et al.  Morphed Images of Basic Emotional Expressions: Ratings on Russell's Bipolar Field , 1997, Perceptual and motor skills.

[92]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[93]  M. Katsikitis,et al.  The Classification of Facial Expressions of Emotion: A Multidimensional-Scaling Approach , 1997, Perception.

[94]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[95]  A. Ohman,et al.  Masking the face: recognition of emotional facial expressions as a function of the parameters of backward masking. , 1993, Scandinavian journal of psychology.

[96]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[97]  P. Ekman An argument for basic emotions , 1992 .

[98]  D. Matsumoto American-Japanese Cultural Differences in the Recognition of Universal Facial Expressions , 1992 .

[99]  S. Harnad Categorical Perception: The Groundwork of Cognition , 1990 .

[100]  P. Ekman,et al.  American-Japanese cultural differences in intensity ratings of facial expressions of emotion , 1989 .

[101]  James A. Russell,et al.  Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. , 1985 .

[102]  F. Doré,et al.  Judgment of Facial Expressions of Emotion as a Function of Exposure Time , 1984, Perceptual and motor skills.

[103]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[104]  Shilpa Chakravartula Complex Networks: Structure and Dynamics , 2014 .

[105]  Olga Korolkova,et al.  Categorical Perception of Facial Expressions Is Not a Homogeneous Effect , 2014, CogSci.

[106]  D. Maurer,et al.  Similarities and differences in the perceptual structure of facial expressions of children and adults. , 2010, Journal of experimental child psychology.

[107]  I. Christie,et al.  Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[108]  Vladimir Batagelj,et al.  Pajek - Analysis and Visualization of Large Networks , 2004, Graph Drawing Software.

[109]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[110]  Joseph P. Forgas,et al.  The Message Within : The Role of Subjective Experience In Social Cognition And Behavior , 2000 .

[111]  A. Andrew,et al.  Emergence of Scaling in Random Networks , 1999 .

[112]  J. Russell Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[113]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[114]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[115]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[116]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .