Is sadness blue? The problem of using figurative language for emotions on psychological tests

Psychological tests sometimes include figurative language like I feel blue. However, figurative language may not mean the same thing cross-culturally. Previous research found cross-cultural evidence for 14 conceptual metaphors and metonymies for emotions (e.g., sadness is blue). Our two studies asked participants (total n = 795) in the USA and India whether happiness, sadness, anger, and fear are associated with certain descriptors (blue, down, bright, etc.). Most participants in both countries endorsed ten of the 14 hypothesized associations; however, the percentage of participants endorsing an association was often far from 100 %. For example, in the USA, only 71.7 % associated hot with anger and only 65.9 % associated blue with sadness. Moreover, descriptors were often associated with more than one emotion. Furthermore, only two associations (happiness is up and bright) were endorsed by more than 90 % of participants in both countries and had descriptors that were not associated with additional emotions. We conclude that figurative language is often ambiguous and should be used with caution on psychological tests unless there is evidence the language is understood cross-culturally. Advice to this effect is currently lacking from psychometrics textbooks and should be added.

[1]  G. Lakoff The Cambridge Handbook of Metaphor and Thought: The neural theory of metaphor , 2009 .

[2]  Gary D. Borich,et al.  Educational Testing and Measurement : Classroom Application and Practice , 1984 .

[3]  A Comparative Analysis of English and Chinese Idioms— From the Perspective of Conceptual Metaphor of “Happiness” , 2010 .

[4]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[5]  A Cognitive Study of “Happiness” Metaphors in English and Chinese Idioms , 2010 .

[6]  L. Radloff The CES-D Scale , 1977 .

[7]  K. Tan,et al.  Emotional Temperament in Food-Related Metaphors: A Cross-Cultural Account of the Conceptualizations of ANGER , 2013 .

[8]  G. Lakoff Mapping the brain's metaphor circuitry: metaphorical thought in everyday reason , 2014, Front. Hum. Neurosci..

[9]  J. Tolaas,et al.  Notes on the Origin of Some Spatialization Metaphors , 1991 .

[10]  N. K. Dor-Shav,et al.  Cross-Cultural Study of Ratings of Phenomenological Experience of Emotion , 1978, Psychological reports.

[11]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[12]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[13]  A. Realo,et al.  Emotional Experience and Its Relation to the Five-Factor Model in Estonian , 1997 .

[14]  J. Russell Culture and the categorization of emotions. , 1991, Psychological bulletin.

[15]  Leib Litman,et al.  The relationship between motivation, monetary compensation, and data quality among US- and India-based workers on Mechanical Turk , 2014, Behavior Research Methods.

[16]  A. Ortony,et al.  Metaphorical Uses of Language in the Expression of Emotions , 1987 .

[17]  Zoltán Kövecses,et al.  The Concept of Anger: Universal or Culture Specific? , 2000, Psychopathology.

[18]  Z. Kövecses,et al.  Metaphor: A Practical Introduction , 2002 .

[19]  Eric Partridge,et al.  A Dictionary of Slang and Unconventional English , 1937 .

[20]  G. Lakoff,et al.  The cognitive model of anger inherent in American English , 1983 .

[21]  M. Danesi Metaphorical competence in second language acquisition and second language teaching: the neglected dimension , 1993 .

[22]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[23]  Conventional Metaphors for Depression , 2002 .

[24]  David G. Rand,et al.  The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments. , 2012, Journal of theoretical biology.

[25]  Zoltán Kövecses,et al.  Metaphors of Anger, Pride and Love: A lexical approach to the structure of concepts , 1986 .

[26]  J. Davitz The language of emotion , 1969 .

[27]  Jacki O'Neill,et al.  Turk-Life in India , 2014, GROUP.

[28]  Sandra A. McIntire,et al.  Foundations of psychological testing: A practical approach, 2nd ed. , 2007 .

[29]  E. Barbee Healing time: the blues and African-American women. , 1994, Health care for women international.

[30]  Helen H. Epps,et al.  Color-emotion associations: Past experience and personal preference , 2004 .

[31]  R. Hogan,et al.  Development of an empathy scale. , 1969, Journal of consulting and clinical psychology.

[32]  J. Sandford Turn a colour with emotion: a linguistic construction of colour in English , 2014 .

[33]  Thomas P. Hogan,et al.  Psychological Testing: A Practical Introduction , 2002 .

[34]  Elisabeth Piirainen,et al.  Figurative Language: Cross-cultural and Cross-linguistic Perspectives , 2005 .

[35]  A. J. Fay,et al.  Embodied effects are moderated by situational cues: warmth, threat, and the desire for affiliation. , 2015, The British journal of social psychology.

[36]  Keiko Matsuki,et al.  Metaphors of anger in Japanese , 1995 .

[37]  L. Aiken Psychological testing and assessment , 1976 .

[38]  R. Gibbs The Poetics of Mind: Figurative Thought, Language, and Understanding , 1994 .

[39]  Sonya Pritzker,et al.  The role of metaphor in culture, consciousness, and medicine: a preliminary inquiry into the metaphors of depression in chinese and western medical and common languages , 2003 .

[40]  Ulrike Oster,et al.  Using corpus methodology for semantic and pragmatic analyses: What can corpora tell us about the linguistic expression of emotions? , 2010 .

[41]  A. Omori Emotion as a Huge Mass of Moving Water , 2008 .

[42]  G. Hofstede The Cultural Relativity of Organizational Practices and Theories , 1983 .

[43]  A. Vingerhoets,et al.  Heartwarming memories: Nostalgia maintains physiological comfort. , 2012, Emotion.

[44]  Colin Baker,et al.  Encyclopedia of Bilingualism and Bilingual Education , 1998 .

[45]  Emotion Metaphors and Cross-Linguistic. Conceptualization of Emotions , 1997 .

[46]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[47]  David Watson,et al.  The PANAS-X manual for the positive and negative affect schedule , 1994 .

[48]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[49]  F. Ding,et al.  The Interaction between Metaphor and Metonymy in Emotion Category , 2012 .

[50]  Ning Yu,et al.  Metaphorical Expressions of Anger and Happiness in English and Chinese , 1995 .

[51]  P. Ekman,et al.  American-Japanese cultural differences in intensity ratings of facial expressions of emotion , 1989 .

[52]  Aaron D. Shaw,et al.  Social desirability bias and self-reports of motivation: a study of amazon mechanical turk in the US and India , 2012, CHI.

[53]  Johanna Viimaranta,et al.  Metaphoric Expressions on Vertical Axis Revisited: An Empirical Study of Russian and French Material , 2010 .

[54]  Jon Sprouse A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory , 2010, Behavior research methods.

[55]  W. James,et al.  The Principles of Psychology. , 1983 .

[56]  Michael D. Robinson,et al.  Anger as Seeing Red , 2011, Social psychological and personality science.

[57]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[58]  P. Salovey,et al.  Emotional intelligence meets traditional standards for an intelligence , 1999 .

[59]  Michael D. Robinson,et al.  Anger as “seeing red”: Evidence for a perceptual association , 2012, Cognition & emotion.

[60]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[61]  M. Watson,et al.  Development of a questionnaire measure of emotional control. , 1983, Journal of psychosomatic research.

[62]  Lera Boroditsky,et al.  The Immediate and Chronic Influence of Spatio-Temporal Metaphors on the Mental Representations of Time in English, Mandarin, and Mandarin-English Speakers , 2013, Front. Psychol..

[63]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[64]  Richard A. Shweder,et al.  Thinking Through Cultures: Expe-ditions in Cultural Psychology , 1991 .

[65]  Jörn Hurtienne,et al.  Sad is heavy and happy is light: population stereotypes of tangible object attributes , 2009, TEI.

[66]  Gerhard Stemmler,et al.  Physiological processes during emotion. , 2004 .

[67]  Z. Kövecses Metaphor in Culture: Metaphor in Culture , 2005 .

[68]  Hong-mei Sun,et al.  The Cognitive Study of Metaphor and its Application in English Language Teaching , 2010 .

[69]  Metaphorical Thinking in Engilsh and Chinese Languages , 2011 .

[70]  Xiao Liu,et al.  A Comparative Study of Emotion Metaphors between English and Chinese , 2013 .

[71]  Michael D. Robinson,et al.  The Metaphorical Representation of Affect , 2005 .

[72]  A Comparative and Contrastive Study of Sadness Conceptualization in Persian and English , 2013 .

[73]  A. Beck,et al.  Depression: Causes and Treatment , 1967 .

[74]  V. Lehtinen,et al.  Gender differences in depressive symptoms. An artefact caused by measurement instruments? , 2002, Journal of affective disorders.

[75]  Y. Gunther The Phenomenology and Intentionality of Emotion , 2004 .

[76]  Javier Valenzuela,et al.  Emotion and colour across languages: implicit associations in Spanish colour terms , 2009 .

[77]  K. Scherer,et al.  Evidence for universality and cultural variation of differential emotion response patterning. , 1994, Journal of personality and social psychology.

[78]  Jesse J. Chandler,et al.  Inside the Turk , 2014 .

[79]  Sandra A. McIntire,et al.  Foundations of Psychological Testing: A Practical Approach , 2006 .

[80]  Zoltán Kövecses,et al.  Happiness: A Definitional Effort , 1991 .

[81]  T. Kline Psychological Testing: A Practical Approach to Design and Evaluation , 2005 .

[82]  A Corpus Linguistic Perspective on the Relationship between Metonymy and Metaphor , 2005 .

[83]  D. Palermo,et al.  Betty Is a Bouncing Bubble: Children's Comprehension of Emotion-Descriptive Metaphors. , 1989 .

[84]  H. Kaviani,et al.  A quantitative/qualitative study on metaphors used by Persian depressed patients , 2011 .

[85]  Z. Kövecses The Metaphor–Metonymy Relationship: Correlation Metaphors Are Based on Metonymy , 2013 .

[86]  Temperature-Based Metonymies for Emotions in Children and Adults , 2010, Psychological reports.

[87]  Marcello Gallucci,et al.  Cold-blooded loneliness: social exclusion leads to lower skin temperatures. , 2012, Acta psychologica.

[88]  R. Gibbs,et al.  Complementary perspectives on metaphor: Cognitive linguistics and relevance theory. , 2008 .

[89]  Ning Yu Body and emotion: body parts in Chinese expression of emotion , 2002 .

[90]  Michele L. Ybarra,et al.  Center for Epidemiologic Studies Depression Scale: Review and Revision (CESD and CESD-R). , 2004 .

[91]  A. Barcelona Metaphor and metonymy at the crossroads : a cognitive perspective , 2003 .