Towards a Framework of Critical Multimodal Analysis: Emotion in a Film Trailer

This paper presents a pilot study in the analysis of emotion integrating approaches from traditionally separate theoretical backgrounds: socio-semiotic studies and cognitive studies. The general aim is to identify a flexible and comprehensive framework for critical multimodal analysis of visual, verbal (oral, written and a blend of the two), kinetic, sound, music and graphic aspects. The case-study, exemplifying this kind of integrated approach in its initial stages, identifies the voices of emotion as expressed in the trailer of the film An Inconvenient Truth (2006) and discusses their intertextual and interdiscoursal characteristics. Aspects of the on-going research projects are discussed.

[1]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[2]  Theo van Leeuwen,et al.  Reading Images: The Grammar of Visual Design , 1996 .

[3]  A. Damasio,et al.  Emotion in the perspective of an integrated nervous system 1 Published on the World Wide Web on 27 January 1998. 1 , 1998, Brain Research Reviews.

[4]  Kay L. O’Halloran,et al.  Multimodal Discourse Analysis: Systemic Functional Perspectives , 2006 .

[5]  Jonathan H. Turner,et al.  The Sociology of Emotions: The Sociology of Emotions , 2005 .

[6]  R. Iedema.  Multimodality, resemiotization: extending the analysis of discourse as multi-semiotic practice , 2003 .

[7]  Cindy Gallois,et al.  Group membership, social rules, and power: A social-psychological perspective on emotional communication , 1994 .

[8]  N. Fairclough.  Language and globalization , 2006 .

[9]  M. Bednarek.  Emotion Talk Across Corpora , 2008 .

[10]  S. Hunston,et al.  Evaluation in Text: Authorial Stance and the Construction of Discourse , 2001 .

[11]  P. White.  Evaluative semantics and ideological positioning in journalistic discourse: A new framework for analysis , 2006 .

[12]  Z. Kövecses,et al.  The Cambridge Handbook of Metaphor and Thought: Metaphor and emotion , 2008 .

[13]  P. Ekman.  Should we call it expression or communication , 1997 .

[14]  Jenefer Robinson.  Deeper than reason : emotion and its role in literature, music, and art , 2005 .

[15]  P. Johnson-Laird,et al.  The language of emotions: An analysis of a semantic field , 2013 .

[16]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[17]  A. Wierzbicka.  Emotions Across Languages And Cultures , 1999 .

[18]  Deborah Tannen,et al.  Critical Discourse Analysis , 2005 .

[19]  M. Baynham.  J.R. Martin and Ruth Wodak: Re/Reading the Past: Critical and Functional Perspectives on Time and Value. John Benjamins, 2003. , 2006 .

[20]  R. Wodak,et al.  Methods of critical discourse analysis , 2001 .

[21]  Jeannett Martin,et al.  The Language of Evaluation: Appraisal in English , 2005 .

[22]  Devin Nordberg.  An inconvenient truth: A film directed by Davis Guggenheim, Paramount Classics, 2006, Running time: 100 min , 2007 .

[23]  Jane Vincent,et al.  Electronic emotion : the mediation of emotion via information and communication technologies , 2009 .

[24]  N. Fairclough.  Analysing Discourse: Textual Analysis for Social Research , 2003 .

[25]  D. Machin,et al.  Global Media Discourse: A Critical Introduction , 2007 .

[26]  E. Semino.  Metaphor in discourse , 2008 .

[27]  R. Wodak.  Critical Discourse Analysis , 2003 .

[28]  T. V. Dijk.  The Discourse-Knowledge Interface , 2003 .

[29]  Christian M. I. M. Matthiessen,et al.  Continuing Discourse on Language: A Functional Perspective , 2007 .

[30]  Michael Halliday,et al.  An Introduction to Functional Grammar , 1985 .

[31]  C. Forceville.  Metaphor in pictures and multimodal representations , 2008 .

[32]  Jeannett Martin,et al.  English Text: System and structure , 1992 .

[33]  Contextual knowledge management in discourse production: A CDA perspective , 2005 .

[34]  Z. Kövecses,et al.  Metaphor in Culture: Metaphor in Culture , 2005 .

[35]  P. Thoits.  The sociology of emotions , 2005 .

[36]  T. V. Dijk.  Discourse and Power , 2008 .

[37]  Nicola Maria Dusi.  Le forme del trailer come manipolazione intrasemiotica , 2002 .

[38]  A. Damasio.  The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 1999 .

[39]  A. Goatly.  Washing the Brain - Metaphor and Hidden Ideology , 2007 .

[40]  Anna Esposito,et al.  Multimodal Signals: Cognitive and Algorithmic Issues, COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008, Revised Selected and Invited Papers , 2009, COST 2102 School.

[41]  Charles Forceville,et al.  Pictorial Metaphor in Advertising , 1998 .

[42]  R. Wodak.  What CDA is about – a summary of its history, important concepts and its developments. , 2001 .

[43]  Nathan Gardels,et al.  The Dialogical Imagination , 2009 .

[44]  G. Kress,et al.  Colour as a semiotic mode: notes for a grammar of colour , 2002 .

[45]  N. Fairclough.  Language and power (2nd ed.) , 2001 .

[46]  Gunther Kress,et al.  Literacy in the New Media Age , 2003 .

[47]  Jonathan H. Turner,et al.  The Sociology of Emotions: Index , 2005 .

[48]  Ruth Wodak,et al.  Re/Reading the Past Critical and Functional Perspectives on Time and Value , 2003 .