The kineikonic mode : towards a multimodal approach to moving-image media

Multimodality theory can offer new ways to think about the combination of sign-systems to be found in such cultural forms as narrative film, television, animation, moving image art installations and machinima. Why we might need such a theory is a question for specialists in Film Studies, which will be briefly considered in the conclusion. Meanwhile, this chapter is aimed mostly at those with a more general interest in analysing the moving image, particularly in relation to other media and other art-forms, and in relation to conceptions of literacy which move beyond print and language. I will examine two examples: one from a narrative film produced in 1948, and one from a machinima film made by 11 year-olds in 2013.

[1]  John A. Bateman,et al.  Multimodal Film Analysis: How Films Mean , 2011 .

[2]  L. Mulvey.  Visual Pleasure and Narrative Cinema , 1975 .

[3]  David Parker,et al.  Analysing Media Texts , 2003 .

[4]  T. V. Leeuwen.  Speech, Music, Sound , 1999 .

[5]  S. Eisenstein,et al.  The Film Sense , 1942 .

[6]  David Parker,et al.  Making your Mark: digital inscription, animation, and a new visual semiotic , 2001 .

[7]  Damiana Gibbons,et al.  Tracing the Paths of Moving Artifacts in Youth Media Production , 2010 .

[8]  Patrick Cook.  Cinematic Hamlet: The Films of Olivier, Zeffirelli, Branagh, and Almereyda , 2011 .

[9]  Rebekah Willett.  Parodic Practices: Amateur Spoofs on Video-Sharing Sites , 2009 .

[10]  Jen Scott Curwood,et al.  “Just Like I Have Felt”: Multimodal Counternarratives in Youth-Produced Digital Media , 2009 .

[11]  Daniela De Paulis.  Le Voyage dans la Lune , 2014, Int. J. Arts Technol..

[12]  James Durran,et al.  Media Literacy in Schools: Practice, Production and Progression , 2007 .

[13]  Michael Halliday,et al.  An Introduction to Functional Grammar , 1985 .

[14]  Derek B. Scott,et al.  Orientalism and Musical Style , 1998 .

[15]  Henry Jenkins.  Textual Poachers: Television Fans & Participatory Culture , 1992 .

[16]  Bernard Shaw,et al.  Three Plays for Puritans , 1901 .

[17]  Theo van Leeuwen,et al.  Rhythmic Structure of the Film Text , 1985 .

[18]  Andrew Burn,et al.  Tiger's Big Plan: Multimodality and the Moving Image , 2003 .

[19]  Sandy Flitterman-Lewis,et al.  New vocabularies in film semiotics : structuralism, post-structuralism and beyond , 2005 .

[20]  Lea Jacobs,et al.  Theatre to Cinema: Stage Pictorialism and the Early Feature Film , 1998 .

[21]  Kendra Preston Leonard,et al.  “Silencing Ophelia: Male Aurality as a Controlling Element in Olivier’s Hamlet” , 2009 .

[22]  E. Goffman.  Frame analysis: An essay on the organization of experience , 1974 .

[23]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[24]  G. Kress,et al.  Multimodal Discourse: The Modes and Media of Contemporary Communication , 2002 .

[25]  Andrew Burn,et al.  Grabbing the Werewolf , 1999 .

[26]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[27]  David Bordwell,et al.  Post-Theory: Reconstructing Film Studies , 1997 .

[28]  Victoria Hurr.  Documenting an Encounter between art-film and multimodality informed by the production of digital moving images. , 2012 .