Extracting information about emotions in films

We present a method being developed to extract information about characters' emotions in films. It is suggested that this information can help describe higher levels of multimedia semantics relating to narrative structures. Our method extracts information from audio description that is provided for the visually-impaired with an increasing number of films. The method is based on a cognitive theory of emotions that links a character's emotional states to the events in their environment. In this paper the method is described along with some preliminary evaluation and discussions about the kinds of novel video retrieval and browsing applications it may support.

[1]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[2]  Volker Roth Content-based retrieval from digital video , 1999, Image Vis. Comput..

[3]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[4]  Robert B. Allen,et al.  Browsing the structure of multimedia stories , 2000, DL '00.

[5]  William H Fenn,et al.  The English patient. , 2003, JAAPA : official journal of the American Academy of Physician Assistants.

[6]  Svetha Venkatesh,et al.  Computational Media Aesthetics: Finding Meaning Beautiful , 2001, IEEE Multim..