A Probabilistic Framework for Extracting Narrative Act Boundaries and Semantics in Motion Pictures

This work constitutes the first attempt to extract the important narrative structure, the 3-Act storytelling paradigm in film. Widely prevalent in the domain of film, it forms the foundation and framework in which a film can be made to function as an effective tool for story telling, and its extraction is a vital step in automatic content management for film data. The identification of act boundaries allows for structuralizing film at a level far higher than existing segmentation frameworks, which include shot detection and scene identification, and provides a basis for inferences about the semantic content of dramatic events in film. A novel act boundary likelihood function for Act 1 and 2 is derived using a Bayesian formulation under guidance from film grammar, tested under many configurations and the results are reported for experiments involving 25 full-length movies. The result proves to be a useful tool in both the automatic and semi-interactive setting for semantic analysis of film, with potential application to analogues occuring in many other domains, including news, training video, sitcoms.

[1]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Thomas Sobchack,et al.  An Introduction to Film , 1980 .

[3]  Robert L. Winkler,et al.  An Introduction to Bayesian Inference and Decision , 1972 .

[4]  Rainer Lienhart,et al.  Scene Determination Based on Video and Audio Features , 2004, Multimedia Tools and Applications.

[5]  Kristin Thompson,et al.  Storytelling in the New Hollywood: Understanding Classical Narrative Technique , 1999 .

[6]  C. Vogler The writer's journey : mythic structure for storytellers and screenwriters , 1999 .

[7]  Wolfgang Effelsberg,et al.  Scene Determination Based on Video and Audio Features , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  A. Gulland,et al.  French connection. , 1997, Nursing times.

[9]  Peter Bøgh Andersen,et al.  Designing Interactive Narratives , 2001 .

[10]  Svetha Venkatesh,et al.  Formulating Film Tempo , 2002 .

[11]  Dennis V. Lindley,et al.  An Introduction to Bayesian Inference and Decision , 1974 .

[12]  Svetha Venkatesh,et al.  Computational Media Aesthetics: Finding Meaning Beautiful , 2001, IEEE Multim..

[13]  Svetha Venkatesh,et al.  Bridging the Semantic Gap in Content Management Systems , 2002 .

[14]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[15]  Ying Li,et al.  Semantic video content abstraction based on multiple cues , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[16]  William Goldman,et al.  Adventures in the Screen Trade: A Personal View of Hollywood and Screenwriting , 1983 .

[17]  Raymond Spottiswoode,et al.  A grammar of the film , 1950 .

[18]  S. Field Screenplay: The Foundations of Screenwriting , 1979 .

[19]  Robert McKee,et al.  Story: Substance, Structure, Style, and the Principles of Screenwriting , 1997 .

[20]  Svetha Venkatesh,et al.  Towards automatic extraction of expressive elements from motion pictures: tempo , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[21]  Svetha Venkatesh,et al.  Bridging the semantic gap in content management : computational media aesthetics , 2001 .