The Application of Video Semantics and Theme Representation in Automated Video Editing

This paper considers the automated generation of humorous video sequences from arbitrary video material. We present a simplified model of the editing process. We then outline our approach to narrativity and visual humour, discuss the problems of context and shot-order in video and consider influences on the editing process. We describe the role of themes and semantic fields in the generation of content oriented video scenes. We then present the architecture of AUTEUR, an experimental system that embodies mechanisms to interpret, manipulate and generate video. An example of a humorous video sequence generated by AUTEUR is described.

[1]  Gilles R. Bloch.  From Concepts to Film Sequences , 1988, RIAO.

[2]  T. Shultz.  A Cognitive-Developmental Analysis of Humour , 1976 .

[3]  John Preston Isenhour.  The effects of context and order in film editing , 1975 .

[4]  Glorianna Davenport,et al.  The Stratification System A Design Environment for Random Access Video , 2005 .

[5]  Andrew McTaggart,et al.  Signs and Meaning in the Cinema , 1969 .

[6]  Wendy G. Lehnert,et al.  Strategies for Natural Language Processing , 1982 .

[7]  Marc Davis,et al.  IDIC: assembling video sequences from story plans and content annotations , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[8]  Alan P. Parkes.  Settings and the setting structure: the description and automated propagation of networks for perusing videodisk image states , 1989, SIGIR '89.

[9]  Akio Nagasaka,et al.  Automatic structure visualization for video editing , 1993, INTERCHI.

[10]  John M. Carroll,et al.  Toward A Structural Psychology Of Cinema , 1980 .

[11]  Andrew S. Gordon,et al.  Conceptual Indexing for Video Retrieval , 1995 .

[12]  Alan P. Parkes.  An artificial intelligence approach to the conceptual description of videodisc images , 1988 .

[13]  G. Salomon,et al.  Television Formats, Mastery of Mental Skills, and the Acquisition of Knowledge. , 1977 .

[14]  R. Wilensky.  Points: a theory of the structure of stories in memory , 1986 .

[15]  Umberto Eco.  Einführung in die Semiotik. , 1972 .

[16]  Alan P. Parkes.  The prototype cloris system: Describing, retrieving and discussing videodisc stills and sequence , 1989, Inf. Process. Manag..

[17]  Marc Davis,et al.  Media streams: representing video for retrieval and repurposing , 1994, MULTIMEDIA '94.

[18]  R. Wilensky.  Story grammars versus story points , 1983, Behavioral and Brain Sciences.

[19]  H. Foot,et al.  Humour and laughter: Theory, research and applications. , 1976 .

[20]  S. Freud,et al.  Jokes and Their Relation to the Unconscious , 1905 .

[21]  Michael G. Dyer,et al.  BORIS - An Experiment in In-Depth Understanding of Narratives , 1983, Artif. Intell..

[22]  Yukinobu Taniguchi,et al.  Structured Video Computing , 1994, IEEE MultiMedia.

[23]  Glorianna Davenport,et al.  The Stratification System - A Design Emvironment for Random Access , 1992, NOSSDAV.

[24]  U. Frith,et al.  Perceiving the Language of Films , 1975, Perception.

[25]  Ramesh C. Jain,et al.  Architecture of a Multimedia Information System for Content-Based Retrieval , 1992, NOSSDAV.