Toward the Automated Editing of Theme Oriented Video Sequences

This article considers the automated generation of humorous video sequences from arbitrary video material. We present a simplified model of the editing process. We then outline our approach to narrativity and visual humor, discuss the problems of context and shot order in video, and consider influences on the editing process. We describe the role of themes and semantic fields in the generation of content-oriented video scenes. We then present the architecture of AUTEUR, an experimental system that embodies mechanisms to interpret, manipulate, and generate video. An example of a humorous video sequence generated by AUTEUR is described.

[1]  李幼升,et al.  Ph , 1989 .

[2]  Akio Nagasaka,et al.  Automatic structure visualization for video editing , 1993, INTERCHI.

[3]  U. Frith,et al.  Perceiving the Language of Films , 1975, Perception.

[4]  Ramesh C. Jain,et al.  Architecture of a Multimedia Information System for Content-Based Retrieval , 1992, NOSSDAV.

[5]  Alan P. Parkes.  The prototype cloris system: Describing, retrieving and discussing videodisc stills and sequence , 1989, Inf. Process. Manag..

[6]  Marc Davis,et al.  Media streams: representing video for retrieval and repurposing , 1994, MULTIMEDIA '94.

[7]  Roman Jakobson,et al.  Fundamentals of Language , 1957 .

[8]  R. Wilensky.  Points: a theory of the structure of stories in memory , 1986 .

[9]  R. Wilensky.  Story grammars versus story points , 1983, Behavioral and Brain Sciences.

[10]  Michael G. Dyer,et al.  BORIS - An Experiment in In-Depth Understanding of Narratives , 1983, Artif. Intell..

[11]  Glorianna Davenport,et al.  The Stratification System - A Design Emvironment for Random Access , 1992, NOSSDAV.

[12]  Marc Davis,et al.  IDIC: assembling video sequences from story plans and content annotations , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[13]  John Preston Isenhour.  The effects of context and order in film editing , 1975 .

[14]  Alan P. Parkes.  Settings and the setting structure: the description and automated propagation of networks for perusing videodisk image states , 1989, SIGIR '89.

[15]  V. Pudovkin,et al.  Film Technique and Film Acting , 1968 .

[16]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[17]  Andrew S. Gordon,et al.  Conceptual Indexing for Video Retrieval , 1995 .

[18]  Ferdinand de Saussure.  Course in General Linguistics , 1916 .

[19]  G. Salomon,et al.  Television Formats, Mastery of Mental Skills, and the Acquisition of Knowledge. , 1977 .

[20]  S. Freud,et al.  Jokes and Their Relation to the Unconscious , 1905 .

[21]  Allan Casebier,et al.  How to read a film , 1977 .

[22]  Gilles R. Bloch.  From Concepts to Film Sequences , 1988, RIAO.

[23]  T. Shultz.  A Cognitive-Developmental Analysis of Humour , 1976 .

[24]  Alan P. Parkes.  An artificial intelligence approach to the conceptual description of videodisc images , 1988 .

[25]  Yukinobu Taniguchi,et al.  Structured Video Computing , 1994, IEEE MultiMedia.

[26]  John M. Carroll,et al.  Toward A Structural Psychology Of Cinema , 1980 .