A Discourse Planning Approach to Cinematic Camera Control for Narratives in Virtual Environments

As the complexity of narrative-based virtual environments grows, the need for effective communication of information to the users of these systems increase. Effective camera control for narrative-oriented virtual worlds involves decision making at three different levels: choosing cinematic geometric composition, choosing the best camera parameters for conveying affective information, and choosing camera shots and transitions to maintain thetorical coherence. We propose a camera planning system that mirrors the film production pipeline; we describe our formalization of film idioms used to communicate affective information. Our representation of idioms captures their hierarchical nature, represents the causal motivation for selection of shots, and provides a way for the system designer to specify the ranking of candidate shot sequences.

[1]  Johanna D. Moore,et al.  Planning Text for Advisory Dialogues , 1989, ACL.

[2]  Gerhard Lakemeyer,et al.  An Autonomous Real-Time Camera Agent for Interactive Narratives and Games , 2003, IVA.

[3]  Allan Casebier,et al.  How to read a film , 1977 .

[4]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[5]  G. Ferguson.  Explicit Representation of Events, Actions and Plans for Assumption-Based Plan Reasoning , 1992 .

[6]  Johanna D. Moore,et al.  DPOCL: A Principled Approach To Discourse Planning , 1994, INLG.

[7]  William C. Mann,et al.  RHETORICAL STRUCTURE THEORY: A THEORY OF TEXT ORGANIZATION , 1987 .

[8]  R. Michael Young,et al.  An architecture for integrating plan-based behavior generation with interactive game environments , 2004, J. Game Dev..

[9]  Thomas Strothotte,et al.  A Camera Engine for Computer Games: Managing the Trade‐Off Between Constraint Satisfaction and Frame Coherence , 2001, Comput. Graph. Forum.

[10]  Mark T. Maybury,et al.  Communicative Acts for Explanation Generation , 1992, Int. J. Man Mach. Stud..

[11]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[12]  Steven M. Drucker,et al.  Intelligent Camera Control in a Virtual Environment , 1994 .

[13]  Joseph V. Maschelli,et al.  The Five C's of Cinematography , 1965 .

[14]  James C. Lester,et al.  Cinematographic User Models for Automated Realtime Camera Control in Dynamic 3D Environments , 1997 .

[15]  Eduard H. Hovy,et al.  Automated Discourse Generation Using Discourse Structure Relations , 1993, Artif. Intell..

[16]  Robert E. Mercer,et al.  Planning animation cinematography and shot structure to communicate theme and mood , 2002, SMARTGRAPH '02.

[17]  Bruce Blumberg,et al.  Expressive autonomous cinematography for interactive virtual environments , 2000, AGENTS '00.

[18]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.