Virtual 3D camera composition from frame constraints

We have designed a graphical interface that enables 3D visual artists or developers of interactive 3D virtual environments to efficiently define sophisticated camera compositions by creating storyboard frames, indicating how a desired shot should appear. These storyboard frames are then automatically encoded into an extensive set of virtual camera constraints that capture the key visual composition elements of the storyboard frame. Visual composition elements include the size and position of a subject in a camera shot. A recursive heuristic constraint solver then searches the space of a given 3D virtual environment to determine camera parameter values which produce a shot closely matching the one in the given storyboard frame. The search method uses given ranges of allowable parameter values expressed by each constraint to reduce the size of the 7 Degree of Freedom search space of possible camera positions, aim direction vectors, and field of view angles. In contrast, some existing methods of automatically positioning cameras in 3D virtual environments rely on pre-defined camera placements that cannot account for unanticipated configurations and movement of objects or use program-like scripts to define constraint-based camera shots. For example, it is more intuitive to directly manipulate an object's size in the frame rather than editing a constraint script to specify that the object should cover 10% of the frame's area.

[1]  Norman I. Badler,et al.  Automatic viewing control for 3D direct manipulation , 1992, I3D '92.

[2]  Steven M. Drucker,et al.  Intelligent camera control for graphical environments , 1994 .

[3]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[4]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[5]  Eric A. Wernert,et al.  Constrained 3D navigation with 2D controllers , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[6]  Patrick Olivier,et al.  CamPlan: A Camera Planning Agent , 2000 .

[7]  Gerald Millerson,et al.  Video camera techniques , 1983 .

[8]  WareColin,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990 .

[9]  李幼升,et al.  Ph , 1989 .

[10]  Stephen Katz Film directing shot by shot , 1991 .

[11]  Andreas Butz,et al.  Anymation with CATHI , 1997, AAAI 1997.

[12]  James F. Blinn,et al.  Where am I? What am I looking at? (cinematography) , 1988, IEEE Computer Graphics and Applications.

[13]  Wolfgang Wahlster,et al.  WIP: The Automatic Synthesis of Multimodal Presentations , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[14]  Colin Ware,et al.  Context sensitive flying interface , 1997, SI3D.

[15]  James C. Lester,et al.  Intelligent multi-shot visualization interfaces for dynamic 3D worlds , 1998, IUI '99.

[16]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[17]  Patrick Olivier,et al.  Visual Composition as Optimisation , 1999 .

[18]  Frank Jardillier,et al.  Screen‐Space Constraints for Camera Movements: the Virtual Cameraman , 1998, Comput. Graph. Forum.

[19]  Steven K. Feiner,et al.  Automated presentation planning of animation using task decomposition with heuristic reasoning , 1993 .

[20]  Steven K. Feiner,et al.  Automated generation of intent-based 3D Illustrations , 1991, SIGGRAPH.

[21]  Jock D. Mackinlay,et al.  Rapid controlled movement through a virtual 3D workspace , 1990, SIGGRAPH.

[22]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[23]  Joseph V. Maschelli,et al.  The Five C's of Cinematography , 1965 .

[24]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[25]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[26]  Bryan Peterson,et al.  Learning to See Creatively , 1988 .

[27]  Steven K. Feiner,et al.  Apex: An Experiment in the Automated Creation of Pictorial Explanations , 1985, IEEE Computer Graphics and Applications.