A Semantic Space Partitioning Approach to Virtual Camera Composition

In this paper, we present a semantic space partitioning (SSP) approach to the virtual camera composition problem. Virtual camera composition (VCC) consists in positioning a camera in a virtual world, such that the resulting image satises a set of visual cinematographic properties. Whereas most related works concentrate on numerically computing a unique camera position satisfying the problem, we offer to isolate identical possible solutions in 3D volumes with respect to their visual properties, and to propose them to the user. We introduce the notion of semantic volumes as an extension of visual aspects to characterize, compute and manipulate distinct solution sets. Our approach relies on (1) a space partitioning process derived from a study of possible camera locations w.r.t. to the objects in the scene and (2) local search numerical techniques to compute good representatives of each volume. This work is motivated by the lack of VCC tools in 3D software and the will to integrate cinematographic semantics in the description, solving and interaction processes. Experimental results illustrate the suitability of our approach for identifying and providing distinct solution sets. Furthermore, the exploitation of the semantic volumes lays the groundwork for natural and efcient user interaction by providing knowledge and reasoning on possible classes of solutions.

[1]  J. K. Lenstra,et al.  Local Search in Combinatorial Optimisation. , 1997 .

[2]  Geoff Wyvill,et al.  Field functions for implicit surfaces , 2005, The Visual Computer.

[3]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[4]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[5]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[6]  Jonathan H. Pickering Intelligent camera planning for computer graphics , 2002 .

[7]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[8]  Charles R. Dyer,et al.  Visibility, occlusion, and the aspect graph , 1990, International Journal of Computer Vision.

[9]  Patrick Olivier,et al.  CamPlan: A Camera Planning Agent , 2000 .

[10]  Yves Crama,et al.  Local Search in Combinatorial Optimization , 2018, Artificial Neural Networks.

[11]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[12]  Marc Christie,et al.  Modeling Camera Control with Constrained Hypertubes , 2002, CP.

[13]  William H. Bares,et al.  Virtual 3D camera composition from frame constraints , 2000, ACM Multimedia.

[14]  James F. Blinn,et al.  Where am I? What am I looking at? (cinematography) , 1988, IEEE Computer Graphics and Applications.

[15]  Thomas Strothotte,et al.  A Camera Engine for Computer Games: Managing the Trade‐Off Between Constraint Satisfaction and Frame Coherence , 2001, Comput. Graph. Forum.

[16]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[17]  Patrick Olivier,et al.  Visual Composition as Optimisation , 1999 .

[18]  J. Koenderink,et al.  The internal representation of solid shape with respect to vision , 1979, Biological Cybernetics.

[19]  Frank Jardillier,et al.  Screen‐Space Constraints for Camera Movements: the Virtual Cameraman , 1998, Comput. Graph. Forum.

[20]  Frédo Durand,et al.  The 3D visibility complex , 2002, TOGS.

[21]  James C. Lester,et al.  Realtime Constraint-Based Cinematography for Complex Interactive 3D Worlds , 1998, AAAI/IAAI.