Camera Control in Computer Graphics

Progress in modeling, animation and rendering means that rich, high fidelity interactive virtual worlds are now commonplace. But as photographers and cinematographers know, achievement of the intended informational and aesthetic goals is highly dependent on the position and motion of the camera in relation to the elements of the scene. Camera control encompasses interactive approaches, semi-automatic camera positioning, and fully declarative approaches to the management of a user’s viewpoint on a scene. Camera control is required in nearly all interactive 3D applications and presents a particular combination of technical challenges for which there have been a number of recent proposals (e.g. specific path-planning, management of occlusion, modeling of high-level communicative goals). We present classify the approaches, analyze the requirements and limits of solving techniques and explore in detail the main difficulties and challenges in automatic camera control.

[1]  Massimo Zancanaro,et al.  Automatic Video Composition , 2003, Smart Graphics.

[2]  James F. Blinn,et al.  Where am I? What am I looking at? (cinematography) , 1988, IEEE Computer Graphics and Applications.

[3]  Mark H. Overmars,et al.  Motion Planning for Camera Movements in Virtual Environments , 2003 .

[4]  Sung Je Hong,et al.  Through-the-lens camera control with a simple jacobian matrix , 1995 .

[5]  Marc Christie,et al.  Modeling Camera Control with Constrained Hypertubes , 2002, CP.

[6]  William H. Bares,et al.  Virtual 3D camera composition from frame constraints , 2000, ACM Multimedia.

[7]  William H. Bares.  A Photographic Composition Assistant for Intelligent Virtual 3D Camera Systems , 2006, Smart Graphics.

[8]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[9]  Dimitri Plemenos,et al.  Methods and data structures for virtual world exploration , 2006, The Visual Computer.

[10]  Mateu Sbert,et al.  Automatic View Selection Using Viewpoint Entropy and its Application to Image‐Based Modelling , 2003, Comput. Graph. Forum.

[11]  Anselmo Lastra,et al.  Proceedings of the 2005 symposium on Interactive 3D graphics and games , 2005, I3D 2005.

[12]  Frederick P. Brooks,et al.  Walkthrough—a dynamic graphics system for simulating virtual buildings , 1987, I3D '86.

[13]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[14]  Steffi Beckhaus,et al.  Dynamic potential fields for guided exploration in virtual environments , 2002 .

[15]  Luke S. Zettlemoyer,et al.  Task-sensitive cinematography interfaces for interactive 3D learning environments , 1998, IUI '98.

[16]  Patrice Torguet,et al.  Virtual Storytelling Using Virtual Reality Technologies for Storytelling , 2001, Lecture Notes in Computer Science.

[17]  James C. Lester,et al.  Cinematographic User Models for Automated Realtime Camera Control in Dynamic 3D Environments , 1997 .

[18]  George W. Fitzmaurice,et al.  HoverCam: interactive 3D navigation for proximal object inspection , 2005, I3D '05.

[19]  Patrizia Palamidese.  A Camera Motion Metaphor Based on Film Grammar , 1996 .

[20]  Christopher G. Healey,et al.  Assisted navigation for large information spaces , 2002, IEEE Visualization, 2002. VIS 2002..

[21]  Nicolas Courty,et al.  Controlling a camera in a virtual environment , 2002, The Visual Computer.

[22]  Desney S. Tan,et al.  Exploring 3D navigation: combining speed-coupled flying with orbiting , 2001, CHI.

[23]  Nicolas Courty,et al.  A Cinematography System for Virtual Storytelling , 2003, International Conference on Virtual Storytelling.

[24]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[25]  Eric A. Wernert,et al.  Constrained 3D navigation with 2D controllers , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[26]  Steven K. Feiner,et al.  Supporting interactivity in automated 3D illustrations , 1993, IUI '93.

[27]  Nicolas Courty,et al.  Computer animation: a new application for image-based visual servoing , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[28]  William H. Bares,et al.  A Model for Constraint-Based Camera Planning , 2000 .

[29]  Satoru Kawai,et al.  A simple method for computing general position in displaying three-dimensional objects , 1988, Comput. Vis. Graph. Image Process..

[30]  Pere-Pau Vázquez,et al.  Way‐Finder: guided tours through complex walkthrough models , 2004, Comput. Graph. Forum.

[31]  M. Zancanaro,et al.  Using Cinematic Techniques in a Multimedia Museum Guide. , 2003 .

[32]  Dimitri Plemenos,et al.  Viewpoint quality and scene understanding , 2005, VAST.

[33]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[34]  Steven M. Drucker,et al.  Intelligent Camera Control in a Virtual Environment , 1994 .

[35]  Mateu Sbert,et al.  Viewpoint Selection using Viewpoint Entropy , 2001, VMV.

[36]  Steven M. Drucker,et al.  Intelligent camera control for graphical environments , 1994 .

[37]  Steven M. Drucker,et al.  CINEMA: a system for procedural camera movements , 1992, I3D '92.

[38]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[39]  Steven K. Feiner,et al.  Evaluation of visual balance for automated layout , 2004, IUI '04.

[40]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[41]  Patrick Olivier,et al.  Visual Composition as Optimisation , 1999 .

[42]  J. Koenderink,et al.  The internal representation of solid shape with respect to vision , 1979, Biological Cybernetics.

[43]  Frank Jardillier,et al.  Screen‐Space Constraints for Camera Movements: the Virtual Cameraman , 1998, Comput. Graph. Forum.

[44]  Wolfgang Stuerzlinger,et al.  Imaging all Visible Surfaces , 1999, Graphics Interface.

[45]  Daniel Thalmann,et al.  Physically-based interactive camera motion control using 3D input devices , 1991 .

[46]  Tsai-Yen Li,et al.  An intelligent 3D user interface adapting to user control behaviors , 2004, IUI '04.

[47]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[48]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[49]  James C. Lester,et al.  Intelligent multi-shot visualization interfaces for dynamic 3D worlds , 1998, IUI '99.

[50]  Marc Cavazza,et al.  Real-Time Camera Control for Interactive Storytelling , 2002, GAME-ON.

[51]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[52]  Jock D. Mackinlay,et al.  Rapid controlled movement through a virtual 3D workspace , 1990, SIGGRAPH.

[53]  William D. Smart,et al.  Say Cheese! Experiences with a Robot Photographer , 2004, AI Mag..

[54]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[55]  E. Krupinski,et al.  The Role of Formal Art Training on Perception and Aesthetic Judgment of Art Compositions , 2017 .

[56]  Abdul Sattar,et al.  Applying Constraint Weighting to Autonomous Camera Control , 2005, AIIDE.

[57]  Gregory D. Hager,et al.  Dynamic sensor planning in visual servoing , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[58]  Tsai-Yen Li,et al.  An Interactive Camera Planning System for Automatic Cinematographer , 2005, 11th International Multimedia Modelling Conference.

[59]  James C. Lester,et al.  Realtime Constraint-Based Cinematography for Complex Interactive 3D Worlds , 1998, AAAI/IAAI.

[60]  Steven K. Feiner,et al.  Automated generation of intent-based 3D Illustrations , 1991, SIGGRAPH.

[61]  Hana Rudová.  Over-Constrained Systems , 1999, AAAI/IAAI.

[62]  George W. Fitzmaurice,et al.  StyleCam: interactive stylized 3D navigation using integrated spatial & temporal controls , 2002, UIST '02.

[63]  Dirk Bartz,et al.  Virtual voyage: interactive navigation in the human colon , 1997, SIGGRAPH.

[64]  Patrick Olivier,et al.  CamPlan: A Camera Planning Agent , 2000 .

[65]  Donghyun Kim,et al.  A camera control interface based on the visualization of subspaces of the 6D motion space of the camera , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[66]  Hiroshi Hosobe.  Hierarchical nonlinear constraint satisfaction , 2004, SAC '04.

[67]  John F. Hughes,et al.  User-guided composition effects for art-based rendering , 2001, I3D '01.

[68]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[69]  Yang Shan-qing.  Automatic Viewing Control for 3D Direct Manipulation , 2007 .

[70]  Carol O'Sullivan,et al.  Predicting and Evaluating Saliency for Simplified Polygonal Models , 2005, TAP.

[71]  Yishai A. Feldman,et al.  Knowledge-Based Cinematography and Its Applications , 2004, ECAI.

[72]  Charles R. Dyer,et al.  Visibility, occlusion, and the aspect graph , 1990, International Journal of Computer Vision.

[73]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[74]  Roger J. Hubbold,et al.  Navigation guided by artificial force fields , 1998, CHI.

[75]  Andrew S. Forsberg,et al.  UniCam—2D gestural camera controls for 3D environments , 1999, SI3D.

[76]  Dinesh Manocha,et al.  Interactive navigation in complex environments using path planning , 2003, I3D '03.

[77]  Marc Christie,et al.  Interval constraint solving for camera control and motion planning , 2000, TOCL.

[78]  William H. Bares,et al.  Storyboard frame editing for cinematic composition , 2002, IUI '02.

[79]  Han-Wei Shen,et al.  View selection for volume rendering , 2005, VIS 05. IEEE Visualization, 2005..

[80]  R. Rosenholtz.  A simple saliency model predicts a number of motion popout phenomena , 1999, Vision Research.

[81]  Marc Christie,et al.  A Constraint-Based Approach to Camera Path Planning , 2003, Smart Graphics.

[82]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[83]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[84]  Jonathan H. Pickering.  Intelligent camera planning for computer graphics , 2002 .

[85]  John M. Snyder,et al.  Interval analysis for computer graphics , 1992, SIGGRAPH.

[86]  Tsai-Yen Li,et al.  An intelligent user interface with motion planning for 3D navigation , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[87]  Michael Werman,et al.  On View Likelihood and Stability , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[88]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[89]  Bruce Blumberg,et al.  Expressive autonomous cinematography for interactive virtual environments , 2000, AGENTS '00.

[90]  Mateu Sbert,et al.  Importance-Driven Focus of Attention , 2006, IEEE Transactions on Visualization and Computer Graphics.

[91]  Nicolas Courty,et al.  Animation référencée vision : de la tâche au comportement , 2002 .

[92]  Thomas Strothotte,et al.  A Camera Engine for Computer Games: Managing the Trade‐Off Between Constraint Satisfaction and Frame Coherence , 2001, Comput. Graph. Forum.

[93]  Andreas Butz,et al.  Animation with CATHI , 1997, AAAI/IAAI.

[94]  Joseph V. Mascelli.  The five C's of cinematography : motion picture filming techniques simplified , 1965 .

[95]  Zhengrong Liang,et al.  Interactive Path Planning for Virtual Endoscopy , 1999 .

[96]  Joan E. Hart,et al.  Film Directing Shot by Shot: Visualizing from Concept to Screen , 1991 .

[97]  Wolfgang Straßer,et al.  A case study on automatic camera placement and motion for visualizing historical data , 2002, IEEE Visualization, 2002. VIS 2002..

[98]  Dani Lischinski,et al.  Automatic camera placement for image-based modeling , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[99]  WareColin,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990 .