Smooth key framing using the image plane

Key framing is an integral part of the animation making process. The user places the camera in a sequence of "key" positions, and the computer produces a set of intermediate camera locations that interpolates between these key frames. Traditional methods treat the camera as just another 3D object in the scene, with intermediate frames produced by interpolating the position and focal point of the camera in space. Unlike a 3D object, however, the camera's role is to project the 3D scene into 2D. The user indirectly controls the projection -- how objects in the scene are placed in the 2D image -- by adjusting the camera parameters for each key frame. Automatic 3D camera interpolation adds yet another layer of indirection. The net effect is that the user must solve a complicated inverse problem in order to move objects across the 2D scene in the desired manner. Figure 1 shows an example where the user wanted the table to move down and across the scene while moving the view to the top of the table. Traditional interpolation (top row) rotates the table out of the view. Correcting this using traditional approaches requires the addition of a substantial number of key frames which in turn reduce the smoothness of the motion.

[1]  James C. Michener,et al.  Natural and efficient viewing parameters , 1980, SIGGRAPH '80.

[2]  William H. Bares,et al.  A Model for Constraint-Based Camera Planning , 2000 .

[3]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[4]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[5]  Bruce Blumberg,et al.  Expressive autonomous cinematography for interactive virtual environments , 2000, AGENTS '00.

[6]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[7]  James C. Lester,et al.  Realtime Constraint-Based Cinematography for Complex Interactive 3D Worlds , 1998, AAAI/IAAI.

[8]  Richard H. Bartels,et al.  Constraint-based curve manipulation , 1993, IEEE Computer Graphics and Applications.

[9]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[10]  David H. Eberly,et al.  3D Game Engine Design , 2001 .

[11]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[12]  Marc Alexa,et al.  Linear combination of transformations , 2002, ACM Trans. Graph..

[13]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[14]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  John F. Hughes,et al.  Smooth interpolation of orientations with angular velocity constraints using quaternions , 1992, SIGGRAPH.

[16]  Lei Wang,et al.  A 3D Pattern for Post Estimation for Object Capture , 2003 .

[17]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[18]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[19]  M. Carter Computer graphics: Principles and practice , 1997 .

[20]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Songde Ma,et al.  Conics-based stereo, motion estimation, and pose determination , 1993, International Journal of Computer Vision.

[22]  Patrick Olivier,et al.  CamPlan: A Camera Planning Agent , 2000 .

[23]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[24]  Karan Singh,et al.  The IBar: a perspective-based camera widget , 2004, UIST '04.

[25]  Bill Triggs,et al.  Camera pose and calibration from 4 or 5 known 3D points , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[26]  Lihong Zhi,et al.  A complete symbolic-numeric linear method for camera pose determination , 2003, ISSAC '03.

[27]  Sung Yong Shin,et al.  A C/sup 2/-continuous B-spline quaternion curve interpolating a given sequence of solid orientations , 1995, Proceedings Computer Animation'95.

[28]  William H. Bares,et al.  Virtual 3D camera composition from frame constraints , 2000, ACM Multimedia.

[29]  H. Pottmann,et al.  Energy-minimizing splines in manifolds , 2004, SIGGRAPH 2004.