Motion overview of human actions

During the last decade, motion capture data has emerged and gained a leading role in animations, games and 3D environments. Many of these applications require the creation of expressive overview video clips capturing the human motion, however sufficient attention has not been given to this problem. In this paper, we present a technique that generates an overview video based on the analysis of motion capture data. Our method is targeted for applications of 3D character based animations, automating, for example, the action summary and gameplay overview in simulations and computer games. We base our method on quantum annealing optimization with an objective function that respects the analysis of the character motion and the camera movement constraints. It automatically generates a smooth camera control path, splitting it to several shots if required. To evaluate our method, we introduce a novel camera placement metric which is evaluated against previous work and conduct a user study comparing our results with the various systems.

[1]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Godfried T. Toussaint,et al.  Nice Perspective Projections , 2001, J. Vis. Commun. Image Represent..

[3]  Thomas Strothotte,et al.  A Camera Engine for Computer Games: Managing the Trade‐Off Between Constraint Satisfaction and Frame Coherence , 2001, Comput. Graph. Forum.

[4]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[5]  James C. Lester,et al.  Intelligent multi-shot 3D visualization interfaces , 1999, Knowl. Based Syst..

[6]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[7]  Joseph V. Mascelli The five C's of cinematography : motion picture filming techniques simplified , 1965 .

[8]  Silvia Biasotti,et al.  What’s in an image? , 2005, The Visual Computer.

[9]  Patrick Olivier,et al.  Virtual Camera Planning: A Survey , 2005, Smart Graphics.

[10]  Steven M. Drucker,et al.  Intelligent Camera Control in a Virtual Environment , 1994 .

[11]  Mateu Sbert,et al.  Automatic View Selection Using Viewpoint Entropy and its Application to Image‐Based Modelling , 2003, Comput. Graph. Forum.

[12]  William H. Bares,et al.  A Model for Constraint-Based Camera Planning , 2000 .

[13]  Frank Jardillier,et al.  Screen‐Space Constraints for Camera Movements: the Virtual Cameraman , 1998, Comput. Graph. Forum.

[14]  Mongi A. Abidi,et al.  Shape analysis algorithm based on information theory , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  Sung Yong Shin,et al.  Example‐based motion cloning , 2004, Comput. Animat. Virtual Worlds.

[16]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[17]  Patrick Olivier,et al.  CamPlan: A Camera Planning Agent , 2000 .

[18]  John F. Hughes,et al.  Smooth interpolation of orientations with angular velocity constraints using quaternions , 1992, SIGGRAPH.

[19]  Ting-Chieh Lin,et al.  Cinematic Camera Control in 3D Computer Games , 2004, WSCG.

[20]  B. Apolloni,et al.  Quantum stochastic optimization , 1989 .

[21]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[22]  In-Kwon Lee,et al.  Determination of camera parameters for character motions using motion area , 2008, The Visual Computer.

[23]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[24]  Dimitri Plemenos,et al.  Virtual world explorations by using topological and semantic knowledge , 2007, The Visual Computer.

[25]  Patrick Olivier,et al.  Camera Control in Computer Graphics , 2008, Comput. Graph. Forum.

[26]  Marc Christie,et al.  Interval constraint solving for camera control and motion planning , 2000, TOCL.

[27]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[28]  Satoru Kawai,et al.  A simple method for computing general position in displaying three-dimensional objects , 1988, Comput. Vis. Graph. Image Process..

[29]  D. Cohen-Or,et al.  Action synopsis: pose selection and illustration , 2005, SIGGRAPH 2005.

[30]  M J Tarr,et al.  What Object Attributes Determine Canonical Views? , 1999, Perception.

[31]  David S. Doermann,et al.  Video summarization by curve simplification , 1998, MULTIMEDIA '98.

[32]  Steven D. Katz Film directing, shot by shot : visualizing from concept to screen , 1991 .

[33]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[34]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.