Rhythmic-motion synthesis based on motion-beat analysis

Real-time animation of human-like characters is an active research area in computer graphics. The conventional approaches have, however, hardly dealt with the rhythmic patterns of motions, which are essential in handling rhythmic motions such as dancing and locomotive motions. In this paper, we present a novel scheme for synthesizing a new motion from unlabelled example motions while preserving their rhythmic pattern. Our scheme first captures the motion beats from the example motions to extract the basic movements and their transitions. Based on those data, our scheme then constructs a movement transition graph that represents the example motions. Given an input sound signal, our scheme finally synthesizes a novel motion in an on-line manner while traversing the motion transition graph, which is synchronized with the input sound signal and also satisfies kinematic constraints given explicitly and implicitly. Through experiments, we have demonstrated that our scheme can effectively produce a variety of rhythmic motions.

[1]  E. Forgy Cluster analysis of multivariate data : efficiency versus interpretability of classifications , 1965 .

[2]  Anil K. Jain,et al.  Clustering techniques: The user's dilemma , 1976, Pattern Recognit..

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  Lynne Anne Blom,et al.  The intimate act of choreography , 1982 .

[5]  P. Essens,et al.  Metrical and nonmetrical representations of temporal patterns , 1985, Perception & psychophysics.

[6]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[7]  S. Minton Choreography: A Basic Approach Using Improvisation , 1986 .

[8]  E. Fogel,et al.  Parameter estimation of quasi-periodic sequences , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[9]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[10]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Mira Balaban,et al.  Understanding music with AI: perspectives on music cognition , 1992 .

[13]  Jacqueline A. Jones,et al.  On the perception of meter , 1992 .

[14]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[15]  Joab R Winkler,et al.  Numerical recipes in C: The art of scientific computing, second edition , 1993 .

[16]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[17]  John F. Kolen,et al.  Resonance and the Perception of Musical Meter , 1994, Connect. Sci..

[18]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[19]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[20]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[21]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[22]  M. S. Kim General Schemes for Unit Quaternion Curve Construction , 1996 .

[23]  Robert Taylor,et al.  Disney's Aladdin: first steps toward storytelling in virtual reality , 1996, SIGGRAPH.

[24]  Shang Guo,et al.  A high-level control mechanism for human locomotion based on parametric frame space interpolation , 1996 .

[25]  John G. Proakis,et al.  Digital signal processing (3rd ed.): principles, algorithms, and applications , 1996 .

[26]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[27]  J. Hahn,et al.  Interpolation Synthesis of Articulated Figure Motion , 1997, IEEE Computer Graphics and Applications.

[28]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[29]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[30]  Brian M. Sadler,et al.  On periodic pulse interval analysis with outliers and missing observations , 1998, IEEE Trans. Signal Process..

[31]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[32]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[33]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[34]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[36]  Marc Parizeau,et al.  Training Hidden Markov Models with Multiple Observations-A Combinatorial Method , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[38]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[39]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[40]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[41]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[42]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[43]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[44]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[45]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[46]  BreglerChristoph,et al.  Motion capture assisted animation , 2002 .

[47]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[48]  Let's dance. , 2002, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[49]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[50]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[51]  Yong Hyun Shin,et al.  An Event-Driven Approach to Crowd Simulation with Example Motions , 2003 .

[52]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[53]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[54]  R. Thorne Entertainment, publishing and the arts handbook , 2004 .

[55]  Leonidas J. Guibas,et al.  Efficient Collision Detection among Moving Spheres with Unknown Trajectories , 2005, Algorithmica.