Music-driven character animation

Music-driven character animation extracts musical features from a song and uses them to create an animation. This article presents a system that builds a new animation directly from musical attributes, rather than simply synchronizing it to the music like similar systems. Using a simple script that identifies the movements involved in the performance and their timing, the user can easily control the animation of characters. Another unique feature of the system is its ability to incorporate multiple characters into the same animation, both with synchronized and unsynchronized movements. A system that integrates Celtic dance movements is developed in this article. An evaluation of the results shows that the majority of animations are found to be appealing to viewers and that altering the music can change the attractiveness of the final result.

[1]  Anna Woch,et al.  Using the framework of the kinematic theory for the definition of a movement primitive. , 2004, Motor control.

[2]  Sung Yong Shin,et al.  Rhythmic-motion synthesis based on motion-beat analysis , 2003, ACM Trans. Graph..

[3]  Gazihan Alankus,et al.  Automated Motion Synthesis for Virtual Choreography , 2004 .

[4]  Yoichi Muraoka,et al.  Real-time beat tracking for drumless audio signals: Chord change detection for musical decisions , 1999, Speech Commun..

[5]  Simon Dixon,et al.  Analysis of musical expression in audio signals , 2003, IS&T/SPIE Electronic Imaging.

[6]  Gazihan Alankus,et al.  Automated motion synthesis for dancing characters: Motion Capture and Retrieval , 2005 .

[7]  Frédéric H. Pighin,et al.  Expressive speech-driven facial animation , 2005, TOGS.

[8]  Gazihan Alankus,et al.  Automated motion synthesis for dancing characters , 2005, Comput. Animat. Virtual Worlds.

[9]  Atsushi Nakazawa,et al.  Dancing‐to‐Music Character Animation , 2006, Comput. Graph. Forum.

[10]  Eric D. Scheirer,et al.  Tempo and beat analysis of acoustic musical signals. , 1998, The Journal of the Acoustical Society of America.

[11]  Masataka Goto,et al.  An Audio-based Real-time Beat Tracking System for Music With or Without Drum-sounds , 2001 .

[12]  Atsushi Nakazawa,et al.  Detecting dance motion structure through music analysis , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[13]  Newton Lee,et al.  ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMCCAP) , 2007, CIE.

[14]  George Tzanetakis,et al.  Audio Analysis using the Discrete Wavelet Transform , 2001 .

[15]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[16]  Daniel Torres,et al.  Using Music to Interact with a Virtual Character , 2005, NIME.

[17]  Mark B. Sandler,et al.  A tutorial on onset detection in music signals , 2005, IEEE Transactions on Speech and Audio Processing.

[18]  M. Cardle,et al.  Music-driven motion editing: local motion transformations guided by music analysis , 2002, Proceedings 20th Eurographics UK Conference.

[19]  In-Kwon Lee,et al.  Automatic Synchronization of Background Music and Motion in Computer Animation , 2005, Comput. Graph. Forum.

[20]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[21]  Yoichi Muraoka,et al.  A beat tracking system for acoustic signals of music , 1994, MULTIMEDIA '94.