Motion retiming by using bilateral time control surfaces

Motion retiming is an important tool used to edit character animations. It consists of changing the time at which an action occurs during an animation. One example might be editing an animation of a person playing football to change the precise time at which the ball is kicked. It is, nevertheless, a non-trivial task to retime the motion of a set of joints, since spatio-temporal correlation exists among them. It is especially difficult in the case of motion capture, when there are forward kinematic keys on every frame, to define the motion. In this paper, we present a novel approach to motion retiming that exploits the proximity of joints to preserve the motion coherence when a retiming operation is performed. We introduce the bilateral time control surface (BTCS), a framework that allows users to intuitively and interactively retime motion. The BTCS is a free-form surface, located on the timeline, that can be interactively deformed to move the action of a particular joint to a certain time, while preserving the coherency and smoothness of surrounding joints. The animation is retimed by manipulating successive BTCSs, and the final animation is generated by resampling the original motion by time spans defined by the BTCSs. Graphical abstractDisplay Omitted HighlightsIntroducing a new retiming formulation that can easily control motion curves and keyframes.An interactive and intuitive retiming interface without the need for modifying motion curves independently.Bilateral filtering for ensuring that edits are applied within a character's topological distance on a time surface.A new visualization technique of spatio-temporal motion data in 3D space.

[1]  Karan Singh,et al.  Finger walking: motion editing with contact-based hand performance , 2012, SCA '12.

[2]  Martin Guay,et al.  The line of action , 2013, ACM Trans. Graph..

[3]  Taku Komura,et al.  Indexing and Retrieving Motions of Characters in Close Contact , 2009, IEEE Transactions on Visualization and Computer Graphics.

[4]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[5]  Michael Gleicher,et al.  Staggered poses: a character motion representation for detail-preserving editing of pose and coordinated timing , 2008, SCA '08.

[6]  BodenheimerBobby,et al.  Verbs and Adverbs , 1998 .

[7]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[8]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[9]  Jovan Popovic,et al.  Guided time warping for motion editing , 2007, SCA '07.

[10]  Lucas Kovar,et al.  Splicing Upper‐Body Actions with Locomotion , 2006, Comput. Graph. Forum.

[11]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Taku Komura,et al.  An Energy-Driven Motion Planning Method for Two Distant Postures , 2015, IEEE Transactions on Visualization and Computer Graphics.

[13]  Siddhartha S. Srinivasa,et al.  Physics-based motion retiming , 2006, SCA '06.

[14]  Haibin Yin,et al.  cNV SRAM: CMOS Technology Compatible Non-Volatile SRAM Based Ultra-Low Leakage Energy Hybrid Memory System , 2016, IEEE Transactions on Computers.

[15]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[16]  Michael Cohen,et al.  Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, San Antonio, TX, USA, July 21-22, 2002 , 2002, Symposium on Computer Animation.

[17]  Jehee Lee,et al.  Tiling Motion Patches , 2013, IEEE Transactions on Visualization and Computer Graphics.

[18]  Tomohiko Mukai,et al.  Pose-timeline for propagating motion edits , 2009, SCA '09.

[19]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2005 .

[20]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[21]  Michael Neff,et al.  AER: aesthetic exploration and refinement for expressive character animation , 2005, SCA '05.

[22]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[23]  Bedrich Benes,et al.  Sketching human character animations by composing sequences from large motion database , 2013, The Visual Computer.

[24]  Jehee Lee,et al.  Synchronized multi-character motion editing , 2009, ACM Trans. Graph..

[25]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2005, Symposium on Computer Animation.

[26]  Michael Neff,et al.  Aesthetic edits for character animation , 2003, SCA '03.

[27]  Sílvio César Lizana Terra,et al.  Performance timing for keyframe animation , 2004, SCA '04.