Rig animation with a tangible and modular input device

We propose a novel approach to digital character animation, combining the benefits of tangible input devices and sophisticated rig animation algorithms. A symbiotic software and hardware approach facilitates the animation process for novice and expert users alike. We overcome limitations inherent to all previous tangible devices by allowing users to directly control complex rigs using only a small set (5-10) of physical controls. This avoids oversimplification of the pose space and excessively bulky device configurations. Our algorithm derives a small device configuration from complex character rigs, often containing hundreds of degrees of freedom, and a set of sparse sample poses. Importantly, only the most influential degrees of freedom are controlled directly, yet detailed motion is preserved based on a pose interpolation technique. We designed a modular collection of joints and splitters, which can be assembled to represent a wide variety of skeletons. Each joint piece combines a universal joint and two twisting elements, allowing to accurately sense its configuration. The mechanical design provides a smooth inverse kinematics-like user experience and is not prone to gimbal locking. We integrate our method with the professional 3D software Autodesk Maya® and discuss a variety of results created with characters available online. Comparative user experiments show significant improvements over the closest state-of-the-art in terms of accuracy and time in a keyframe posing task.

[1]  Chris Esposito,et al.  Of mice and monkeys: a specialized input device for virtual body animation , 1995, I3D '95.

[2]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[3]  David Salesin,et al.  Performance-driven hand-drawn animation , 2000, NPAR '00.

[4]  Hans-Peter Seidel,et al.  Interactive motion mapping for real‐time character control , 2014, Comput. Graph. Forum.

[5]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[6]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[7]  Junghyun Ahn,et al.  Motion Level-of-Detail: A Simplification Method on Crowd Scene , 2004 .

[8]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[9]  Olga Sorkine-Hornung,et al.  Fast automatic skinning transformations , 2012, ACM Trans. Graph..

[10]  Matthias Zwicker,et al.  Mesh-based inverse kinematics , 2005, ACM Trans. Graph..

[11]  Olga Sorkine-Hornung,et al.  Tangible and modular input device for character articulation , 2014, SIGGRAPH '14.

[12]  Paul Milgram,et al.  Measuring the allocation of control in a 6 degree-of-freedom docking experiment , 2000, CHI.

[13]  Taku Komura,et al.  Learning an inverse rig mapping for character animation , 2015, Symposium on Computer Animation.

[14]  Tong-Yee Lee,et al.  Skeleton extraction by mesh contraction , 2008, SIGGRAPH 2008.

[15]  Jessica K. Hodgins,et al.  Expressing animated performances through puppeteering , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[16]  Ken-ichi Anjyo,et al.  Direct Manipulation Blendshapes , 2010, IEEE Computer Graphics and Applications.

[17]  Maud Marchal,et al.  THING: Introducing a Tablet-based Interaction Technique for Controlling 3D Hand Models , 2015, CHI.

[18]  Andrew Nealen,et al.  AniMesh: interleaved animation, modeling, and editing , 2015, ACM Trans. Graph..

[19]  Jovan Popović,et al.  Semantic deformation transfer , 2009, SIGGRAPH 2009.

[20]  Maneesh Agrawala,et al.  3D puppetry: a kinect-based interface for 3D animation , 2012, UIST.

[21]  Olga Sorkine-Hornung,et al.  Rig animation with a tangible and modular input device , 2017, Interactions.

[22]  Martin Guay,et al.  The line of action , 2013, ACM Trans. Graph..

[23]  Hiroshi Ishii,et al.  LineFORM: Actuated Curve Interfaces for Display, Interaction, and Constraint , 2015, UIST.

[24]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[25]  Robert J. K. Jacob,et al.  Integrality and separability of input devices , 1994, TCHI.

[26]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[27]  Yuta Sugiura,et al.  An actuated physical puppet as an input device for controlling a digital manikin , 2011, CHI.

[28]  James Davis,et al.  Motion capture data retrieval using an artist’s doll , 2008, 2008 19th International Conference on Pattern Recognition.

[29]  Scott Schaefer,et al.  Example-based skeleton extraction , 2007, Symposium on Geometry Processing.

[30]  Zhigang Deng,et al.  Robust and accurate skeletal rigging from mesh sequences , 2014, ACM Trans. Graph..

[31]  Markus H. Gross,et al.  Rig-space physics , 2012, ACM Trans. Graph..

[32]  Markus H. Gross,et al.  Differential blending for expressive sketch-based posing , 2013, SCA '13.

[33]  Andrea Tagliasacchi,et al.  Mean Curvature Skeletons , 2012, Comput. Graph. Forum.

[34]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[35]  W. Kabsch A solution for the best rotation to relate two sets of vectors , 1976 .

[36]  Brian Knep,et al.  Dinosaur input device , 1995, CHI '95.

[37]  David Lindlbauer,et al.  Creature Teacher: A Performance-Based Animation System for Creating Cyclic Movements , 2015, SUI.

[38]  Alexandre Meyer,et al.  Multi-Layer Level of Detail For Character Animation , 2008, VRIPHYS.

[39]  Markus H. Gross,et al.  Sketch abstractions for character posing , 2015, Symposium on Computer Animation.

[40]  Martin Guay,et al.  Space-time sketching of character animation , 2015, ACM Trans. Graph..

[41]  Alec Jacobson,et al.  Skinning: real-time shape deformation , 2014, SIGGRAPH ASIA Courses.

[42]  Li-Wei Chan,et al.  FlexiBend: Enabling Interactivity of Multi-Part, Deformable Fabrications Using Single Shape-Sensing Strip , 2015, UIST.