Tangible and modular input device for character articulation

Interactively articulating virtual 3D characters lies at the heart of computer animation and geometric modeling. Expressive articulation requires control over many degrees of freedom: most often the joint angles of an internal skeleton. We introduce a physical input device assembled on the fly to control any character's skeleton directly. With traditional mouse and keyboard input, animators must rely on indirect methods such as inverse kinematics or decompose complex and integrated motions into smaller sequential manipulations---for example, iteratively positioning each bone of a skeleton hierarchy. While direct manipulation mouse and touch interfaces are successful in 2D [Shneiderman 1997], 3D interactions with 2D input are ill-posed and thus more challenging. Successful commercial products with 2D interfaces, e.g. Autodesk's Maya, have notoriously steep learning curves and require interface-specific training.

[1]  Antonis A. Argyros,et al.  Tracking the articulated motion of two strongly interacting hands , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Matthias Zwicker,et al.  Ieee Transactions on Visualization and Computer Graphics Ewa Splatting , 2002 .

[3]  Robert J. K. Jacob,et al.  Integrality and separability of input devices , 1994, TCHI.

[4]  Jovan Popović,et al.  Semantic deformation transfer , 2009, SIGGRAPH 2009.

[5]  Maneesh Agrawala,et al.  3D puppetry: a kinect-based interface for 3D animation , 2012, UIST.

[6]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[7]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[8]  Yuta Sugiura,et al.  An actuated physical puppet as an input device for controlling a digital manikin , 2011, CHI.

[9]  C. Karen Liu,et al.  Performance-based control interface for character animation , 2009, SIGGRAPH 2009.

[10]  Chris Esposito,et al.  Of mice and monkeys: a specialized input device for virtual body animation , 1995, I3D '95.

[11]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[12]  James Davis,et al.  Motion capture data retrieval using an artist’s doll , 2008, 2008 19th International Conference on Pattern Recognition.

[13]  Yeongho Seol,et al.  Creature features: online motion puppetry for non-human characters , 2013, SCA '13.

[14]  Jovan Popovic,et al.  Automatic rigging and animation of 3D characters , 2007, ACM Trans. Graph..

[15]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[16]  Antti Oulasvirta,et al.  Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[18]  Ying He,et al.  A Sketching Interface for Sitting Pose Design in the Virtual Environment , 2012, IEEE Transactions on Visualization and Computer Graphics.

[19]  Danica Kragic,et al.  Hands in action: real-time 3D reconstruction of hands in interaction with objects , 2010, 2010 IEEE International Conference on Robotics and Automation.

[20]  Andrew W. Fitzgibbon,et al.  KinÊtre: animating the world with the human body , 2012, UIST.

[21]  Leila De Floriani,et al.  A Dimension-Independent Data Structure for Simplicial Complexes , 2010, IMR.

[22]  Hans-Peter Seidel,et al.  Automatically Rigging Multi‐component Characters , 2012, Comput. Graph. Forum.

[23]  E. Shibayama,et al.  Animation System with Superimposing CG on a Physical Armature , 2004 .

[24]  Jovan Popovic,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH '09.

[25]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[26]  Bruce Blumberg,et al.  Sympathetic interfaces: using a plush toy to direct synthetic characters , 1999, CHI '99.

[27]  Geoffrey E. Hinton,et al.  A Desktop Input Device and Interface for Interactive 3D Character Animation , 2002, Graphics Interface.

[28]  Doug L. James,et al.  Fabricating articulated characters from skinned meshes , 2012, ACM Trans. Graph..

[29]  Daniele Panozzo,et al.  Implicit Hierarchical Quad‐Dominant Meshes , 2011, Comput. Graph. Forum.

[30]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[31]  Andrea Tagliasacchi,et al.  Mean Curvature Skeletons , 2012, Comput. Graph. Forum.

[32]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[33]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[34]  W. Kabsch A solution for the best rotation to relate two sets of vectors , 1976 .

[35]  Brian Knep,et al.  Dinosaur input device , 1995, CHI '95.

[36]  Ben Shneiderman,et al.  Direct manipulation for comprehensible, predictable and controllable user interfaces , 1997, IUI '97.

[37]  Walid G. Aref,et al.  Proceedings of the 16th ACM SIGSPATIAL international conference on Advances in geographic information systems , 2008, GIS 2008.

[38]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[39]  Daniele Panozzo,et al.  Automatic Construction of Quad-Based Subdivision Surfaces Using Fitmaps , 2011, IEEE Transactions on Visualization and Computer Graphics.

[40]  Ellen Yi-Luen Do,et al.  Posey: instrumenting a poseable hub and strut construction toy , 2008, Tangible and Embedded Interaction.

[41]  Olga Sorkine-Hornung,et al.  Tangible and modular input device for character articulation , 2014, SIGGRAPH Emerging Technologies.

[42]  Jessica K. Hodgins,et al.  Expressing animated performances through puppeteering , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[43]  Adam Finkelstein,et al.  Video puppetry: a performative interface for cutout animation , 2008, ACM Trans. Graph..

[44]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[45]  Jan Kautz,et al.  3D-printing of non-assembly, articulated models , 2012, ACM Trans. Graph..

[46]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .