KinÊtre: animating the world with the human body

KinÊtre allows novice users to scan arbitrary physical objects and bring them to life in seconds. The fully interactive system allows diverse static meshes to be animated using the entire human body. Traditionally, the process of mesh animation is laborious and requires domain expertise, with rigging specified manually by an artist when designing the character. KinÊtre makes creating animations a more playful activity, conducted by novice users interactively "at runtime". This paper describes the KinÊtre system in full, highlighting key technical contributions and demonstrating many examples of users animating meshes of varying shapes and sizes. These include non-humanoid meshes and incomplete surfaces produced by 3D scanning - two challenging scenarios for existing mesh animation systems. Rather than targeting professional CG animators, KinÊtre is intended to bring mesh animation to a new audience of novice users. We demonstrate potential uses of our system for interactive storytelling and new forms of physical gaming.

[1]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[2]  Olga Sorkine-Hornung,et al.  Stretchable and Twistable Bones for Skeletal Shape Deformation , 2011, ACM Trans. Graph..

[3]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[4]  Michael Kipp,et al.  Multitouch puppetry: creating coordinated 3D motion for an articulated arm , 2010, ITS '10.

[5]  Katsu Yamane,et al.  Animating non-humanoid characters with human motion data , 2010, SCA '10.

[6]  Hans-Peter Seidel,et al.  Automatic generation of personalized human avatars from multi-view video , 2005, VRST '05.

[7]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[8]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[9]  Kun Zhou,et al.  Mesh puppetry: cascading optimization of mesh deformation with inverse kinematics , 2007, SIGGRAPH 2007.

[10]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[11]  Scott Schaefer,et al.  Image deformation using moving least squares , 2006, ACM Trans. Graph..

[12]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[13]  J. Warren,et al.  Mean value coordinates for closed triangular meshes , 2005, SIGGRAPH 2005.

[14]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[15]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[16]  M. Pauly,et al.  Embedded deformation for shape manipulation , 2007, SIGGRAPH 2007.

[17]  Jaakko Lehtinen,et al.  A meshless hierarchical representation for light transport , 2008, ACM Trans. Graph..

[18]  Koji Komatsu,et al.  Human skin model capable of natural shape variation , 1988, The Visual Computer.

[19]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2005 .

[20]  M. Ben-Chen,et al.  Variational harmonic maps for space deformation , 2009, SIGGRAPH 2009.

[21]  Brian Knep,et al.  Dinosaur input device , 1995, CHI '95.

[22]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[23]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[24]  Wojciech Matusik,et al.  Articulated mesh animation from multi-view silhouettes , 2008, ACM Trans. Graph..

[25]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[26]  Mel Slater,et al.  The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment , 2003, CHI '03.

[27]  Mark Meyer,et al.  Harmonic coordinates for character articulation , 2007, ACM Trans. Graph..

[28]  David J. Sturman,et al.  Computer Puppetry , 1998, IEEE Computer Graphics and Applications.

[29]  Bruce Blumberg,et al.  Sympathetic interfaces: using a plush toy to direct synthetic characters , 1999, CHI '99.

[30]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[31]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..