Finger walking: motion editing with contact-based hand performance

We present a system for generating full-body animations from the performance on a touch-sensitive tabletop of "finger walking", where two fingers are used to pantomime leg movements. A user study was conducted to explore how users can communicate full-body motion using their hands, which concluded that finger walking is a naturally-chosen and comfortable performance method. Based on contact data recorded during this study, the properties of a variety of performed locomotion types were analyzed to determine which motion parameters are most reliable and expressive for the purpose of generating corresponding full-body animations. Based on this analysis, a compact set of motion features was developed for classifying the locomotion type of a finger performance. A prototype interactive animation system was implemented to generate full-body animations of a known locomotion type from finger walking by estimating the motion path of a finger performance, and editing the path of a corresponding animation to match. The classification accuracy and output animation quality of this system was evaluated in a second user study, demonstrating that satisfying full-body animations can be reliably generated from finger performances.

[1]  David Zeltzer,et al.  A design method for “whole-hand” human-computer interaction , 1993, TOIS.

[2]  Michiel van de Panne,et al.  From Footprints to Animation , 1997, Comput. Graph. Forum.

[3]  David J. Sturman,et al.  Computer Puppetry , 1998, IEEE Computer Graphics and Applications.

[4]  Michiel van de Panne,et al.  Footprint-based Quadruped Motion Synthesis , 1998, Graphics Interface.

[5]  Eugene Fiume,et al.  Interactive control for physically-based animation , 2000, SIGGRAPH.

[6]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[7]  Geoffrey E. Hinton,et al.  A Desktop Input Device and Interface for Interactive 3D Character Animation , 2002, Graphics Interface.

[8]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[9]  Dinesh K. Pai,et al.  FootSee: an interactive animation system , 2003, SCA '03.

[10]  Sung Yong Shin,et al.  Planning biped locomotion using motion capture data and probabilistic roadmaps , 2003, TOGS.

[11]  Taku Komura,et al.  Motion editing with data glove , 2004, ACE '04.

[12]  Sílvio César Lizana Terra,et al.  Performance timing for keyframe animation , 2004, SCA '04.

[13]  Masaki Oshita.  Pen-to-mime: a pen-based interface for interactive control of a human figure , 2004, SBM'04.

[14]  C. Vaughan,et al.  Froude and the contribution of naval architecture to our understanding of bipedal locomotion. , 2005, Gait & posture.

[15]  Jörn Loviscach,et al.  Walking with Pens , 2005, Eurographics.

[16]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, SIGGRAPH '05.

[17]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[18]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2005, Symposium on Computer Animation.

[19]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[20]  Motion doodles: an interface for sketching character motion , 2006, SIGGRAPH Courses.

[21]  Abhishek Ranjan,et al.  Interacting with large displays from a distance with vision-tracked multi-finger gestural input , 2005, SIGGRAPH '06.

[22]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2005 .

[23]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[24]  Philippe Beaudoin,et al.  Synthesis of constrained walking skills , 2008, SIGGRAPH Asia '08.

[25]  Dan B. Goldman,et al.  Video puppetry: a performative interface for cutout animation , 2008, SIGGRAPH Asia '08.

[26]  Yuta Sugiura,et al.  An operating method for a bipedal walking robot for entertainment , 2009, SIGGRAPH ASIA '09.

[27]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[28]  C. Karen Liu,et al.  Performance-based control interface for character animation , 2009, SIGGRAPH 2009.

[29]  Michael Kipp,et al.  Multitouch puppetry: creating coordinated 3D motion for an articulated arm , 2010, ITS '10.

[30]  C. Karen Liu,et al.  Performance capture with physical interaction , 2010, SCA '10.

[31]  Karan Singh,et al.  Biomechanically-inspired motion path editing , 2011, SCA '11.

[32]  Taehyun Rhee,et al.  Realtime human motion control with a small number of inertial sensors , 2011, SI3D.