A Multi-touch System for 3D Modelling and Animation

3D modelling and animation software is typically operated via single-pointer input, imposing a serialised workflow that seems cumbersome in comparison to how humans manipulate objects in the real world. Research has brought forth new interaction techniques for modelling and animation that utilise input with more degrees of freedom or employ both hands to allow more parallel control, yet these are separate efforts across diverse input technologies and have not been applied to a usable system. We developed a 3D modelling and animation system for multi-touch interactive surfaces, as this technology offers parallel input with many degrees of freedom through one or both hands. It implements techniques for one-handed 3D navigation, 3D object manipulation, and time control. This includes mappings for layered or multi-track performance animation that allows the animation of different features across several passes or the modification of previously recorded motion. We show how these unimanual techniques can be combined for efficient bimanual control and propose techniques that specifically support the use of both hands for typical tasks in 3D editing. A study proved that even inexperienced users can successfully use our system for a more parallel and direct modelling or animation process.

[1]  Andrew D. Wilson.  Simulating grasping behavior on an imaging interactive surface , 2009, ITS '09.

[2]  Daniel Vogel,et al.  HybridPointing: fluid switching between absolute and relative pointing with a direct input device , 2006, UIST.

[3]  Andrew S. Forsberg,et al.  Two pointer input for 3D interaction , 1997, SI3D.

[4]  Jun Rekimoto,et al.  A Multi-finger Interface for Performance Animation of Deformable Drawings , 2005 .

[5]  M. Sheelagh T. Carpendale,et al.  Sticky tools: full 6DOF force-based interaction for multi-touch tables , 2009, ITS '09.

[6]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[7]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[8]  John F. Hughes,et al.  Multi-finger cursor techniques , 2006, Graphics Interface.

[9]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[10]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[11]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[12]  Abigail Sellen,et al.  Affordances for manipulation of physical versus digital media on interactive surfaces , 2007, CHI.

[13]  Hans-Peter Seidel,et al.  Layered Performance Animation with Correlation Maps , 2007, Comput. Graph. Forum.

[14]  Geoffrey E. Hinton,et al.  Local Physical Models for Interactive Character Animation , 2002, Comput. Graph. Forum.

[15]  John F. Hughes,et al.  Indirect mappings of multi-touch input using one and two hands , 2008, CHI.

[16]  Geoffrey E. Hinton,et al.  A Desktop Input Device and Interface for Interactive 3D Character Animation , 2002, Graphics Interface.

[17]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[18]  David J. Sturman,et al.  Computer Puppetry , 1998, IEEE Computer Graphics and Applications.

[19]  C. Machover,et al.  Computer Graphics In Entertainment , 1998, IEEE Computer Graphics and Applications.

[20]  Nicolas Courty,et al.  Gesture in Human-Computer Interaction and Simulation , 2006 .

[21]  Tovi Grossman,et al.  The design and evaluation of multi-finger mouse emulation techniques , 2009, CHI.

[22]  Laurent Grisoni,et al.  The design and evaluation of 3D positioning techniques for multi-touch displays , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[23]  Ravin Balakrishnan,et al.  Exploring bimanual camera control and object manipulation in 3D graphics interfaces , 1999, CHI '99.

[24]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[25]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[26]  Chris Esposito,et al.  Of mice and monkeys: a specialized input device for virtual body animation , 1995, I3D '95.