Motion capture data retrieval using an artist’s doll

In this paper, we present a keyframe-based human motion capture data retrieval system which uses a wooden doll as the input device. A user inputs a keyframe by posing an artistpsilas doll with painted joints in front of a stereo camera rig. The system interactively gives real-time feedback on the results of the joint detection and 3D pose reconstruction as the user is positioning and rotating the doll. The robust 3D joint reconstruction is achieved by integrating 3D joint positions from multiple views of the same pose. After the user has finished inputting all the keyframes, the motion sequences are retrieved from the database and ranked based on their similarities to the keyframes. Experiments show that the presented system is simple to use and has high quality of retrieval results.

[1]  Tao Yu,et al.  MotionMaster: authoring and choreographing Kung-fu motions by sketch drawings , 2006, SCA '06.

[2]  Tido Röder,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH 2005.

[3]  Yasuhiko Sakamoto,et al.  Motion map: image-based retrieval and segmentation of motion data , 2004, SCA '04.

[4]  Meinard Müller,et al.  Motion templates for automatic classification and retrieval of motion capture data , 2006, SCA '06.

[5]  Michiel van de Panne,et al.  Motion doodles: an interface for sketching character motion , 2004, SIGGRAPH Courses.

[6]  Ulrich Neumann,et al.  Vision-based pose computation: robust and accurate augmented reality tracking , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[7]  Dinesh K. Pai,et al.  FootSee: an interactive animation system , 2003, SCA '03.

[8]  Dieter Schmalstieg,et al.  Augmented Reality Agents in the Development Pipeline of Computer Entertainment , 2005, ICEC.

[9]  Chris Esposito,et al.  Of mice and monkeys: a specialized input device for virtual body animation , 1995, I3D '95.

[10]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[11]  Bruce Blumberg,et al.  Swamped! using plush toys to direct autonomous animated characters , 1998, SIGGRAPH '98.

[12]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[13]  Dieter Schmalstieg,et al.  Augmented reality in the character animation pipeline , 2006, SIGGRAPH '06.

[14]  Bruce Blumberg,et al.  Sympathetic interfaces: using a plush toy to direct synthetic characters , 1999, CHI '99.