Human motion retrieval based on freehand sketch

In this paper, we present an integrated framework of human motion retrieval based on freehand sketch. With some simple rules, the user can acquire a desired motion by sketching several key postures. To retrieve efficiently and accurately by sketch, the 3D postures are projected onto several 2D planes. The limb direction feature is proposed to represent the input sketch and the projected‐postures. Furthermore, a novel index structure based on k‐d tree is constructed to index the motions in the database, which speeds up the retrieval process. With our posture‐by‐posture retrieval algorithm, a continuous motion can be got directly or generated by using a pre‐computed graph structure. What's more, our system provides an intuitive user interface. The experimental results demonstrate the effectiveness of our method. © 2014 The Authors. Computer Animation and Virtual Worlds published by John Wiley & Sons, Ltd.

[1]  Hassan Foroosh,et al.  Motion Retrieval Using Low‐Rank Subspace Decomposition of Motion Volume , 2011, Comput. Graph. Forum.

[2]  Jian-Jun Zhang,et al.  A semantic feature for human motion retrieval , 2013, Comput. Animat. Virtual Worlds.

[3]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[4]  Chao-Hung Lin,et al.  Human Motion Retrieval from Hand-Drawn Sketch , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[6]  Chris Hecker,et al.  Real-time motion retargeting to highly varied user-created morphologies , 2008, SIGGRAPH 2008.

[7]  Chih-Yi Chiu,et al.  Content-based retrieval for human motion data , 2004, J. Vis. Commun. Image Represent..

[8]  Bruce Blumberg,et al.  Sympathetic interfaces: using a plush toy to direct synthetic characters , 1999, CHI '99.

[9]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[10]  Atsuo Yoshitaka,et al.  A Survey on Content-Based Retrieval for Multimedia Databases , 1999, IEEE Trans. Knowl. Data Eng..

[11]  Tao Yu,et al.  MotionMaster: authoring and choreographing Kung-fu motions by sketch drawings , 2006, SCA '06.

[12]  Christian Böhm,et al.  Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases , 2001, CSUR.

[13]  Haiying Liu,et al.  Motion retrieval based on kinetic features in large motion database , 2012, ICMI '12.

[14]  Yan-Ju Chen,et al.  Interactive and flexible motion transition , 2007, Comput. Animat. Virtual Worlds.

[15]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[16]  BreglerChristoph,et al.  Motion capture assisted animation , 2002 .

[17]  Zhigang Deng,et al.  Perceptually consistent example-based human motion retrieval , 2009, I3D '09.

[18]  K HodginsJessica,et al.  Interactive control of avatars animated with human motion data , 2002 .

[19]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[20]  Takeo Igarashi,et al.  Retrieval and Visualization of Human Motion Data via Stick Figures , 2012, Comput. Graph. Forum.

[21]  James Davis,et al.  Motion capture data retrieval using an artist’s doll , 2008, 2008 19th International Conference on Pattern Recognition.

[22]  Zhigang Deng,et al.  Quaternion space sparse decomposition for motion compression and retrieval , 2012, SCA '12.

[23]  Elsevier Sdol,et al.  Journal of Visual Communication and Image Representation , 2009 .

[24]  Atsushi Nakazawa,et al.  A puppet interface for retrieval of motion capture data , 2011, SCA '11.

[25]  Lucas Kovar,et al.  Fast and accurate goal-directed motion synthesis for crowds , 2005, SCA '05.

[26]  C. Karen Liu,et al.  Optimization-based interactive motion synthesis , 2009, ACM Trans. Graph..

[27]  Yen-Lin Chen,et al.  Interactive generation of human animation with deformable motion models , 2009, TOGS.

[28]  Jinxiang Chai,et al.  Synthesis and editing of personalized stylistic human motion , 2010, I3D '10.

[29]  Tido Röder,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH 2005.

[30]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.