Retrieval and Visualization of Human Motion Data via Stick Figures

We propose 2D stick figures as a unified medium for visualizing and searching for human motion data. The stick figures can express a wide range or human motion, and they are easy to be drawn by people without any professional training. In our interface, the user can browse overall motion by viewing the stick figure images generated from the database and retrieve them directly by using sketched stick figures as an input query. We started with a preliminary survey to observe how people draw stick figures. Based on the rules observed from the user study, we developed an algorithm converting motion data to a sequence of stick figures. The feature‐based comparison method between the stick figures provides an interactive and progressive search for the users. They assist the user's sketching by showing the current retrieval result at each stroke. We demonstrate the utility of the system with a user study, in which the participants retrieved example motion segments from the database with 102 motion files by using our interface.

[1]  Chen Mao,et al.  A Sketch-Based Gesture Interface for Rough 3D Stick Figure Animation , 2005, SBM.

[2]  Arno Zinke,et al.  Fast local and global similarity searches in large motion capture databases , 2010, SCA '10.

[3]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[4]  Meinard Müller,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH '05.

[5]  Yen-Lin Chen,et al.  Interactive generation of human animation with deformable motion models , 2009, TOGS.

[6]  Zhigang Deng,et al.  Perceptually consistent example-based human motion retrieval , 2009, I3D '09.

[7]  Okan Arikan.  Compression of motion capture databases , 2006, ACM Trans. Graph..

[8]  Masayuki Nakajima,et al.  Motion belts , 2007, SIGGRAPH '07.

[9]  Michiel van de Panne,et al.  Motion doodles: an interface for sketching character motion , 2004, SIGGRAPH Courses.

[10]  Hans-Peter Seidel,et al.  Efficient and Robust Annotation of Motion Capture Data , 2009 .

[11]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[12]  Atsushi Nakazawa,et al.  A puppet interface for retrieval of motion capture data , 2011, SCA '11.

[13]  Taku Komura,et al.  Relationship descriptors for interactive motion adaptation , 2013, SCA '13.

[14]  Takeo Igarashi,et al.  A Sketching Interface for Sitting-Pose Design , 2010, SBIM.

[15]  Junjun Pan,et al.  Sketch-Based Skeleton-Driven 2D Animation and Motion Capture , 2009, Trans. Edutainment.

[16]  Daniel Cohen-Or,et al.  Action synopsis: pose selection and illustration , 2005, ACM Trans. Graph..

[17]  Shengfeng Qin.  Intelligent Classification of Sketch Strokes , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[18]  James Davis,et al.  Motion capture data retrieval using an artist’s doll , 2008, 2008 19th International Conference on Pattern Recognition.

[19]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[20]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[21]  Pierre Poulin,et al.  Motion cues for illustration of skeletal motion capture data , 2007, NPAR '07.

[22]  Timothy Sherwood,et al.  Sketch-Based Recognition System for General Articulated Skeletal Figures , 2010, SBIM.

[23]  Matthias Zwicker,et al.  Bidirectional Search for Interactive Motion Synthesis , 2010, Comput. Graph. Forum.

[24]  Adrian David Cheok,et al.  Transactions on Edutainment VI , 2011, Trans. Edutainment.

[25]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[26]  Jinxiang Chai,et al.  Intuitive Interactive Human-Character Posing with Millions of Example Poses , 2011, IEEE Computer Graphics and Applications.