Strike a Pose: Image-Based Pose Synthesis

In this paper, our objective is to facilitate the creation of novel human poses by synthesizing images. Existing approaches commonly deform one single image, which often results in a distorted image due to texture and illumination artefacts. We present a novel image-based pose synthesis technique that accurately reconstructs texture details by combining information from multiple photographs. Given a user-specified 2D target pose, our solution merges different parts of the input photographs in order to conform to the desired pose, solely using 2D operations. We illustrate how novel poses can be generated from only a few example images, requiring little user intervention. CR Descriptors: Image-based, pose, 2D, synthesis

[1]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[2]  Alexei A. Efros,et al.  Photo clip art , 2007, ACM Trans. Graph..

[3]  Leif Kobbelt,et al.  Character animation from 2D pictures and 3D motion data , 2007, TOGS.

[4]  Frank Van Reeth,et al.  Uniting cartoon textures with computer assisted animation , 2005, GRAPHITE '05.

[5]  David Salesin,et al.  Animating pictures with stochastic motion textures , 2005, ACM Trans. Graph..

[6]  Irfan A. Essa,et al.  Controlled animation of video sprites , 2002, SCA '02.

[7]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[8]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[9]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[10]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[11]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[12]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[13]  Philippe Bekaert,et al.  Articulated Video Sprites , 2006, Eurographics.

[14]  Yanzhen Wang,et al.  2D shape deformation based on rigid square matching , 2008, Comput. Animat. Virtual Worlds.

[15]  Adrian Hilton,et al.  Video-based character animation , 2005, SCA '05.

[16]  L. Paul Chew,et al.  Constrained Delaunay triangulations , 1987, SCG '87.

[17]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[18]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, SIGGRAPH '05.

[19]  Alan M. McIvor,et al.  Background Subtraction Techniques , 2000 .

[20]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[21]  Jirí Zára,et al.  Polypostors: 2D polygonal impostors for 3D crowds , 2008, I3D '08.

[22]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..