3D shape and texture morphing using 2D projection and reconstruction

We present an algorithm for morphing shape and view-dependent texture that utilizes an unstructured lumigraph representation to (1) gracefully handle topological changes, (2) create plausible appearance transformations, and (3) provide user control independent from the underlying mesh structure. It works by reducing the otherwise complex problem of a 3D shape and material morph into multiple simpler 2D morphs. The shape morph operates on 2D depth maps and then reconstructs a conventional mesh, making it insensitive to the input geometry quality. Our morphing algorithm robustly handles topology changes and outputs complete meshes and lumigraphs for later use. We show how 2D image morphs can be computed from 3D correspondences, while eliminating ambiguities that might result in the projected 2D morphs. Graphical abstractDisplay Omitted HighlightsWe present an algorithm for morphing shape and view-dependent texture.The 3D shape morph is implicit and therefore immune to topological constraints.Complex problem of 3D shape+material morphing is converted to multiple 2D morphs.Morph stages are unstructured lumigraphs with realistic simulation of appearance.

[1]  Wan-Chun Ma,et al.  The Digital Emily Project: Achieving a Photorealistic Digital Actor , 2010, IEEE Computer Graphics and Applications.

[2]  Sung Yong Shin,et al.  Image morphing using deformable surfaces , 1994, Proceedings of Computer Animation '94.

[3]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[4]  Wayne A. Davis,et al.  Proceedings of the conference on Graphics interface '96 , 1996 .

[5]  David P. Dobkin,et al.  Multiresolution mesh morphing , 1999, SIGGRAPH.

[6]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[7]  Daniel Cohen-Or,et al.  Three-dimensional distance field metamorphosis , 1998, TOGS.

[8]  Hugues Hoppe,et al.  Spherical parametrization and remeshing , 2003, ACM Trans. Graph..

[9]  David P. Dobkin,et al.  MAPS: multiresolution adaptive parameterization of surfaces , 1998, SIGGRAPH.

[10]  DebevecPaul,et al.  The Digital Emily Project , 2010 .

[11]  Anita Sellent,et al.  Floating Textures , 2008, Comput. Graph. Forum.

[12]  Baining Guo,et al.  Feature-based light field morphing , 2002, ACM Trans. Graph..

[13]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[14]  Kun Zhou,et al.  As-Rigid-AsPossible Distance Field Metamorphosis , 2013, Comput. Graph. Forum.

[15]  E ParentRichard,et al.  Shape transformation for polyhedral objects , 1992 .

[16]  Stephen Lin,et al.  Light field morphing using 2D features , 2005, IEEE Transactions on Visualization and Computer Graphics.

[17]  Baining Guo,et al.  Feature-based surface light field morphing , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[18]  Heinrich Müller,et al.  Image warping with scattered data interpolation , 1995, IEEE Computer Graphics and Applications.

[19]  James J. Thomas,et al.  Proceedings of the 19th annual conference on Computer graphics and interactive techniques , 1992, SIGGRAPH.

[20]  Frédo Durand,et al.  Unstructured Light Fields , 2012, Comput. Graph. Forum.

[21]  Douglas DeCarlo,et al.  Topological Evolution of Surfaces , 1996, Graphics Interface.

[22]  Jing Liao,et al.  Automating Image Morphing Using Structural Similarity on a Halfway Domain , 2014, ACM Trans. Graph..

[23]  Leif Kobbelt,et al.  Interactive Pixel‐Accurate Free Viewpoint Rendering from Images with Silhouette Aware Sampling , 2009, Comput. Graph. Forum.

[24]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[25]  GrzeszczukRadek,et al.  Light field mapping , 2002 .

[26]  Anthony J. Yezzi,et al.  Texture transfer during shape transformation , 2005, TOGS.

[27]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[28]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[29]  Marc Alexa,et al.  As-rigid-as-possible shape interpolation , 2000, SIGGRAPH.

[30]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[31]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[32]  Wayne E. Carlson,et al.  Shape transformation for polyhedral objects , 1992, SIGGRAPH.

[33]  BeierThaddeus,et al.  Feature-based image metamorphosis , 1992 .