Feature-based light field morphing

We present a feature-based technique for morphing 3D objects represented by light fields. Our technique enables morphing of image-based objects whose geometry and surface properties are too difficult to model with traditional vision and graphics techniques. Light field morphing is not based on 3D reconstruction; instead it relies on ray correspondence, i.e., the correspondence between rays of the source and target light fields. We address two main issues in light field morphing: feature specification and visibility changes. For feature specification, we develop an intuitive and easy-to-use user interface (UI). The key to this UI is feature polygons, which are intuitively specified as 3D polygons and are used as a control mechanism for ray correspondence in the abstract 4D ray space. For handling visibility changes due to object shape changes, we introduce ray-space warping. Ray-space warping can fill arbitrarily large holes caused by object shape changes; these holes are usually too large to be properly handled by traditional image warping. Our method can deal with non-Lambertian surfaces, including specular surfaces (with dense light fields). We demonstrate that light field morphing is an effective and easy-to-use technqiue that can generate convincing 3D morphing effects.

[1]  Wayne E. Carlson,et al.  Shape transformation for polyhedral objects , 1992, SIGGRAPH.

[2]  John F. Hughes,et al.  Scheduled Fourier volume morphing , 1992, SIGGRAPH.

[3]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[4]  B P Bergeron,et al.  Morphing as a means of generating variation in visual medical teaching materials. , 1994, Computers in biology and medicine.

[5]  Marc Levoy,et al.  Feature-based volume metamorphosis , 1995, SIGGRAPH.

[6]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[7]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[8]  Douglas DeCarlo,et al.  Topological Evolution of Surfaces , 1996, Graphics Interface.

[9]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[10]  Marc Levoy,et al.  Image-based rendering: really new or déjà vu? (panel). , 1997, SIGGRAPH 1997.

[11]  Jitendra Malik,et al.  Image-based rendering (panel): really new or déjà vu? , 1997, SIGGRAPH.

[12]  George Wolberg,et al.  Image morphing: a survey , 1998, The Visual Computer.

[13]  Anne Verroust-Blondet,et al.  Three-dimensional metamorphosis: a survey , 1998, The Visual Computer.

[14]  Daniel Cohen-Or,et al.  Three-dimensional distance field metamorphosis , 1998, TOGS.

[15]  Kiriakos N. Kutulakos,et al.  Plenoptic Image Editing , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  Lance Williams,et al.  View interpolation for image synthesis , 1998 .

[17]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[18]  Luiz Velho,et al.  Warping and morphing of graphical objects , 1998 .

[19]  Werner Purgathofer,et al.  Global Ray-Bundle Tracing with Hardware Acceleration , 1998, Rendering Techniques.

[20]  David P. Dobkin,et al.  Multiresolution mesh morphing , 1999, SIGGRAPH.

[21]  Dinesh Manocha,et al.  Feature-based surface decomposition for polyhedral morphing , 1999, SCG '99.

[22]  Dinesh Manocha,et al.  Interactive surface decomposition for polyhedral morphing , 1999, The Visual Computer.

[23]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[24]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[25]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[26]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.