Image morphing using deformation and patch-based synthesis

Image morphing creates a smooth transformation between images. Traditional morphing techniques may fail when the two input images have large displacements. In this paper, a two-step scheme is proposed to deal with this challenging task. Firstly, a series of deformed images is generated through optimizing an adaptation of deformation objective that composed of as-rigid-as-possible energy, group lasso penalty, and smoothness penalty. Then, the forward and backward deformed sequences are aligned utilizing the patch-based synthesis, satisfying source similarity and temporal coherence. Guided by a few user-specified correspondences, the proposed method works well in many morphing scenes.

[1]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[2]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, ICCV.

[3]  P. Belhumeur,et al.  Moving gradients: a path-based method for plausible image interpolation , 2009, SIGGRAPH 2009.

[4]  D. Levin,et al.  Linear rotation-invariant coordinates for meshes , 2005, SIGGRAPH 2005.

[5]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[6]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[7]  Michael F. Cohen,et al.  Fourier Analysis of the 2D Screened Poisson Equation for Gradient Domain Problems , 2008, ECCV.

[8]  Sung Yong Shin,et al.  Image Metamorphosis with Scattered Feature Constraints , 1996, IEEE Trans. Vis. Comput. Graph..

[9]  Fei Yang,et al.  Face morphing using 3D-aware appearance optimization , 2012, Graphics Interface.

[10]  Bo Zhang,et al.  Locally controlled as‐rigid‐as‐possible deformation for 2D characters , 2017, Comput. Animat. Virtual Worlds.

[11]  Enhua Wu,et al.  Robust image metamorphosis immune from ghost and blur , 2012, The Visual Computer.

[12]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Bo Yan,et al.  Low complexity image interpolation method based on path selection , 2013, J. Vis. Commun. Image Represent..

[14]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[15]  Jing Liao,et al.  Automating Image Morphing Using Structural Similarity on a Halfway Domain , 2014, ACM Trans. Graph..

[16]  Shigeo Morishima,et al.  PatchMove: Patch-based Fast Image Interpolation with Greedy Bidirectional Correspondence , 2014, PG.

[17]  Eli Shechtman,et al.  Regenerative morphing , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.