Texture synthesis guided by a low-resolution image

In this paper, we aim at synthesizing a texture from a high-resolution patch and a low-resolution image. To do so, we solve a nonconvex optimization problem that involves a statistical prior and a Fourier spectrum constraint. The numerical analysis shows that the proposed approach achieves better results (in terms of visual quality) than state-of-the-art methods tailored to super-resolution or texture synthesis.

[1]  Yann Gousseau,et al.  Constrained Sparse Texture Synthesis , 2013, SSVM.

[2]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[3]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[4]  Bruno Galerne,et al.  Random Phase Textures: Theory and Synthesis , 2011, IEEE Transactions on Image Processing.

[5]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[6]  Eitan Grinspun,et al.  Multiscale texture synthesis , 2008, SIGGRAPH 2008.

[7]  Lionel Moisan,et al.  A compact representation of random phase and Gaussian textures , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Ronan Fablet,et al.  Joint Interpolation of Multisensor Sea Surface Temperature Fields Using Nonlocal and Statistical Priors , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  J. Moreau.  Fonctions convexes duales et points proximaux dans un espace hilbertien , 1962 .

[10]  Julien Rabin,et al.  Wasserstein regularization of imaging problem , 2011, 2011 18th IEEE International Conference on Image Processing.

[11]  Marcello Pelillo,et al.  Energy Minimization Methods in Computer Vision and Pattern Recognition , 2003, Lecture Notes in Computer Science.

[12]  Jean-François Aujol,et al.  Texture Reconstruction Guided by a High-Resolution Patch , 2017, IEEE Transactions on Image Processing.

[13]  Mila Nikolova,et al.  Energy Minimization Methods , 2015, Handbook of Mathematical Methods in Imaging.

[14]  Nikos Komodakis,et al.  Playing with Duality: An overview of recent primal?dual approaches for solving large-scale optimization problems , 2014, IEEE Signal Process. Mag..

[15]  Andreas Weinmann,et al.  Jump-Sparse and Sparse Recovery Using Potts Functionals , 2013, IEEE Transactions on Signal Processing.

[16]  Marcus A. Magnor,et al.  ZIPMAPS: Zoom-Into-Parts Texture Maps , 2010, VMV.

[17]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[18]  Yann Gousseau,et al.  Variational Texture Synthesis with Sparsity and Spectrum Constraints , 2015, Journal of Mathematical Imaging and Vision.

[19]  Yann Gousseau,et al.  Wasserstein Loss for Image Synthesis and Restoration , 2016, SIAM J. Imaging Sci..

[20]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[21]  Jean-Christophe Pesquet,et al.  Playing with Duality , 2015 .

[22]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[23]  Jean-François Aujol,et al.  Image Zoom Completion , 2016, IEEE Transactions on Image Processing.

[24]  Christoph Schnörr,et al.  Convex Variational Image Restoration with Histogram Priors , 2013, SIAM J. Imaging Sci..

[25]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[26]  Bruno Galerne,et al.  Micro-Texture Synthesis by Phase Randomization , 2011, Image Process. Line.

[27]  Bang Công Vu,et al.  A splitting algorithm for dual monotone inclusions involving cocoercive operators , 2011, Advances in Computational Mathematics.

[28]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[29]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[31]  Patrick L. Combettes,et al.  A Monotone+Skew Splitting Model for Composite Monotone Inclusions in Duality , 2010, SIAM J. Optim..

[32]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[33]  Arjan Kuijper,et al.  Scale Space and Variational Methods in Computer Vision , 2013, Lecture Notes in Computer Science.

[34]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.