Optimal Transport Mixing of Gaussian Texture Models

This paper tackles the problem of mixing color texture models learned from an input dataset. We focus on stationary Gaussian texture models, also known as spot noises. We derive the barycenter and geodesic path between models according to optimal transport. This allows the user to navigate inside the set of texture models, and perform texture synthesis from the obtained interpolated models. Numerical examples on a library of exemplars show the ability of our method to generate arbitrary interpolations among unstructured natural textures.

[1]  D. Dowson,et al.  The Fréchet distance between multivariate normal distributions , 1982 .

[2]  M. Knott,et al.  On a generalization of cyclic monotonicity and distances among random vectors , 1994 .

[3]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[5]  C. Villani.  Topics in Optimal Transportation , 2003 .

[6]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[7]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[8]  F. Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, ACM Trans. Graph..

[9]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[10]  Lionel Moisan,et al.  Periodic Plus Smooth Image Decomposition , 2011, Journal of Mathematical Imaging and Vision.

[11]  Bruno Galerne,et al.  Random Phase Textures: Theory and Synthesis , 2011, IEEE Transactions on Image Processing.

[12]  Guillaume Carlier,et al.  Barycenters in the Wasserstein Space , 2011, SIAM J. Math. Anal..

[13]  Julien Rabin,et al.  Wasserstein Barycenter and Its Application to Texture Mixing , 2011, SSVM.

[14]  Asuka Takatsu.  Wasserstein geometry of Gaussian measures , 2011 .