Sufficient Image Appearance Transfer Combining Color and Texture

Traditional color transfer methods can achieve satisfactory results for transferring the color style from a reference image to a source image, provided that the source image shares the similar color mood with the reference image. However, color transfer solutions are always sensitive to color category, which cannot generate natural results when the contents of the reference image and the source image are different, e.g., a lush tree in the reference image and a bare tree in the source image. In this situation, it is insufficient only through color transfer to transfer the appearance from the reference image to the source image only through color transfer, since other information such as texture should also be considered. To obtain sufficient appearance transfer results, we propose a new image appearance transfer method combining both color and texture features. Given a source image and a reference image, our method starts with feature detection and matching between the source image and the reference image. Then, we design a new method for expanding feature point sets to get texture transfer mark (TTM) and color transfer mark (CTM). TTM and CTM will guide texture transfer and color transfer, respectively. We demonstrate our appearance transfer algorithm between quantities of images and compare with results of existing methods. Experiment results show that given only a single reference image, our approach can produce more sufficient appearance transfer results than the state-of-the-art algorithms.

[1]  Hiroshi Ishikawa,et al.  Let there be color! , 2016, ACM Trans. Graph..

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  Neil A. Dodgson,et al.  Color histogram specification by histogram warping , 2005, IS&T/SPIE Electronic Imaging.

[4]  Anil Kokaram,et al.  The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer , 2007 .

[5]  陈世峰 Style Transfer via Image Component Analysis , 2013 .

[6]  Vipin Tyagi,et al.  An effective scheme for image texture classification based on binary local structure pattern , 2013, The Visual Computer.

[7]  Dani Lischinski,et al.  Non-rigid dense correspondence with applications for image enhancement , 2011, ACM Trans. Graph..

[8]  Olga Sorkine-Hornung,et al.  Synthesis of Complex Image Appearance from Limited Exemplars , 2015, TOGS.

[9]  Deepu Rajan,et al.  Image colorization using similar images , 2012, ACM Multimedia.

[10]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, SIGGRAPH 2011.

[11]  Wojciech Matusik,et al.  CG2Real: Improving the Realism of Computer Generated Images Using a Large Collection of Photographs , 2011, IEEE Transactions on Visualization and Computer Graphics.

[12]  Yizhou Yu,et al.  Automatic Photo Adjustment Using Deep Neural Networks , 2014, ACM Trans. Graph..

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Sylvain Lefebvre,et al.  Proxy-Guided Texture Synthesis for Rendering Natural Scenes , 2010, VMV.

[15]  Jun-Cheng Chen,et al.  An adaptive edge detection based colorization algorithm and its applications , 2005, ACM Multimedia.

[16]  Andrew Chi-Sing Leung,et al.  Example-Based Color Transfer for Gradient Meshes , 2013, IEEE Transactions on Multimedia.

[17]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[18]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ralph R. Martin,et al.  PatchNet: a patch-based image representation for interactive library-driven image editing , 2013, ACM Trans. Graph..

[20]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[21]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[22]  Hans-Peter Seidel,et al.  An efficient construction of reduced deformable objects , 2013, ACM Trans. Graph..

[23]  Michael S. Brown,et al.  Illuminant Aware Gamut‐Based Color Transfer , 2014, Comput. Graph. Forum.

[24]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[25]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[26]  Adrien Bousseau,et al.  Unifying Color and Texture Transfer for Predictive Appearance Manipulation , 2015, Comput. Graph. Forum.

[27]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[28]  Markus H. Gross,et al.  Fast and Stable Color Balancing for Images and Augmented Reality , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[29]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[30]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[31]  Frédo Durand,et al.  Data-driven hallucination of different times of day from a single outdoor photo , 2013, ACM Trans. Graph..

[32]  Chi-Keung Tang,et al.  Soft Color Segmentation and Its Applications , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Xing Mei,et al.  Image Retargeting by Texture-Aware Synthesis , 2016, IEEE Transactions on Visualization and Computer Graphics.

[34]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[35]  Hans-Peter Seidel,et al.  Animating deformable objects using sparse spacetime constraints , 2014, ACM Trans. Graph..

[36]  Erik Reinhard,et al.  A Survey of Color Mapping and its Applications , 2014, Eurographics.

[37]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[38]  Youngbae Hwang,et al.  Color Transfer Using Probabilistic Moving Least Squares , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Frédo Durand,et al.  Style transfer for headshot portraits , 2014, ACM Trans. Graph..