Fabric image recolorization based on intrinsic image decomposition

Fabric image recolorization is widely used in assisting designers to generate new color design proposals for fabric. In this paper, a new image recolorization method is proposed. Different from classical image recolorization methods, which need some complicated interactive operations from users, our proposed method can achieve automatic recolorization of images. The proposed method contains three sequential phases: a phase of extracting representative colors from fabric images; an image segmentation phase; and an image reconstruction phase by using given color themes. Integrated with intrinsic image decomposition, a new image segmentation model is designed in a variational framework, and an algorithm is given to solve the model. Our image recolorization results are images that are reconstructed by the composition of the image segmentation results and the given color themes. Numerical results demonstrate that our newly proposed intrinsic image decomposition-based image recolorization method can generate better results than the classical cartoon-and-texture decomposition-based method.

[1]  Shi-guang Liu,et al.  Sufficient Image Appearance Transfer Combining Color and Texture , 2017, IEEE Transactions on Multimedia.

[2]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[3]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[4]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, SIGGRAPH 2011.

[5]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[6]  Adolfo Muñoz,et al.  Intrinsic Images by Clustering , 2012, Comput. Graph. Forum.

[7]  Da Liu,et al.  Emotional image color transfer via deep learning , 2018, Pattern Recognit. Lett..

[8]  Dejun Zheng,et al.  A new method for automatic separation of fabric color , 2015 .

[9]  Chunming Li,et al.  Image segmentation with simultaneous illumination and reflectance estimation: An energy minimization approach , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Noah Snavely,et al.  Intrinsic images in the wild , 2014, ACM Trans. Graph..

[11]  Chunping Hou,et al.  Contrast Enhancement Based on Intrinsic Image Decomposition. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[12]  Stephen DiVerdi,et al.  Palette-based photo recoloring , 2015, ACM Trans. Graph..

[13]  Chuohao Yeo,et al.  Intrinsic Image Decomposition Using a Sparse Representation of Reflectance , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Di Chen,et al.  A computational approach to digital hand-painted printing patterns on cloth , 2015, Multimedia Tools and Applications.

[15]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[16]  Nicolas Papadakis,et al.  A Variational Model for Histogram Transfer of Color Images , 2011, IEEE Transactions on Image Processing.

[17]  Shiguang Liu,et al.  Hierarchical emotional color theme extraction , 2016 .

[18]  Yu Han,et al.  Color Transfer Using Adaptive Second-Order Total Generalized Variation Regularizer , 2018, IEEE Access.

[19]  Yu Han,et al.  Cartoon and Texture Decomposition-Based Color Transfer for Fabric Images , 2017, IEEE Transactions on Multimedia.

[20]  Dejun Zheng,et al.  Multi-scale density detection for yarn-dyed fabrics with deformed repeat patterns , 2017 .

[21]  Michael S. Brown,et al.  Illuminant Aware Gamut‐Based Color Transfer , 2014, Comput. Graph. Forum.

[22]  Min Pei,et al.  Texture-Aware Emotional Color Transfer Between Images , 2018, IEEE Access.

[23]  Alexei A. Efros,et al.  Learning Data-Driven Reflectance Priors for Intrinsic Image Decomposition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..

[25]  Yizhou Yu,et al.  Title An L 1 image transform for edge-preserving smoothing andscene-level intrinsic decomposition , 2015 .

[26]  Yizhou Yu,et al.  Data-driven image color theme enhancement , 2010, ACM Trans. Graph..

[27]  Qing Zhang,et al.  Palette-Based Image Recoloring Using Color Decomposition Optimization. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[28]  Dejun Zheng.  A novel method for fabric color transfer , 2015 .

[29]  Xiaoli Zhang,et al.  Contrast preserving image decolorization combining global features and local semantic features , 2018, The Visual Computer.

[30]  Lizhuang Ma,et al.  Intrinsic image estimation using near-$$L_0$$L0 sparse optimization , 2017, The Visual Computer.

[31]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[32]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[33]  Yaxi Jiang,et al.  Attention-aware color theme extraction for fabric images , 2018 .

[34]  Jin Young Choi,et al.  PaletteNet: Image Recolorization with Given Color Palette , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Xiangchu Feng,et al.  Fuzzy region competition-based auto-color-theme design for textile images , 2013 .

[36]  Takao Onoye,et al.  Halo artifacts reduction method for variational based realtime retinex image enhancement , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[37]  Maxim Zaitsev,et al.  Reconstruction of undersampled radial PatLoc imaging using total generalized variation , 2012, Magnetic resonance in medicine.

[38]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Julien Rabin,et al.  Adaptive color transfer with relaxed optimal transport , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[40]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.