Image Decomposition using Geometric Region Colour Unmixing

In this paper, we propose a new geometric approach for image decomposition which aims to combine the advantages of two state of the art techniques. Given an input image, we first compute a palette of colours from the image and use it to split the RGB space into a number of different regions. Depending on which region a given pixel lies in, different geometric methods are used to unmix the pixel’s colour into a number of colours, where each colour is associated with a different layer. The layers created are smooth and homogeneous in colour, and have no reconstruction error when recombined. Our layer decomposition technique is fast to compute and the layers created can be used successfully in several applications, including layer compositing and recolouring.

[1]  GingoldYotam,et al.  Decomposing Images into Layers via RGB-Space Geometry , 2016 .

[2]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[3]  Carlo Tomasi,et al.  Alpha estimation in natural images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Chunxia Xiao,et al.  Palette-Based Image Recoloring Using Color Decomposition Optimization , 2017, IEEE Transactions on Image Processing.

[6]  Yotam I. Gingold,et al.  Efficient palette-based decomposition and recoloring of images via RGBXY-space geometry , 2018, ACM Trans. Graph..

[7]  Pat Hanrahan,et al.  LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing , 2017, ArXiv.

[8]  Aljoscha Smolic,et al.  Unmixing-Based Soft Color Segmentation for Image Manipulation , 2017, TOGS.

[9]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Stephen DiVerdi,et al.  Palette-based photo recoloring , 2015, ACM Trans. Graph..

[11]  Antoni B. Chan,et al.  Color Orchestra: Ordering Color Palettes for Interpolation and Prediction , 2017, IEEE Transactions on Visualization and Computer Graphics.

[12]  Daniel Cohen-Or,et al.  Image Appearance Exploration by Model‐Based Navigation , 2009, Comput. Graph. Forum.

[13]  Noah Snavely,et al.  Intrinsic images in the wild , 2014, ACM Trans. Graph..

[14]  AksoyYağiz,et al.  Unmixing-Based Soft Color Segmentation for Image Manipulation , 2017 .

[15]  Masataka Goto,et al.  Decomposing Images into Layers with Advanced Color Blending , 2018, Comput. Graph. Forum.

[16]  DuffTom,et al.  Compositing digital images , 1984 .

[17]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, ACM Trans. Graph..

[18]  Pat Hanrahan,et al.  Modeling how people extract color themes from images , 2013, CHI.

[19]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Aljoscha Smolic,et al.  Interactive High-Quality Green-Screen Keying via Color Unmixing , 2016, ACM Trans. Graph..