Consistent color and detail transfer from multiple source images for video and images

In this paper, we propose a method to jointly transfer the color and detail of multiple source images to a target video or image. Our method is based on a probabilistic segmentation scheme using Gaussian mixture model (GMM) to divide each source image as well as the target video frames or image into soft regions and determine the relevant source regions for each target region. For detail transfer, we first decompose each image as well as the target video frames or image into base and detail components. Then histogram matching is performed for detail components to transfer the detail of matching regions from source images to the target. We propose a unified framework to perform both color and detail transforms in an integrated manner. We also propose a method to maintain consistency for video targets, by enforcing consistent region segmentations for consecutive video frames using GMM-based parameter propagation and adaptive scene change detection. Experimental results demonstrate that our method automatically produces consistent color and detail transferred videos and images from a set of source images.

[1]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[2]  Hong Li,et al.  Selective color transfer with multi-source images , 2009, Pattern Recognit. Lett..

[3]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, ACM Trans. Graph..

[4]  Jieping Ye,et al.  A framework for interactive image color editing , 2012, The Visual Computer.

[5]  Youngbae Hwang,et al.  Color Transfer Using Probabilistic Moving Least Squares , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Frédo Durand,et al.  Style transfer for headshot portraits , 2014, ACM Trans. Graph..

[7]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Hua Huang,et al.  Example-based painting guided by color features , 2010, The Visual Computer.

[9]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[10]  André Kaup,et al.  Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[12]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[13]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[14]  Chi-Keung Tang,et al.  Tensor voting for image correction by global and local intensity alignment , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Hua Huang,et al.  Artistic preprocessing for painterly rendering and image stylization , 2014, The Visual Computer.

[16]  Xiaonan Luo,et al.  A novel image decomposition approach and its applications , 2012, The Visual Computer.

[17]  Sim Heng Ong,et al.  A clustering-based system to automate transfer function design for medical image visualization , 2011, The Visual Computer.

[18]  Jon Y. Hardeberg,et al.  Computer-Aided Reclamation of Lost Art , 2012, ECCV Workshops.

[19]  Thomas Brox,et al.  A Unified Video Segmentation Benchmark: Annotation, Metrics and Analysis , 2013, 2013 IEEE International Conference on Computer Vision.

[20]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[22]  Chi-Keung Tang,et al.  Soft Color Segmentation and Its Applications , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[24]  Stephen Gould,et al.  Multi-Class Segmentation with Relative Location Prior , 2008, International Journal of Computer Vision.

[25]  Nicolas D. Georganas,et al.  Fast color correction using principal regions mapping in different color spaces , 2004, Real Time Imaging.

[26]  Qionghai Dai,et al.  Color transfer based on wavelet transform , 2008, Electronic Imaging.

[27]  Beibei Li,et al.  Color correction based on point clouds alignment in the logarithmic RGB space , 2013, The Visual Computer.

[28]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[29]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.