Histogram-Based Color Transfer for Image Stitching

Color inconsistency often exists between the images to be stitched and will reduce the visual quality of the stitching results. Color transfer plays an important role in image stitching. This kind of technique can produce corrected images which are color consistent. This paper presents a color transfer approach via histogram specification and global mapping. The proposed algorithm can make images share the same color style and obtain color consistency. There are four main steps in this algorithm. Firstly, overlapping regions between a reference image and a test image are obtained. Secondly, an exact histogram specification is conducted for the overlapping region in the test image using the histogram of the overlapping region in the reference image. Thirdly, a global mapping function is obtained by minimizing color differences with an iterative method. Lastly, the global mapping function is applied to the whole test image for producing a color-corrected image. Both the synthetic dataset and real dataset are tested. The experiments demonstrate that the proposed algorithm outperforms the compared methods both quantitatively and qualitatively.

[1]  Erik Reinhard,et al.  Colour Mapping: A Review of Recent Methods, Extensions and Applications , 2016, Comput. Graph. Forum.

[2]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[3]  Mila Nikolova,et al.  Fast Ordering Algorithm for Exact Histogram Specification , 2014, IEEE Transactions on Image Processing.

[4]  André Kaup,et al.  Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[6]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[7]  Qi-Chong Tian,et al.  Color correction in image stitching using histogram specification and global mapping , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[8]  Sharath Pankanti,et al.  Adaptive as-natural-as-possible image stitching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Pascal Monasse,et al.  Global Multiple-View Color Consistency , 2013 .

[10]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[11]  Edoardo Provenzi.  Variational models for color image processing in the RGB space inspired by human vision Mémoire d'Habilitation a Diriger des Recherches dans la spécialité Mathématiques , 2016 .

[12]  Michael K. Ng,et al.  A Variational Method for Multiple-Image Blending , 2012, IEEE Transactions on Image Processing.

[13]  Nicolas Papadakis,et al.  A Variational Model for Histogram Transfer of Color Images , 2011, IEEE Transactions on Image Processing.

[14]  Alain Trémeau,et al.  Illumination and device invariant image stitching , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Gholamreza Anbarjafari.  An Objective No-Reference Measure of Illumination Assessment , 2015 .

[17]  Yingen Xiong,et al.  Fast panorama stitching for high-quality panoramic images on mobile phones , 2010, IEEE Transactions on Consumer Electronics.

[18]  Hristina Hristova,et al.  Style-aware robust color transfer , 2015, CAE '15.

[19]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Mila Nikolova,et al.  A Variational Model for Color Assignment , 2015, SSVM.

[22]  Raymond H. Chan,et al.  Journal of Mathematical Imaging and Vision 2012 1 Exact Histogram Specification for Digital Images Using a Variational Approach , 2022 .

[23]  Mila Nikolova,et al.  Fast Hue and Range Preserving Histogram Specification: Theory and New Algorithms for Color Image Enhancement , 2014, IEEE Transactions on Image Processing.

[24]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[25]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[27]  Alain Trémeau,et al.  Approximate Cross Channel Color Mapping from Sparse Color Correspondences , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[28]  Steven M. Seitz,et al.  Photo Uncrop , 2014, ECCV.

[29]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[30]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[31]  Henri Maitre.  From Photon to Pixel: The Digital Camera Handbook , 2015 .

[32]  Youngbae Hwang,et al.  Color Transfer Using Probabilistic Moving Least Squares , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.