A Probabilistic Approach for Color Correction in Image Mosaicking Applications

Image mosaicking applications require both geometrical and photometrical registrations between the images that compose the mosaic. This paper proposes a probabilistic color correction algorithm for correcting the photometrical disparities. First, the image to be color corrected is segmented into several regions using mean shift. Then, connected regions are extracted using a region fusion algorithm. Local joint image histograms of each region are modeled as collections of truncated Gaussians using a maximum likelihood estimation procedure. Then, local color palette mapping functions are computed using these sets of Gaussians. The color correction is performed by applying those functions to all the regions of the image. An extensive comparison with ten other state of the art color correction algorithms is presented, using two different image pair data sets. Results show that the proposed approach obtains the best average scores in both data sets and evaluation metrics and is also the most robust to failures.

[1]  Lei Han,et al.  An efficient fuzzy clustering-based color transfer method , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[2]  S. Walker,et al.  Sampling Truncated Normal, Beta, and Gamma Densities , 2001 .

[3]  Pierre Soille,et al.  Morphological image compositing , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[5]  André Kaup,et al.  Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[7]  Wenqing Huang,et al.  Automatic image stitching using SIFT , 2008, 2008 International Conference on Audio, Language and Image Processing.

[8]  Jana Kosecka,et al.  Piecewise planar city 3D modeling from street view panoramic sequences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  A. Abadpour,et al.  A fast and efficient fuzzy color transfer method , 2004, Proceedings of the Fourth IEEE International Symposium on Signal Processing and Information Technology, 2004..

[10]  Shohreh Kasaei,et al.  An efficient PCA-based color transfer method , 2007, J. Vis. Commun. Image Represent..

[11]  Shree K. Nayar,et al.  Video super-resolution using controlled subpixel detector shifts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[13]  Chi-Keung Tang,et al.  Tensor voting for image correction by global and local intensity alignment , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W. Härdle.  Applied Nonparametric Regression , 1991 .

[15]  Stephen Lin,et al.  Single-Image Vignetting Correction , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Victor S. Lempitsky,et al.  Seamless Mosaicing of Image-Based Texture Maps , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[18]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Aditi Majumder,et al.  ADICT: Accurate Direct and Inverse Color Transformation , 2010, ECCV.

[21]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Zhi-Wei Chen,et al.  Region-Based Color Correction of Images , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[23]  Peter Meer,et al.  Synergism in low level vision , 2002, Object recognition supported by user interaction for service robots.

[24]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Luc Vincent,et al.  Taking Online Maps Down to Street Level , 2007, Computer.

[26]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[27]  Jeremy R. Cooperstock,et al.  Color Correction Methods with Application to Digital Projection Environments , 2004, WSCG.

[28]  Miguel Oliveira,et al.  Color Correction Using 3D Gaussian Mixture Models , 2012, ICIAR.

[29]  Gui Yun Tian,et al.  Colour correction for panoramic imaging , 2002, Proceedings Sixth International Conference on Information Visualisation.

[30]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Gyemin Lee,et al.  EM algorithms for multivariate Gaussian mixture models with truncated and censored data , 2012, Comput. Stat. Data Anal..

[32]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Miguel Oliveira,et al.  Unsupervised local color correction for coarsely registered images , 2011, CVPR 2011.

[34]  Hong Li,et al.  Selective color transfer with multi-source images , 2009, Pattern Recognit. Lett..

[35]  Subhasis Chaudhuri,et al.  Automatic illumination correction for scene enhancement and object tracking , 2006, Image Vis. Comput..

[36]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[37]  W. Härdle.  Applied Nonparametric Regression , 1992 .

[38]  Dani Lischinski,et al.  Non-rigid dense correspondence with applications for image enhancement , 2011, ACM Trans. Graph..

[39]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Charles A. Bouman,et al.  Hierarchical Color Correction for Camera Cell Phone Images , 2008, IEEE Transactions on Image Processing.

[41]  Nicolas D. Georganas,et al.  Fast color correction using principal regions mapping in different color spaces , 2004, Real Time Imaging.

[42]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[43]  Chi-Keung Tang,et al.  Soft Color Segmentation and Its Applications , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Alain Trémeau,et al.  Approximate Cross Channel Color Mapping from Sparse Color Correspondences , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[45]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.