Objective Quality Assessment for Color-to-Gray Image Conversion

Color-to-gray (C2G) image conversion is the process of transforming a color image into a grayscale one. Despite its wide usage in real-world applications, little work has been dedicated to compare the performance of C2G conversion algorithms. Subjective evaluation is reliable but is also inconvenient and time consuming. Here, we make one of the first attempts to develop an objective quality model that automatically predicts the perceived quality of C2G converted images. Inspired by the philosophy of the structural similarity index, we propose a C2G structural similarity (C2G-SSIM) index, which evaluates the luminance, contrast, and structure similarities between the reference color image and the C2G converted image. The three components are then combined depending on image type to yield an overall quality measure. Experimental results show that the proposed C2G-SSIM index has close agreement with subjective rankings and significantly outperforms existing objective quality metrics for C2G conversion. To explore the potentials of C2G-SSIM, we further demonstrate its use in two applications: 1) automatic parameter tuning for C2G conversion algorithms and 2) adaptive fusion of C2G converted images.

[1]  Reiner Eschbach,et al.  Spatial Color-to-Grayscale Transform Preserving Chrominance Edge Information , 2004, CIC.

[2]  Yonghong Tian,et al.  Quality Assessment for Comparing Image Enhancement Algorithms , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Kai Zeng,et al.  High Dynamic Range Image Compression by Optimizing Tone Mapped Image Quality Index , 2015, IEEE Transactions on Image Processing.

[4]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[5]  Cewu Lu,et al.  Contrast Preserving Decolorization with Perception-Based Quality Metrics , 2014, International Journal of Computer Vision.

[6]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[7]  László Neumann,et al.  An Efficient Perception-based Adaptive Color to Gray Transformation , 2007, CAe.

[8]  Kai Zeng,et al.  Perceptual evaluation of multi-exposure image fusion algorithms , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[9]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[10]  Xiaobin Xu,et al.  Decolorization: is rgb2gray() out? , 2013, SIGGRAPH ASIA Technical Briefs.

[11]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[12]  Manuel Menezes de Oliveira Neto,et al.  An improved contrast enhancing approach for color-to-grayscale mappings , 2008, The Visual Computer.

[13]  Rafael C. Gonzales,et al.  Digital Image Processing -3/E. , 2012 .

[14]  Changjun Li,et al.  The CIECAM02 Color Appearance Model , 2002, CIC.

[15]  Zhou Wang,et al.  Objective Quality Assessment for Multiexposure Multifocus Image Fusion , 2015, IEEE Transactions on Image Processing.

[16]  Xuelong Li,et al.  Color to Gray: Visual Cue Preservation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Antal Nemcsics Recent experiments investigating the harmony interval based color space of the coloroid color system , 2002, Other Conferences.

[18]  Cewu Lu,et al.  Contrast preserving decolorization , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[19]  Peter G. J. Barten,et al.  Contrast sensitivity of the human eye and its e ects on image quality , 1999 .

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Zhou Wang,et al.  Objective Quality Assessment of Interpolated Natural Images , 2015, IEEE Transactions on Image Processing.

[22]  Karol Myszkowski,et al.  Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video , 2008, Comput. Graph. Forum.

[23]  Robert Geist,et al.  Re‐coloring Images for Gamuts of Lower Dimension , 2005, Comput. Graph. Forum.

[24]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[25]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[27]  Zhou Wang,et al.  On the Mathematical Properties of the Structural Similarity Index , 2012, IEEE Transactions on Image Processing.

[28]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[30]  Zhou Wang,et al.  Objective quality assessment for image super-resolution: A natural scene statistics approach , 2012, 2012 19th IEEE International Conference on Image Processing.

[31]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[32]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, ACM Trans. Graph..

[33]  Davide Eynard,et al.  Laplacian colormaps: a framework for structure‐preserving color transformations , 2014, Comput. Graph. Forum.

[34]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[36]  Y. Nayatani Simple estimation methods for the Helmholtz—Kohlrausch effect , 1997 .

[37]  Zhou Wang,et al.  Perceptual evaluation of single image dehazing algorithms , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[38]  Martin Cadík,et al.  Perceptual Evaluation of Color‐to‐Grayscale Image Conversions , 2008, Comput. Graph. Forum.

[39]  Ingmar Lissner,et al.  Toward a Unified Color Space for Perception-Based Image Processing , 2012, IEEE Transactions on Image Processing.

[40]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..

[41]  Joann M. Taylor,et al.  Digital Color Imaging Handbook , 2004 .

[42]  Seungyong Lee,et al.  Robust color-to-gray via nonlinear global mapping , 2009, ACM Trans. Graph..

[43]  L. Thurstone A law of comparative judgment. , 1994 .

[44]  Kai Zeng,et al.  High dynamic range image tone mapping by optimizing tone mapped image quality index , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[45]  Lizhuang Ma,et al.  Saliency preserving decolorization , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[46]  Guihua Cui,et al.  Evaluation of Colour-difference Formulae for Different Colour-difference Magnitudes , 2008, CGIV/MCS.

[47]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[48]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[49]  Eero P. Simoncelli,et al.  Maximum differentiation (MAD) competition: a methodology for comparing computational models of perceptual quantities. , 2008, Journal of vision.