Color-to-gray based on chance of happening preservation

It is important to convert color images into grayscale ones for both commercial and scientific applications, such as reducing the publication cost and making the color blind people capture the visual content and semantics from color images. Recently, a dozen of algorithms have been developed for color-to-gray conversion. However, none of them considers the visual attention consistency between the color image and the converted grayscale one. Therefore, these methods may fail to convey important visual information from the original color image to the converted grayscale image. Inspired by the Helmholtz principle (Desolneux et al. 2008 [16]) that ''we immediately perceive whatever could not happen by chance'', we propose a new algorithm for color-to-gray to solve this problem. In particular, we first define the Chance of Happening (CoH) to measure the attentional level of each pixel in a color image. Afterward, natural image statistics are introduced to estimate the CoH of each pixel. In order to preserve the CoH of the color image in the converted grayscale image, we finally cast the color-to-gray to a supervised dimension reduction problem and present locally sliced inverse regression that can be efficiently solved by singular value decomposition. Experiments on both natural images and artificial pictures suggest (1) that the proposed approach makes the CoH of the color image and that of the converted grayscale image consistent and (2) the effectiveness and the efficiency of the proposed approach by comparing with representative baseline algorithms. In addition, it requires no human-computer interactions.

[1]  K. R. Rao,et al.  Digital Video Image Quality and Perceptual Coding (Signal Processing and Communications) , 2005 .

[2]  Raja Bala,et al.  Color-to-grayscale conversion to maintain discriminability , 2003, IS&T/SPIE Electronic Imaging.

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Karol Myszkowski,et al.  Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video , 2008, Comput. Graph. Forum.

[5]  Xuelong Li,et al.  Geometric Mean for Subspace Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Robert Geist,et al.  Smart Depiction for Visual Communication Detail Preserving Reproduction of Color Images for , 2022 .

[7]  Yong Luo,et al.  Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification , 2013, IEEE Transactions on Image Processing.

[8]  Wenjun Zhang,et al.  Scalable visual sensitivity profile estimation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[10]  Lawrence B. Wolff,et al.  Multispectral image visualization through first-order fusion , 2002, IEEE Trans. Image Process..

[11]  Zhu Li,et al.  Grassmann Hashing for approximate nearest neighbor search in high dimensional space , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[12]  Bo Geng,et al.  Manifold Regularized Multi-task Learning for Semi-supervised Multi-label Image Classification , 2013 .

[13]  Dacheng Tao,et al.  Subspaces Indexing Model on Grassmann Manifold for Image Search , 2011, IEEE Transactions on Image Processing.

[14]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[15]  Robert Geist,et al.  Re‐coloring Images for Gamuts of Lower Dimension , 2005, Comput. Graph. Forum.

[16]  Xuelong Li,et al.  Color to Gray: Visual Cue Preservation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Dacheng Tao,et al.  Double Shrinking Sparse Dimension Reduction , 2013, IEEE Transactions on Image Processing.

[18]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[19]  Xuelong Li,et al.  Segmenting Images by Combining Selected Atlases on Manifold , 2011, MICCAI.

[20]  Xuelong Li,et al.  Visual Attention Accelerated Vehicle Detection in Low-Altitude Airborne Video of Urban Environment , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[22]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[23]  Simone G. O. Fiori Visualization of Riemannian-manifold-valued elements by multidimensional scaling , 2011, Neurocomputing.

[24]  Hong Ren Wu,et al.  Digital Video Image Quality and Perceptual Coding , 2005 .

[25]  Reiner Eschbach,et al.  Spatial Color-to-Grayscale Transform Preserving Chrominance Edge Information , 2004, CIC.

[26]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[27]  Michel Verleysen,et al.  Mixtures of robust probabilistic principal component analyzers , 2008, ESANN.

[28]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis: A Probabilistic Approach , 2007 .

[29]  Ker-Chau Li,et al.  Sliced Inverse Regression for Dimension Reduction , 1991 .