Naturalness- and information-preserving image recoloring for red-green dichromats

Abstract More than 100 million individuals around the world suffer from color vision deficiency (CVD). Image recoloring algorithms have been proposed to compensate for CVD. This study has proposed a new recoloring algorithm to make up shortages of contrast enhancement and naturalness preservation of the state-of-the-art methods. The recoloring task is formulated as an optimization problem that is solved by using the colors in a simulated CVD color space to maximize contrast and to preserve the original color as much as possible. In addition, the dominant colors are extracted for recoloring. They are then propagated to the whole image so that the optimization problem could be solved at a reasonable cost independent of the image size. In the quantitative evaluation, the results of the proposed method are competitive with those of the best existing method. The evaluation involving subjects with CVD demonstrates that the proposed method outperforms the state-of-the-art method in preserving both the information and the naturalness of images.

[1]  Manuel Menezes de Oliveira Neto,et al.  Using Patterns to Encode Color Information for Dichromats , 2013, IEEE Transactions on Visualization and Computer Graphics.

[2]  J D Mollon,et al.  Computerized simulation of color appearance for dichromats. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  C. H. Graham,et al.  STUDIES OF COLOR BLINDNESS: A UNILATERALLY DICHROMATIC SUBJECT , 1959 .

[4]  Stephen DiVerdi,et al.  Palette-based photo recoloring , 2015, ACM Trans. Graph..

[5]  Manuel Menezes de Oliveira Neto,et al.  An improved contrast enhancing approach for color-to-grayscale mappings , 2008, The Visual Computer.

[6]  Cewu Lu,et al.  Contrast preserving decolorization , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[7]  D B JUDD,et al.  The color perceptions of deuteranopic and protanopic observers. , 1948, Journal of the Optical Society of America.

[8]  Manuel Menezes de Oliveira Neto,et al.  An Efficient Naturalness-Preserving Image-Recoloring Method for Dichromats , 2008, IEEE Transactions on Visualization and Computer Graphics.

[9]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[10]  Shi-Min Hu,et al.  Instant Propagation of Sparse Edits on Images and Videos , 2010, Comput. Graph. Forum.

[11]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[12]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[13]  Po-Chieh Hung,et al.  A Colour Conversion Method Which Allows Colourblind and Normal-Vision People Share Documents with Colour Content (画像技術特集) , 2013 .

[14]  Manabu Ichikawa,et al.  Preliminary study on color modification for still images to realize barrier-free color vision , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[15]  Donald P. Greenberg,et al.  Color-defective vision and computer graphics displays , 1988, IEEE Computer Graphics and Applications.

[16]  Manuel Menezes de Oliveira Neto,et al.  A Physiologically-based Model for Simulation of Color Vision Deficiency , 2009, IEEE Transactions on Visualization and Computer Graphics.

[17]  Ralph R. Martin,et al.  Learning Natural Colors for Image Recoloring , 2014, Comput. Graph. Forum.

[18]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[19]  Richard Harvey,et al.  Accommodating color blind computer users , 2006, Assets '06.

[20]  Wolfgang Heidrich,et al.  Cluster-based color space optimizations , 2011, 2011 International Conference on Computer Vision.

[21]  J. Nathans,et al.  Opsin genes, cone photopigments, color vision, and color blindness , 1999 .

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Manuel Menezes de Oliveira Neto,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2010 Real-time Temporal-coherent Color Contrast Enhancement for Dichromats , 2022 .

[24]  Richard Harvey,et al.  An interface to support color blind computer users , 2007, CHI.

[25]  Ken Wakita,et al.  SmartColor: disambiguation framework for the colorblind , 2005, Assets '05.

[26]  Li Xu,et al.  A sparse control model for image and video editing , 2013, ACM Trans. Graph..

[27]  Xiaowu Chen,et al.  Manifold preserving edit propagation , 2012, ACM Trans. Graph..

[28]  Gordon Heron,et al.  Visual adaptation to interocular brightness differences induced by neutral-density filters. , 2007, Investigative ophthalmology & visual science.

[29]  Sheng-Jyh Wang,et al.  Image recolorization for the colorblind , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Robert Geist,et al.  Smart Depiction for Visual Communication Detail Preserving Reproduction of Color Images for , 2022 .

[31]  Sheng-Jyh Wang,et al.  Information Preserving Color Transformation for Protanopia and Deuteranopia , 2007, IEEE Signal Processing Letters.

[32]  Chun-Rong Huang,et al.  Key Color Priority Based Image Recoloring for Dichromats , 2010, PCM.

[33]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Behzad Mansouri,et al.  Binocular summation of contrast remains intact in strabismic amblyopia. , 2007, Investigative ophthalmology & visual science.

[35]  Shengdong Zhao,et al.  ColorBless , 2015, ACM Trans. Comput. Hum. Interact..

[36]  Vittorio Scarano,et al.  Efficient edge-services for colorblind users , 2006, WWW '06.

[37]  Raveendran Paramesran,et al.  Naturalness preserving image recoloring method for people with red-green deficiency , 2017, Signal Process. Image Commun..

[38]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[39]  J E Sheedy,et al.  Surrogate Color Vision by Luster Discrimination , 1984, American journal of optometry and physiological optics.

[40]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..

[41]  J K Hovis Long Wavelength Pass Filters Designed for the Management of Color Vision Deficiencies , 1997, Optometry and vision science : official publication of the American Academy of Optometry.

[42]  Tien-Tsin Wong,et al.  Seamless visual sharing with color vision deficiencies , 2016, ACM Trans. Graph..

[43]  Robert Geist,et al.  Re‐coloring Images for Gamuts of Lower Dimension , 2005, Comput. Graph. Forum.

[44]  Paul S. Heckbert Color image quantization for frame buffer display , 1998 .

[45]  D. B. Judd Fundamental studies of color vision from 1860 to 1960. , 1966, Proceedings of the National Academy of Sciences of the United States of America.