Notes on the application of the standardized residual sum of squares index for the assessment of intra- and inter-observer variability in color-difference experiments.

The standardized residual sum of squares index was proposed to examine the significant merit of a given color-difference formula over another with respect to a given set of visual color-difference data [J. Opt. Soc. Am. A 24, 1823-1829, 2007]. This index can also be employed to determine intra- and inter-observer variability, although the full complexity of this variability cannot be described by just one number. Appropriate utilization of the standardized residual sum of squares index for the assessment of observer variability is described with a view to encourage its use in future color-difference research. The main goal of this paper is to demonstrate that setting the F parameters of the standardized residual sum of squares index to 1 results in a loss of essential properties of the index (for example, symmetry), and is therefore strongly discouraged.

[1]  J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[2]  Roy S. Berns,et al.  RIT‐DuPont supra‐threshold color‐tolerance individual color‐difference pair dataset , 2009 .

[3]  Rafael Huertas,et al.  Performance of recent advanced color-difference formulas using the standardized residual sum of squares index. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  J. Edward Jackson,et al.  The User's Guide to Multidimensional Scaling , 1985 .

[5]  Guihua Cui,et al.  Assessing total differences for effective samples having variations in color, coarseness, and glint , 2010 .

[6]  Samuel Morillas,et al.  Fuzzy analysis for detection of inconsistent data in experimental datasets employed at the development of the CIEDE2000 colour-difference formula , 2009 .

[7]  David Hinks,et al.  Comparison of naïve and expert subjects in the assessment of small color differences. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  M. A. Tehran,et al.  Investigating the effect of texture on the performance of color difference formulae , 2009 .

[9]  M. Ronnier Luo,et al.  Investigation of parametric effects using small colour differences , 1999 .

[10]  R. Kuehni Variability in estimation of suprathreshold small color differences , 2009 .

[11]  David Hinks,et al.  Development of a comprehensive visual dataset based on a CIE blue color center: Assessment of color difference formulae using various statistical methods , 2011 .

[12]  Guihua Cui,et al.  Color appearance and visual measurements for color samples with gloss effect , 2009 .

[13]  Rolf G. Kuehni,et al.  CIEDE2000, milestone or final answer? , 2002 .

[14]  Roy S. Berns,et al.  Evaluating color difference equation performance incorporating visual uncertainty , 2009 .

[15]  Frank Critchley,et al.  The user's guide to multidimensional scaling , 1982 .

[16]  Guihua Cui,et al.  Measurement of the relationship between perceived and computed color differences. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.