Human efficiency for detecting Gaussian signals in non-Gaussian distributed lumpy backgrounds using different display characteristics and scaling methods

A psychophysical study to measure human efficiency relative to the ideal observer for detecting a Gaussian signal at a known location in a non-Gaussian distributed lumpy background was conducted previously by the author. The study found that human efficiency was less than 2.2% while the ideal observer achieved 0.95 in terms of the area under the receiver operating characteristic curve. In this work, a psychophysical study was conducted with a number of changes that substantially improve upon the previous study design. First, a DICOM-calibrated monitor was used in this study for human-observer performance measurements, whereas an uncalibrated LCD monitor was used in the prior study. Second, two scaling methods to display image values were employed to see how scaling affects human performance for the same task. Third, a random order of image pairs was chosen for each observer to reduce any correlations in human performance that is likely caused by the fixed ordering of the image pairs in the prior study. Human efficiency relative to the ideal observer was found to be less than 3.8$% at the same performance level of the ideal observer as above. Our variance analysis indicates that neither scaling nor display made a significant difference in human performance on the tasks in the two studies. That is, we cannot say that either of these factors caused low human efficiency in these studies. Therefore, we conclude that using highly non-Gaussian distributed lumpy backgrounds in the tasks may have been the major source of low human efficiency.

[1]  Matthew A. Kupinski,et al.  Ideal-Observer Performance under Signal and Background Uncertainty , 2003, IPMI.

[2]  A E Burgess,et al.  Visual signal detectability with two noise components: anomalous masking effects. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  A E Burgess,et al.  Visual signal detection. II. Signal-location identification. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[4]  A. Burgess,et al.  Human observer detection experiments with mammograms and power-law noise. , 2001, Medical physics.

[5]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[6]  Harrison H. Barrett,et al.  Foundations of Image Science , 2003, J. Electronic Imaging.

[7]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[8]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[9]  A Badano,et al.  Method for measuring veiling glare in high-performance display devices. , 2000, Applied optics.

[10]  Theodore G. Birdsall,et al.  Definitions of d′ and η as Psychophysical Measures , 1958 .

[11]  Brandon D Gallas,et al.  One-shot estimate of MRMC variance: AUC. , 2006, Academic radiology.

[12]  Miguel P Eckstein,et al.  Search for lesions in mammograms: statistical characterization of observer responses. , 2003, Medical physics.

[13]  H H Barrett,et al.  Effect of random background inhomogeneity on observer detection performance. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[14]  Eric Clarkson,et al.  Efficiency of the human observer detecting random signals in random backgrounds. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  H. Barrett,et al.  Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  A E Burgess,et al.  The Rose model, revisited. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.