Classification images in a very general decision model

Most of the theory supporting our understanding of classification images relies on standard signal detection models and the use of normally distributed stimulus noise. Here I show that the most common methods of calculating classification images by averaging stimulus noise samples within stimulus-response classes of trials are much more general than has previously been demonstrated, and that they give unbiased estimates of an observer's template for a wide range of decision rules and non-Gaussian stimulus noise distributions. These results are similar to findings on reverse correlation and related methods in the neurophysiology literature, but here I formulate them in terms that are tailored to signal detection analyses of visual tasks, in order to make them more accessible and useful to visual psychophysicists. I examine 2AFC and yes-no designs. These findings make it possible to use and interpret classification images in tasks where observers' decision strategies may not conform to classic signal detection models such as the difference rule, and in tasks where the stimulus noise is non-Gaussian.

[1]  Richard F Murray,et al.  Classification images: A review. , 2011, Journal of vision.

[2]  P. Bennett,et al.  Deriving behavioural receptive fields for visually completed contours , 2000, Current Biology.

[3]  M. Landy,et al.  Histogram contrast analysis and the visual segregation of IID textures. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Larry N. Thibos,et al.  Validation of a clinical aberrometer , 2002 .

[5]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[6]  E J Chichilnisky,et al.  A simple white noise analysis of neuronal light responses , 2001, Network.

[7]  Richard F Murray,et al.  Optimal methods for calculating classification images: weighted sums. , 2002, Journal of vision.

[8]  Jakob H Macke,et al.  Estimating predictive stimulus features from psychophysical data: The decision image technique applied to human faces. , 2010, Journal of vision.

[9]  Miguel P Eckstein,et al.  Classification image analysis: estimation and statistical inference for two-alternative forced-choice experiments. , 2002, Journal of vision.

[10]  B. Leshowitz,et al.  The effects of duration, area, and background intensity on the visual intensity difference threshold given by the forced-choice procedure: Derivations from a statistical decision model for sensory discrimination , 1969 .

[11]  David J. Heeger,et al.  Spatiotemporal mechanisms for detecting and identifying image features in human vision , 2002, Nature Neuroscience.

[12]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[13]  Jun Saiki,et al.  Stimulus-driven mechanisms underlying visual search asymmetry revealed by classification image analyses. , 2008, Journal of vision.

[14]  Stephen Grossberg,et al.  Laminar cortical mechanisms for the perception of slanted and curved 3-D surfaces and their 2-D pictorical projections , 2010 .

[15]  L. Maloney,et al.  Bias and sensitivity in two-interval forced choice procedures: Tests of the difference model , 2008, Vision Research.

[16]  Kenneth Knoblauch,et al.  Estimating classification images with generalized linear and additive models. , 2008, Journal of vision.

[17]  Liam Paninski,et al.  Convergence properties of three spike-triggered analysis techniques , 2003, NIPS.

[18]  Richard F Murray,et al.  Classification images reveal decision variables and strategies in forced choice tasks , 2015, Proceedings of the National Academy of Sciences.

[19]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[20]  A. Ahumada Classification image weights and internal noise level estimation. , 2002, Journal of vision.

[21]  A. Ahumada Perceptual Classification Images from Vernier Acuity Masked by Noise , 1996 .

[22]  Peter Neri,et al.  Frontiers in Computational Neuroscience 2 Methods 2.1 Visual Stimuli and Task , 2022 .

[23]  Richard F. Murray,et al.  Posterior Probability Matching and Human Perceptual Decision Making , 2015, PLoS Comput. Biol..

[24]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.