Decision-variable correlation

An extension of the signal-detection theory framework is described and demonstrated for two-alternative identification tasks. The extended framework assumes that the subject and an arbitrary model (or two subjects, or the same subject on two occasions) are performing the same task with the same stimuli, and that on each trial they both compute values of a decision variable. Thus, their joint performance is described by six fundamental quantities: two levels of intrinsic discriminability (d′), two values of decision criterion, and two decision-variable correlations (DVCs), one for each of the two categories of stimuli. The framework should be widely applicable for testing models and characterizing individual differences in behavioral and neurophysiological studies of perception and cognition. We demonstrate the framework for the well-known task of detecting a Gaussian target in white noise. We find that (a) subjects' DVCs are approximately equal to the square root of their efficiency relative to ideal (in agreement with the prediction of a popular class of models), (b) between-subjects and within-subject (double-pass) DVCs increase with target contrast and are greater for target-present than target-absent trials (rejecting many models), (c) model parameters can be estimated by maximizing DVCs between the model and subject, (d) a model with a center–surround template and a specific (modest) level of position uncertainty predicts the trial-by-trial performance of subjects as well as (or better than) presenting the same stimulus again to the subjects (i.e., the double-pass DVCs), and (e) models of trial-by-trial performance should not include a representation of internal noise.

[1]  Anirvan S. Nandy,et al.  Classification images with uncertainty. , 2006, Journal of vision.

[2]  D M Green,et al.  Two procedures for estimating internal noise. , 1981, The Journal of the Acoustical Society of America.

[3]  A Burgess,et al.  Visual signal detection. III. On Bayesian use of prior knowledge and cross correlation. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[5]  Miguel P Eckstein,et al.  Similar Neural Representations of the Target for Saccades and Perception during Search , 2007, The Journal of Neuroscience.

[6]  M P Eckstein,et al.  Visual signal detection in structured backgrounds. II. Effects of contrast gain control, background variations, and white noise. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  B. Dosher,et al.  Characterizing human perceptual inefficiencies with equivalent internal noise. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  D. M. Green,et al.  Multiple Observations of Signals in Noise , 1959 .

[9]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[10]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[11]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[12]  Claudia Biermann,et al.  Mathematical Methods Of Statistics , 2016 .

[13]  A. Ahumada Perceptual Classification Images from Vernier Acuity Masked by Noise , 1996 .

[14]  D G Pelli,et al.  Why use noise? , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  W. W. Peterson,et al.  The theory of signal detectability , 1954, Trans. IRE Prof. Group Inf. Theory.

[16]  Jonathan W. Pillow,et al.  Majority of choice-related variability in perceptual decisions is present in early sensory cortex , 2017, bioRxiv.

[17]  T. Wickens Elementary Signal Detection Theory , 2001 .

[18]  E. Seidemann,et al.  Linking V1 Activity to Behavior. , 2018, Annual review of vision science.

[19]  Joshua A Solomon,et al.  Noise reveals visual mechanisms of detection and discrimination. , 2002, Journal of vision.

[20]  A. Ahumada,et al.  Stimulus Features in Signal Detection , 1971 .

[21]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[22]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution. VIII. On the correlation of characters not quantitatively measurable , 1900, Proceedings of the Royal Society of London.

[23]  Richard F Murray,et al.  Classification images: A review. , 2011, Journal of vision.

[24]  A E Burgess,et al.  Visual signal detection. IV. Observer inconsistency. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[25]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .