Separating decision and encoding noise in signal detection tasks.

In this article we develop an extension to the signal detection theory framework to separately estimate internal noise arising from representational and decision processes. Our approach constrains signal detection theory models with decision noise by combining a multipass external noise paradigm with confidence rating responses. In a simulation study we present evidence that representation and decision noise can be separately estimated over a range of representative underlying representational and decision noise level configurations. These results also hold across a number of decision rules and show resilience to rule miss-specification. The new theoretical framework is applied to a visual detection confidence-rating task with 3 and 5 response categories. This study compliments and extends the recent efforts of researchers (Benjamin, Diaz, & Wee, 2009; Mueller & Weidemann, 2008; Rosner & Kochanski, 2009; Kellen, Klauer, & Singmann, 2012) to separate and quantify underlying sources of response variability in signal detection tasks.

[1]  M P Friedman,et al.  Feedback and psychophysical variables in signal detection. , 1966, The Journal of the Acoustical Society of America.

[2]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[3]  Ewart A. C. Thomas Criterion adjustment and probability matching , 1975 .

[4]  S. Fernberger Interdependence of judgments within the series for the method of constant stimuli. , 1920 .

[5]  David Kellen,et al.  The law of categorical judgment (corrected) extended: a note on Rosner and Kochanski (2009). , 2012, Psychological review.

[6]  Jeremy Mayall,et al.  The Magical Number Seven, Plus or Minus Two - PLUNGE , 2016 .

[7]  N. Macmillan,et al.  The psychophysics of categorical perception. , 1977, Psychological review.

[8]  Dennis M Levi,et al.  Noise Provides Some New Signals About the Spatial Vision of Amblyopes , 2003, The Journal of Neuroscience.

[9]  D. Norman,et al.  Strength models and serial position in short-term recognition memory ☆ , 1966 .

[10]  Ewart A. C. Thomas On a class of additive learning models: Error-correcting and probability matching , 1973 .

[11]  B. Dosher,et al.  Characterizing observers using external noise and observer models: assessing internal representations with external noise. , 2008, Psychological review.

[12]  D. M. Green,et al.  The bow and sequential effects in absolute identification , 1982, Perception & psychophysics.

[13]  D. M. Green,et al.  Multiple Observations of Signals in Noise , 1959 .

[14]  D. Pelli The quantum efficiency of vision , 1990 .

[15]  T. Parks Signal-detectability theory of recognition-memory performance. , 1966, Psychological review.

[16]  Bingni W. Brunton,et al.  Rats and Humans Can Optimally Accumulate Evidence for Decision-Making , 2013, Science.

[17]  Henrik Singmann,et al.  On the measurement of criterion noise in signal detection theory: the case of recognition memory. , 2012, Psychological review.

[18]  F Gravetter,et al.  Criterial range as a frame of reference for stimulus judgment. , 1973, Psychological review.

[19]  M. Treisman,et al.  American Psychological Association, Inc, A Theory of Criterion Setting With an Application to Sequential Dependencies , 2022 .

[20]  L. Maloney,et al.  Bias and sensitivity in two-interval forced choice procedures: Tests of the difference model , 2008, Vision Research.

[21]  N I Durlach,et al.  Intensity perception. I. Preliminary theory of intensity resolution. , 1969, The Journal of the Acoustical Society of America.

[22]  C. I. Howarth,et al.  Non-Random Sequences in Visual Threshold Experiments , 1956 .

[23]  N. Graham Visual Pattern Analyzers , 1989 .

[24]  M Treisman,et al.  A theory of criterion setting: an alternative to the attention band and response ratio hypotheses in magnitude estimation and cross-modality matching. , 1984, Journal of experimental psychology. General.

[25]  T. Treat,et al.  Quantifying the information value of clinical assessments with signal detection theory. , 1999, Annual review of psychology.

[26]  K Brown,et al.  Signal detection analysis of drug effects , 1978, Irish journal of medical science.

[27]  B. Dosher,et al.  Characterizing human perceptual inefficiencies with equivalent internal noise. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[29]  D. M. Green,et al.  CONSISTENCY OF AUDITORY DETECTION JUDGMENTS. , 1963, Psychology Review.

[30]  A E Burgess,et al.  Visual signal detection. IV. Observer inconsistency. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[31]  Richard F Murray,et al.  Optimal methods for calculating classification images: weighted sums. , 2002, Journal of vision.

[32]  G Sperling,et al.  Second-order reversed phi , 1999, Perception & psychophysics.

[33]  N. I. Durlach,et al.  Intensity Perception. II. Resolution in One‐Interval Paradigms , 1972 .

[34]  Stanley A. Klein,et al.  What is the signal in noise , 2004 .

[35]  Huanping Dai,et al.  Signal Detection Analysis of the Ideal Group , 1994 .

[36]  Aaron S Benjamin,et al.  Where is the criterion noise in recognition? (Almost) everyplace you look: comment on Kellen, Klauer, and Singmann (2012). , 2013, Psychological review.

[37]  John T Wixted,et al.  Cognitive theories as reinforcement history surrogates: The case of likelihood ratio models of human recognition memory , 2002, Animal learning & behavior.

[38]  Nick Chater,et al.  Salience driven value integration explains decision biases and preference reversal , 2012, Proceedings of the National Academy of Sciences.

[39]  Zhong-Lin Lu,et al.  Generating high gray-level resolution monochrome displays with conventional computer graphics cards and color monitors , 2003, Journal of Neuroscience Methods.

[40]  Andrew Faulkner,et al.  Can Decision Criteria Interchange Locations? Some Positive Evidence , 1985 .

[41]  B. Dosher,et al.  Mechanisms of perceptual learning , 1999, Vision Research.

[42]  H B BARLOW,et al.  Increment thresholds at low intensities considered as signal/noise discriminations , 1957, The Journal of physiology.

[43]  Zhong-Lin Lu,et al.  Visual Psychophysics: From Laboratory to Theory , 2013 .