Dynamic Signal Detection Theory : The next logical step in the evolution of signal detection analysis

Measurement, design, and training programs in human factors often rely on the formal concepts of signal detection theory in order to analyze and interpret the performance of human operators. Following recent work in the response time modeling literature, we propose a generalization of this classical framework that is as simple to apply and yet more powerful, in the sense that it is able to identify speed-accuracy trade-off effects that would be confused by detection theory with sensitivity effects. Like the classical, static detection models, this dynamic framework distinguishes between the sensitivity of the operator and operator biases that may lead to higher identification rates for some events but at the expense of lower identification rates of other events. We deve lop formulas for the three free parameters of the dynamic model that can be computed easily without requiring a parameter search routine. We also show how two different kinds of biases, in the stopping rule and in the decision rule, can be distinguished and related to conditions of the display or to operator preferences. These methods require no additional design features and make it possible for investigators not only to quantify an operator’s ability to perform a discrimination task but also to provide feedback that operators can use to correct any suboptimality in their decision making strategy.

[1]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[2]  Philip L. Smith Psychophysically principled models of visual simple reaction time. , 1995 .

[3]  J. D. Balakrishnan,et al.  Decision processes in discrimination: fundamental misrepresentations of signal detection theory. , 1999, Journal of experimental psychology. Human perception and performance.

[4]  R. Nosofsky,et al.  An exemplar-based random walk model of speeded classification. , 1997, Psychological review.

[5]  D. M. Green,et al.  Choice reaction time with a random foreperiod , 1983, Perception & psychophysics.

[6]  David R. Cox,et al.  The Theory of Stochastic Processes , 1967, The Mathematical Gazette.

[7]  C. EWARTA. Sufficient Conditions for Monotone Hazard Rate An Application to Latency-Probability Curves , 2003 .

[8]  W. Edwards Optimal strategies for seeking information: Models for statistics, choice reaction times, and human information processing ☆ , 1965 .

[9]  S. Karlin,et al.  A second course in stochastic processes , 1981 .

[10]  J. Swets Indices of discrimination or diagnostic accuracy: their ROCs and implied models. , 1986, Psychological bulletin.

[11]  Ashby,et al.  A Stochastic Version of General Recognition Theory. , 2000, Journal of mathematical psychology.

[12]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[13]  J. D. Balakrishnan Measures and Interpretations of Vigilance Performance: Evidence against the Detection Criterion , 1998, Hum. Factors.

[14]  J. D. Balakrishnan Some More Sensitive Measures of Sensitivity and Response Bias , 1998 .

[15]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[16]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[17]  Jeffrey N. Rouder,et al.  A diffusion model account of masking in two-choice letter identification. , 2000, Journal of experimental psychology. Human perception and performance.

[18]  I. G. MacKenzie,et al.  Stochastic Processes with Applications , 1992 .

[19]  M. Stone Models for choice-reaction time , 1960 .

[20]  Franz Schmalhofer,et al.  STOCHASTIC CHOICE HEURISTICS , 1984 .

[21]  Philip L. Smith,et al.  Stochastic Dynamic Models of Response Time and Accuracy: A Foundational Primer. , 2000, Journal of mathematical psychology.

[22]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[23]  Diederich,et al.  Dynamic Stochastic Models for Decision Making under Time Constraints , 1997, Journal of mathematical psychology.

[24]  M. Degroot Optimal Statistical Decisions , 1970 .

[25]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[26]  D. F. Fisher,et al.  Hick's law and the speed-accuracy trade-off in absolute judgment , 1972 .

[27]  S. Link,et al.  A sequential theory of psychological discrimination , 1975 .

[28]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.