Assessing recognition memory using confidence ratings and response times

Classification of stimuli into categories (such as ‘old’ and ‘new’ in tests of recognition memory or ‘present’ versus ‘absent’ in signal detection tasks) requires the mapping of internal signals to discrete responses. Introspective judgements about a given choice response are regularly employed in research, legal and clinical settings in an effort to measure the signal that is thought to be the basis of the classification decision. Correlations between introspective judgements and task performance suggest that such ratings often do convey information about internal states that are relevant for a given task, but well-known limitations of introspection call the fidelity of this information into question. We investigated to what extent response times can reveal information usually assessed with explicit confidence ratings. We quantitatively compared response times to confidence ratings in their ability to qualify recognition memory decisions and found convergent results suggesting that much of the information from confidence ratings can be obtained from response times.

[1]  Shane T. Mueller,et al.  Decision noise: An explanation for observed violations of signal detection theory , 2008, Psychonomic bulletin & review.

[2]  R. Bjork,et al.  The mismeasure of memory: when retrieval fluency is misleading as a metamnemonic index. , 1998, Journal of experimental psychology. General.

[3]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[4]  Per B. Sederberg,et al.  PyEPL: A cross-platform experiment-programming library , 2007, Behavior research methods.

[5]  A. Bröder,et al.  Recognition ROCs are curvilinear-or are they? On premature arguments against the two-high-threshold model of recognition. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[6]  Roger Ratcliff,et al.  Validating the unequal-variance assumption in recognition memory using response time distributions instead of ROC functions: A diffusion model analysis. , 2014, Journal of memory and language.

[7]  D. Weintraub,et al.  A signal-detection approach to subception: Concomitant verbal and finger-latency responses in metacontrast , 1979 .

[8]  Bennett L. Schwartz,et al.  The Inferential and Experiential Bases of Metamemory , 1997 .

[9]  D S Blough,et al.  Stimulus Generalization as Signal Detection in Pigeons , 1967, Science.

[10]  D. Blough.  Reaction times of pigeons on a wavelength discrimination task. , 1978, Journal of the experimental analysis of behavior.

[11]  Elizabeth A. Olson,et al.  Eyewitness testimony. , 2003, Annual review of psychology.

[12]  T. Zandt.  ROC curves and confidence judgments in recognition memory. , 2000 .

[13]  Rakefet Ackerman,et al.  Response latency as a predictor of the accuracy of children's reports. , 2011, Journal of experimental psychology. Applied.

[14]  Dean Yager,et al.  Signal-detection analysis of luminance generalization in goldfish using latency as a graded response measure , 1971 .

[15]  Anne-Wil Harzing,et al.  Response Style Differences in Cross-National Research , 2012 .

[16]  Geoffrey R. Loftus,et al.  Response time versus accuracy in human memory , 1999 .

[17]  Pingbo Yin,et al.  Do ferrets perceive relative pitch? , 2010, The Journal of the Acoustical Society of America.

[18]  Zhang,et al.  Analyzing Neuronal Processing Locus in Stimulus-Response Association Tasks , 1997, Journal of mathematical psychology.

[19]  J. L. Myers,et al.  Short-term recognition memory of tones , 1970 .

[20]  J. Lee,et al.  The Best–Worst Scaling Approach: An Alternative to Schwartz's Values Survey , 2008, Journal of personality assessment.

[21]  M. Kahana,et al.  Parametric effects of word frequency in memory for mixed frequency lists. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[22]  M. L. Kietzman,et al.  Visual flicker in depression: response criteria, confidence ratings and response times , 1986, Psychological Medicine.

[23]  Daniel M. Oppenheimer.  The secret life of fluency , 2008, Trends in Cognitive Sciences.

[24]  J. D. Balakrishnan,et al.  Decision processes in discrimination: fundamental misrepresentations of signal detection theory. , 1999, Journal of experimental psychology. Human perception and performance.

[25]  Donald A. Norman,et al.  Strength theory of decision rules and latency in retrieval from short-term memory , 1969 .

[26]  Geoffrey R. Loftus,et al.  Accounts of the confidence-accuracy relation in recognition memory , 2000, Psychonomic bulletin & review.

[27]  Louis Narens,et al.  Using the past to predict the future , 2005, Memory & cognition.

[28]  J V Baranski,et al.  Probing the locus of confidence judgments: experiments on the time to determine confidence. , 1998, Journal of experimental psychology. Human perception and performance.

[29]  Geraint Rees,et al.  Relating Introspective Accuracy to Individual Differences in Brain Structure , 2010, Science.

[30]  A. Bröder,et al.  Validating a two-high-threshold measurement model for confidence rating data in recognition , 2013, Memory.

[31]  Charles S. Watson,et al.  Response latency, confidence, and ROCs in auditory signal detection , 1972 .

[32]  C. Lineberry,et al.  Sensory discriminability in monkeys and humans: Direct comparisons by signal detection theory , 1977, Neuropsychologia.

[33]  Leonard Katz,et al.  A comparison of type II operating characteristics derived from confidence ratings and from latencies , 1970 .

[34]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[35]  Shane T. Mueller,et al.  Decision noise may mask criterion shifts: Reply to Balakrishnan and MacDonald (2008) , 2008 .

[36]  G. Werner,et al.  Signal detection analysis of stimulus discrimination in normal and split-brain monkeys. , 1974, Brain research.

[37]  A Koriat,et al.  How do we know that we know? The accessibility model of the feeling of knowing. , 1993, Psychological review.

[38]  M. P. Friedman,et al.  Reaction-time distributions in the detection of weak signals in noise. , 1965, The Journal of the Acoustical Society of America.

[39]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[40]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[41]  W. Wundt,et al.  Beiträge zur Theorie der Sinneswahrnehmung , 1862 .

[42]  David Navon,et al.  A simple method for latency analysis in signal detection tasks , 1975 .

[43]  Paul Karoly,et al.  Self-report scales and procedures for assessing pain in adults , 1992 .

[44]  Jerome L. Myers,et al.  Implications of latency data for threshold and nonthreshold models of signal detection , 1972 .

[45]  Timothy J. Pleskac,et al.  Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. , 2010, Psychological review.

[46]  Tim Curran,et al.  EEG oscillations and recognition memory: Theta correlates of memory retrieval and decision making , 2006, NeuroImage.

[47]  David Kellen,et al.  Signal detection and threshold modeling of confidence-rating ROCs: A critical test with minimal assumptions. , 2015, Psychological review.

[48]  D. S. Lindsay,et al.  Remembering Mistaken for Knowing: Ease of Retrieval as a Basis for Confidence in Answers to General Knowledge Questions , 1993 .

[49]  M. Terman,et al.  Comparison of yes-no and latency measures of auditory intensity discrimination. , 1979, Journal of the experimental analysis of behavior.

[50]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[51]  Andrew Heathcote,et al.  Item recognition memory and the receiver operating characteristic. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[52]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[53]  R. Ratcliff,et al.  Modeling confidence and response time in recognition memory. , 2009, Psychological review.

[54]  C. Rotello,et al.  Binary ROCs in perception and recognition memory are curved. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[55]  L. Gray.  Simultaneous masking in newborn chickens , 1993, Hearing Research.

[56]  J. Starns.  Using response time modeling to distinguish memory and decision processes in recognition and source tasks , 2014, Memory & Cognition.

[57]  Hans Baumgartner,et al.  Response Styles in Marketing Research: A Cross-National Investigation , 2001 .

[58]  G. Essick,et al.  Assessment of the capacity of human subjects and S-I neurons to distinguish opposing directions of stimulus motion across the skin , 1985, Brain Research Reviews.

[59]  Trisha Van Zandt,et al.  Roc curves and confidence judgments in recognition memory , 2000 .

[60]  Roger Ratcliff,et al.  Beyond ROC curvature: Strength effects and response time data support continuous-evidence models of recognition memory. , 2012, Journal of memory and language.