A critical comparison of discrete-state and continuous models of recognition memory: implications for recognition and beyond.

Multinomial processing tree (MPT) models such as the single high-threshold, double high-threshold, and low-threshold models are discrete-state decision models that map internal cognitive events onto overt responses. The apparent benefit of these models is that they provide independent measures of accuracy and response bias, a claim that has motivated their frequent application in many areas of psychological science including perception, item and source memory, social cognition, reasoning, educational testing, eyewitness testimony, and psychopathology. Before appropriate conclusions about a given analysis can be drawn, however, one must first confirm that the model's assumptions about the underlying structure of the data are valid. The current review outlines the assumptions of several popular MPT models and assesses their validity using multiple sources of evidence, including receiver operating characteristics, direct model fits, and experimental tests of qualitative predictions. We argue that the majority of the evidence is inconsistent with these models and that, instead, the evidence supports continuous models such as those based on signal detection theory (SDT). Hybrid models that incorporate both SDT and MPT processes are also explored, and we conclude that these models retain the limitations associated with their threshold model predecessors. The potentially severe consequences associated with using an invalid model to interpret data are discussed, and a simple tutorial and model-fitting tool is provided to allow implementation of the empirically supported SDT model.

[1]  L. Thurstone,et al.  A scoring method for mental tests. , 1919 .

[2]  K. Holzinger On scoring multiple response tests. , 1924 .

[3]  James P. Egan,et al.  Operating Characteristics Determined by Binary Decisions and by Ratings , 1959 .

[4]  John A. Swets,et al.  Indices of Signal Detectability Obtained with Various Psychophysical Procedures , 1959 .

[5]  J A SWETS,et al.  Is there a sensory threshold? , 1961, Science.

[6]  J SWETS,et al.  Decision processes in perception. , 1961, Psychological review.

[7]  R. Luce,et al.  A threshold theory for simple detection experiments. , 1963, Psychological review.

[8]  R. Atkinson,et al.  A variable sensitivity theory of signal detection. , 1963, Psychological review.

[9]  Gustav Theodor Fechner,et al.  Elements of psychophysics , 1966 .

[10]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[11]  W A Wickelgren,et al.  Testing two-state theories with operating characteristics and a posteriori probabilities. , 1968, Psychological bulletin.

[12]  D H Krantz,et al.  Threshold theories of signal detection. , 1969, Psychological review.

[13]  Don McNicol,et al.  A Primer of Signal Detection Theory , 1976 .

[14]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[15]  G. Box Robustness in the Strategy of Scientific Model Building. , 1979 .

[16]  L. A. Goodman,et al.  Measures of association for cross classifications , 1979 .

[17]  D. Bamber State-trace analysis: A method of testing simple theories of causation , 1979 .

[18]  P. Pollard,et al.  On the conflict between logic and belief in syllogistic reasoning , 1983, Memory & cognition.

[19]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[20]  E. Tulving Memory and consciousness. , 1985 .

[21]  Philip D. Harvey Reality Monitoring in Mania and Schizophrenia: The Association of Thought Disorder and Performance , 1985, The Journal of nervous and mental disease.

[22]  J A Swets,et al.  Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance. , 1986, Psychological bulletin.

[23]  J. Swets Indices of discrimination or diagnostic accuracy: their ROCs and implied models. , 1986, Psychological bulletin.

[24]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[25]  David M. Riefer,et al.  Multinomial processing models of source monitoring. , 1990 .

[26]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[27]  Leslie F. Clark,et al.  RATING SCALES NUMERIC VALUES MAY CHANGE THE MEANING OF SCALE LABELS , 1991 .

[28]  R. Ratcliff,et al.  Testing global memory models using ROC curves. , 1992 .

[29]  Jonathan Evans,et al.  The source of belief bias effects in syllogistic reasoning , 1992, Cognition.

[30]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[31]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[32]  David M. Riefer,et al.  Response strategies in source monitoring , 1994 .

[33]  M. Conway,et al.  Pictures, images, and recollective experience. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[34]  Xiangen Hu,et al.  Measuring memory factors in source monitoring: Reply to Kinchla. , 1994 .

[35]  A. Yonelinas Receiver-operating characteristics in recognition memory: evidence for a dual-process model. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[36]  P. Pollard,et al.  Debiasing by instruction: The case of belief bias , 1994 .

[37]  R. Kinchla Comments on Batchelder and Riefer's multinomial model for source monitoring. , 1994, Psychological review.

[38]  E. Erdfelder,et al.  Toward unbiased measurement of conscious and unconscious memory processes within the process dissociation framework. , 1995, Journal of experimental psychology. General.

[39]  D L Hintzman,et al.  Violations of the independence assumption in process dissociation. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[40]  R Ratcliff,et al.  Process dissociation, single-process theories, and recognition memory. , 1995, Journal of experimental psychology. General.

[41]  W. Donaldson,et al.  The role of decision processes in remembering and knowing , 1996, Memory & cognition.

[42]  E. Erdfelder,et al.  Source discrimination, item detection, and multinomial models of source monitoring. , 1996 .

[43]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  M. Johnson,et al.  Some problems with the process-dissociation approach to memory. , 1996, Journal of experimental psychology. General.

[45]  A. Yonelinas,et al.  Signal-Detection, Threshold, and Dual-Process Models of Recognition Memory: ROCs and Conscious Recollection , 1996, Consciousness and Cognition.

[46]  E. Erdfelder,et al.  The nature of memory processes underlying recognition judgments in the process dissociation procedure , 1997, Memory & cognition.

[47]  Neil W. Mulligan,et al.  Measuring the bases of recognition memory: An investigation of the process-dissociation framework , 1997 .

[48]  A. Yonelinas Recognition memory ROCs for item and associative information: The contribution of recollection and familiarity , 1997, Memory & cognition.

[49]  J. Engelkamp,et al.  Process Dissociation Procedure: Double Dissociations following Divided Attention and Speeded Responding , 1997 .

[50]  W. Batchelder Multinomial processing tree models and psychological assessment. , 1998 .

[51]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[52]  L L Jacoby,et al.  Invariance in automatic influences of memory: toward a user's guide for the process-dissociation procedure. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[53]  G. Fechner Elemente der Psychophysik , 1998 .

[54]  E. Erdfelder,et al.  Comment: Process-dissociation measurement models: Threshold theory or detection theory? , 1998 .

[55]  V F Reyna,et al.  Fuzzy-trace theory and children's false memories. , 1998, Journal of experimental child psychology.

[56]  Arthur P. Shimamura,et al.  Using Excel to estimate parameters from observed data: An example from source memory data , 1998 .

[57]  R T Knight,et al.  Recollection and familiarity deficits in amnesia: convergence of remember-know, process dissociation, and receiver operating characteristic data. , 1998, Neuropsychology.

[58]  A P Shimamura,et al.  On the recollection of specific- and partial-source information. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[59]  U. Bayen,et al.  Source monitoring deficits in patients with schizophrenia; a multinomial modelling analysis , 1999, Psychological Medicine.

[60]  L L Jacoby,et al.  Isolating the contributions of familiarity and source information to item recognition: a time course analysis. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[61]  A P Yonelinas,et al.  Recognition memory for faces: When familiarity supports associative recognition judgments , 1999, Psychonomic bulletin & review.

[62]  David M. Riefer,et al.  Theoretical and empirical review of multinomial process tree modeling , 1999, Psychonomic bulletin & review.

[63]  X Hu,et al.  Multinomial processing tree models: An implementation , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[64]  A P Yonelinas,et al.  The contribution of recollection and familiarity to recognition and source-memory judgments: a formal dual-process model and an analysis of receiver operating characteristics. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[65]  Jochen Musch,et al.  On belief bias in syllogistic reasoning. , 2000, Psychological review.

[66]  L. Ball,et al.  Working Memory, Metacognitive Uncertainty, and Belief Bias in Syllogistic Reasoning , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[67]  Caren M. Rotello,et al.  Recall processes in recognition memory , 2000 .

[68]  E. Heit,et al.  Associative Recognition: a Case of Recall-to-reject Processing , 2022 .

[69]  A P Shimamura,et al.  An analysis of signal detection and threshold models of source memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[70]  Caren M. Rotello,et al.  Recall-to-Reject in Recognition: Evidence from ROC Curves ☆ ☆☆ , 2000 .

[71]  V. Gregg,et al.  Impact of encoding depth on awareness of perceptual effects in recognition memory , 2001, Memory & cognition.

[72]  C. L. Raye,et al.  Source ROCs are (typically) curvilinear: comment on Yonelinas (1999). , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[73]  Malcolm W. Brown,et al.  Recognition memory: What are the roles of the perirhinal cortex and hippocampus? , 2001, Nature Reviews Neuroscience.

[74]  Murray Glanzer,et al.  Regularities of source recognition: ROC analysis. , 2002, Journal of experimental psychology. General.

[75]  L. T. DeCarlo Signal detection theory with finite mixture distributions: theoretical developments with applications to recognition memory. , 2002, Psychological review.

[76]  Kenneth J. Malmberg,et al.  On the form of ROCs constructed from confidence ratings. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[77]  C. Judd,et al.  The police officer's dilemma: using ethnicity to disambiguate potentially threatening individuals. , 2002, Journal of personality and social psychology.

[78]  Arndt Bröder,et al.  Memory for multidimensional source information. , 2002 .

[79]  Mieke Verfaellie,et al.  Recollection-based memory in frontotemporal dementia: implications for theories of long-term memory. , 2002, Brain : a journal of neurology.

[80]  J. McEvoy,et al.  Source-monitoring deficits for self-generated stimuli in schizophrenia: multinomial modeling of data from three sources , 2002, Schizophrenia Research.

[81]  C. Rotello,et al.  Does familiarity change in the revelation effect? , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[82]  C. A. Weaver,et al.  Processing similarity does not improve metamemory: evidence against transfer-appropriate monitoring. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[83]  Lawrence T. DeCarlo,et al.  Source monitoring and multivariate signal detection theory, with a model for selection , 2003 .

[84]  Jamie I. D. Campbell,et al.  Syllogistic reasoning time: Disconfirmation disconfirmed , 2003, Psychonomic bulletin & review.

[85]  V. Reyna,et al.  Recollection rejection: false-memory editing in children and adults. , 2003, Psychological review.

[86]  Maxwell J Roberts,et al.  Belief Bias and Relational Reasoning , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[87]  Woojae Kim,et al.  Flexibility versus generalizability in model selection , 2003, Psychonomic bulletin & review.

[88]  William M Petrusic,et al.  Judging confidence influences decision processing in comparative judgments , 2003, Psychonomic bulletin & review.

[89]  John T Wixted,et al.  In defense of the signal detection interpretation of remember/know judgments , 2004, Psychonomic bulletin & review.

[90]  Barbara L. Chalfonte,et al.  Sum-Difference Theory of Remembering and Knowing : A Two-Dimensional Signal-Detection Model By : , 2004 .

[91]  C. Rotello,et al.  ROC curves show that the revelation effect is not a single phenomenon , 2004, Psychonomic bulletin & review.

[92]  Matthew Duncan,et al.  Testing theories of recognition memory by predicting performance across paradigms. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[93]  Roger Ratcliff,et al.  Assessing model mimicry using the parametric bootstrap , 2004 .

[94]  Murray Glanzer,et al.  Six regularities of source recognition. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[95]  M. Schmitter-Edgecombe,et al.  Retrieval inhibition in directed forgetting following severe closed-head injury. , 2004, Neuropsychology.

[96]  Jonathan St. B. T. Evans,et al.  Belief Bias and Figural Bias in Syllogistic Reasoning , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[97]  J. Dunn Remember-know: a matter of confidence. , 2004, Psychological review.

[98]  Jonathan Evans,et al.  Rapid responding increases belief bias: Evidence for the dual-process theory of reasoning , 2005 .

[99]  Luiz Pessoa,et al.  Quantitative prediction of perceptual decisions during near-threshold fear detection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[100]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[101]  Caren M Rotello,et al.  Theremember response: Subject to bias, graded, and not a process-pure indicator of recollection , 2005, Psychonomic bulletin & review.

[102]  Scott D. Slotnick,et al.  Support for a continuous (single-process) model of recognition memory and source memory , 2005, Memory & cognition.

[103]  Jeffrey J Starns,et al.  Source dimensions are retrieved independently in multidimensional monitoring tasks. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[104]  Carla J. Groom,et al.  Separating multiple processes in implicit social cognition: the quad model of implicit task performance. , 2005, Journal of personality and social psychology.

[105]  Thorsten Meiser,et al.  Defocused attention in depressed mood: evidence from source monitoring. , 2005, Emotion.

[106]  Thorsten Meiser,et al.  A Hierarchy of Multinomial Models for Multidimensional Source Monitoring , 2005 .

[107]  Bennet Murdock,et al.  Decision-making models of remember-know judgments: comment on Rotello, Macmillan, and Reeder (2004). , 2006, Psychological review.

[108]  Valerie A Thompson,et al.  Confidence and accuracy in deductive reasoning , 2006, Memory & cognition.

[109]  J. Sherman AUTHORS' RESPONSES: Clearing Up Some Misconceptions About the Quad Model , 2006 .

[110]  K. C. Klauer,et al.  Hierarchical Multinomial Processing Tree Models: A Latent-Trait Approach , 2006 .

[111]  Caren M. Rotello,et al.  Interpreting the effects of response bias on remember-know judgments using signal detection and threshold models , 2006, Memory & cognition.

[112]  L. Ball,et al.  Effects of belief and logic on syllogistic reasoning: Eye-movement evidence for selective processing models. , 2006, Experimental psychology.

[113]  Colleen M. Parks,et al.  Moving beyond pure signal-detection models: comment on Wixted (2007). , 2007, Psychological review.

[114]  P. Higham,et al.  No special K! A signal detection framework for the strategic regulation of memory accuracy. , 2007, Journal of experimental psychology. General.

[115]  L. Pessoa,et al.  Neural Correlates of Perceptual Choice and Decision Making during Fear–Disgust Discrimination , 2007, The Journal of Neuroscience.

[116]  Caren M Rotello,et al.  “Remembering” emotional words is based on response bias, not recollection , 2007, Psychonomic bulletin & review.

[117]  John T Wixted,et al.  A direct test of the unequal-variance signal detection model of recognition memory , 2007, Psychonomic bulletin & review.

[118]  Arndt Bröder,et al.  Measuring source memory , 2007 .

[119]  J. Wixted Dual-process theory and signal-detection theory of recognition memory. , 2007, Psychological review.

[120]  R. Clark,et al.  Recognition memory and the medial temporal lobe: a new perspective , 2007, Nature Reviews Neuroscience.

[121]  Christoph Stahl,et al.  HMMTree: A computer program for latent-class hierarchical multinomial processing tree models , 2007, Behavior research methods.

[122]  Caren M Rotello,et al.  Toward a complete decision model of item and source recognition , 2008, Psychonomic bulletin & review.

[123]  Linden J. Ball,et al.  Belief–logic conflict resolution in syllogistic reasoning: Inspection-time evidence for a parallel-process model , 2008 .

[124]  Caren M Rotello,et al.  Analysis of RT distributions in the remember—know paradigm , 2008, Psychonomic bulletin & review.

[125]  J. Dunn The dimensionality of the remember-know task: a state-trace analysis. , 2008, Psychological review.

[126]  Ben R. Newell,et al.  Dimensions in data: testing psychological models using state-trace analysis , 2008, Trends in Cognitive Sciences.

[127]  Noelle L Brown,et al.  Source memory for unrecognized items: Predictions from multivariate signal detection theory , 2008, Memory & cognition.

[128]  K. C. Klauer,et al.  A simplified conjoint recognition paradigm for the measurement of gist and verbatim memory. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[129]  Caren M Rotello,et al.  Type I error rates and power analyses for single-point sensitivity measures , 2008, Perception & psychophysics.

[130]  Katharina N. Seidl,et al.  Response bias in "remembering" emotional stimuli: a new perspective on age differences. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[131]  J. Wixted,et al.  Testing signal-detection models of yes/no and two-alternative forced-choice recognition memory. , 2009, Journal of experimental psychology. General.

[132]  B. Hilbig,et al.  Multinomial processing tree models: A review of the literature. , 2009 .

[133]  Caren M Rotello,et al.  Sources of bias in the Goodman-Kruskal gamma coefficient measure of association: implications for studies of metacognitive processes. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[134]  Colleen M. Parks,et al.  Evidence for a memory threshold in second-choice recognition memory responses , 2009, Proceedings of the National Academy of Sciences.

[135]  A. Bröder,et al.  Recognition ROCs are curvilinear-or are they? On premature arguments against the two-high-threshold model of recognition. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[136]  Brian P. Kurilla,et al.  Source memory for unidentified stimuli. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[137]  E. Heit,et al.  Assessing the belief bias effect with ROCs: it's a response bias effect. , 2010, Psychological review.

[138]  John T Wixted,et al.  Continuous recollection versus unitized familiarity in associative recognition. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[139]  K. C. Klauer,et al.  Toward a complete decision model of item and source recognition: A discrete-state approach , 2010, Psychonomic bulletin & review.

[140]  Simon Dennis,et al.  An examination of the ERP correlates of recognition memory using state-trace analysis , 2010 .

[141]  Hao Wu,et al.  On the Minimum Description Length Complexity of Multinomial Processing Tree Models. , 2010, Journal of mathematical psychology.

[142]  Jay I. Myung,et al.  Minimum description length model selection of multinomial processing tree models , 2010, Psychonomic bulletin & review.

[143]  J. Wixted,et al.  A continuous dual-process model of remember/know judgments. , 2010, Psychological review.

[144]  W. Batchelder,et al.  Beta-MPT: Multinomial processing tree models for addressing individual differences , 2010 .

[145]  Michael S. Pratte,et al.  Separating mnemonic process from participant and item effects in the assessment of ROC asymmetries. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[146]  Michael S. Pratte,et al.  Hierarchical single- and dual-process models of recognition memory , 2011 .

[147]  J. Wixted,et al.  The diagnosticity of individual data for model selection: Comparing signal-detection models of recognition memory , 2011, Psychonomic bulletin & review.

[148]  Arndt Bröder,et al.  Correction to Bröder and Schütz (2009). , 2011 .

[149]  K. C. Klauer,et al.  Assessing the belief bias effect with ROCs: reply to Dube, Rotello, and Heit (2010). , 2011, Psychological review.

[150]  E. Heit,et al.  The belief bias effect is aptly named: a reply to Klauer and Kellen (2011). , 2011, Psychological review.

[151]  A. Bröder,et al.  Signal detection and threshold models of source memory. , 2011, Experimental psychology.

[152]  K. C. Klauer,et al.  The flexibility of models of recognition memory: An analysis by the minimum-description length principle , 2011 .

[153]  John T Wixted,et al.  The Hippocampus Supports Both Recollection and Familiarity When Memories Are Strong , 2011, The Journal of Neuroscience.

[154]  Akira R. O’Connor,et al.  Some Memories are Odder than Others: Judgments of Episodic Oddity Violate Known Decision Rules. , 2011, Journal of memory and language.

[155]  David Kellen,et al.  Evaluating models of recognition memory using first- and second-choice responses , 2011 .

[156]  C. Rotello,et al.  Binary ROCs in perception and recognition memory are curved. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[157]  Jeffrey N Rouder,et al.  Assessing the dissociability of recollection and familiarity in recognition memory. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[158]  Edgar Erdfelder,et al.  Extracting the truth from conflicting eyewitness reports: a formal modeling approach. , 2012, Journal of experimental psychology. Applied.

[159]  Jeffrey N. Rouder,et al.  Evidence for discrete-state processing in recognition memory , 2012, Proceedings of the National Academy of Sciences.

[160]  Roger Ratcliff,et al.  Beyond ROC curvature: Strength effects and response time data support continuous-evidence models of recognition memory. , 2012, Journal of memory and language.

[161]  John T Wixted,et al.  Recollection can be weak and familiarity can be strong. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[162]  Angela M. Pazzaglia,et al.  Unequal-strength source zROC slopes reflect criteria placement and not (necessarily) memory processes. , 2013, Journal of experimental psychology. Learning, memory, and cognition.