Overestimation of base-rate differences in complex perceptual categories

The optimality of multidimensional perceptual categorization performance was examined for several base-rate ratios, for both integral and separable dimension stimuli, and for complex category structures. In all cases, the optimal decision bound was highly nonlinear. Observers completed several experimental sessions, and all analyses were performed at the single-observer level using a series of nested models derived from decision-bound theory (Maddox, 1995; Maddox & Ashby, 1993). In every condition, all observers were found to be sensitive to the base-rate manipulations, but the majority of observers appeared to overestimate the base-rate difference. These findings converge with those for cases in which the optimal decision bound was linear (Maddox, 1995) and suggest that base-rates are learned in a similar fashion regardless of the complexity of the optimal decision bound. Possible explanations for the consistent overestimate of the base-rate difference are discussed. Several continuous-valued analogues of Kruschke’s (1996) theory of base-rate learning with discrete-valued stimuli were tested. These models found some support, but in all cases were outperformed by a version of decision-bound theory that assumed accurate knowledge of the category structure and an overestimate of the base-rate difference.

[1]  T. Wickens.  Models for Behavior: Stochastic Processes in Psychology , 1982 .

[2]  W. Lee,et al.  CATEGORIZING EXTERNALLY DISTRIBUTED STIMULUS SAMPLES FOR THREE CONTINUA. , 1964, Journal of experimental psychology.

[3]  Peter H. Schönemann,et al.  Similarity of rectangles , 1977 .

[4]  R. Nosofsky.  Attention and learning processes in the identification and categorization of integral stimuli. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[5]  W T Maddox,et al.  Selective attention and the formation of linear decision boundaries: comment on McKinley and Nosofsky (1996). , 1998, Journal of experimental psychology. Human perception and performance.

[6]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[7]  Corey J. Bohil,et al.  Base-rate and payoff effects in multidimensional perceptual categorization. , 1998, Journal of Experimental Psychology. Learning, Memory and Cognition.

[8]  F. Gregory Ashby,et al.  Multivariate probability distributions. , 1992 .

[9]  W. Estes.  The problem of inference from curves based on group data. , 1956, Psychological bulletin.

[10]  Maddox Wt,et al.  BASE-RATE EFFECTS IN MULTIDIMENSIONAL PERCEPTUAL CATEGORIZATION , 1995 .

[11]  R. Nosofsky,et al.  Selective attention and the formation of linear decision boundaries. , 1996, Journal of experimental psychology. Human perception and performance.

[12]  W. Geisler.  Sequential ideal-observer analysis of visual discriminations. , 1989 .

[13]  Gregory Ashby,et al.  On the Dangers of Averaging Across Subjects When Using Multidimensional Scaling or the Similarity-Choice Model , 1994 .

[14]  G. W. Snedecor.  Statistical Methods , 1964 .

[15]  R. Shepard.  Attention and the metric structure of the stimulus space. , 1964 .

[16]  J I Balla,et al.  The Use of Critical Cues and Prior Probability in Decision-Making , 1982, Methods of Information in Medicine.

[17]  Alice F. Healy,et al.  The decision rule in probabilistic categorization: What it is and how it is learned. , 1977 .

[18]  W. Casscells,et al.  Interpretation by physicians of clinical laboratory results. , 1978, The New England journal of medicine.

[19]  T. Marill.  Detection theory and psychophysics , 1956 .

[20]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[21]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[22]  W T Maddox,et al.  Comparing decision bound and exemplar models of categorization , 1993, Perception & psychophysics.

[23]  E. Weber,et al.  Determinants of diagnostic hypothesis generation: effects of information, base rates, and experience. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Estes Wk.  The problem of inference from curves based on group data. , 1956 .

[25]  D. Medin,et al.  Problem structure and the use of base-rate information from experience. , 1988, Journal of experimental psychology. General.

[26]  R. Nosofsky,et al.  Integrating information from separable psychological dimensions. , 1990, Journal of experimental psychology. Human perception and performance.

[27]  Gary L. Felfoldy.  Repetition effects in choice reaction time to multidimensional stimuli , 1974 .

[28]  W. R. Garner,et al.  The effects on speeded classification of implicit and explicit instructions regarding redundant dimensions , 1971 .

[29]  G. Gigerenzer,et al.  Cognition as Intuitive Statistics , 1987 .

[30]  F. Gregory Ashby,et al.  Chapter 4 – Stimulus Categorization , 1998 .

[31]  W. T. Maddox,et al.  Relations between prototype, exemplar, and decision bound models of categorization , 1993 .

[32]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[33]  W. Estes,et al.  Base-rate effects in category learning: a comparison of parallel network and memory storage-retrieval models. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[34]  S. Edgell,et al.  Irrelevant information and utilization of event base rates in nonmetric multiple-cue probability learning , 1980 .

[35]  R. Roe,et al.  IRRELEVANT INFORMATION IN PROBABILISTIC CATEGORIZATION , 1996 .

[36]  S. C. Masin.  Foundations of perceptual theory , 1993 .

[37]  J. Kruschke.  Base rates in category learning. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[38]  M. Kubovy,et al.  Probability matching and the formation of conservative decision rules in a numerical analog of signal detection. , 1981 .

[39]  Gerd Gigerenzer,et al.  Presentation and content: The use of base rates as a continuous variable. , 1988 .

[40]  A. Elstein,et al.  Effects of Prevalence and Test Diagnosticity upon Clinical Judgments of Probability , 1983, Methods of Information in Medicine.

[41]  F. Gregory Ashby,et al.  Toward a Unified Theory of Similarity and Recognition , 1988 .

[42]  F. Gregory Ashby,et al.  Multidimensional models of categorization. , 1992 .

[43]  Ashby Fg,et al.  Integrating information from separable psychological dimensions. , 1990 .

[44]  Thomas R. Zentall,et al.  Factorial effects in the categorization of externally distributed stimulus samples , 1966 .

[45]  Robin D. Thomas.  Gaussian general recognition theory and perceptual independence. , 1995 .

[46]  Maddox Wt,et al.  Perceptual separability, decisional separability, and the identification-speeded classification relationship. , 1996 .

[47]  W. R. Garner,et al.  Integrality of stimulus dimensions in various types of information processing , 1970 .

[48]  F. Gregory Ashby,et al.  Perceptual variability as a fundamental axiom of perceptual science , 1993 .

[49]  M. Janke,et al.  Categorizing Externally Distributed Stimulus Samples for Unequal Molar Probabilities , 1965, Psychological reports.

[50]  Michael M. Cohen,et al.  A comparison of learning models , 1995 .

[51]  T. Wallsten.  Physician and Medical Student Bias in Evaluating Diagnostic Information , 1981, Medical decision making : an international journal of the Society for Medical Decision Making.

[52]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986 .

[53]  W T Maddox,et al.  Perceptual separability, decisional separability, and the identification-speeded classification relationship. , 1996, Journal of experimental psychology. Human perception and performance.

[54]  R. Nosofsky,et al.  Predicting similarity and categorization from identification. , 1991, Journal of experimental psychology. General.

[55]  R. Nosofsky,et al.  Rules and exemplars in categorization, identification, and recognition. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[56]  W. T. Maddox,et al.  A response time theory of separability and integrality in speeded classification , 1994 .

[57]  Maddox Wt,et al.  Selective attention and the formation of linear decision boundaries: comment on McKinley and Nosofsky (1996). , 1998 .

[58]  N. Perrin,et al.  Varieties of perceptual independence. , 1986, Psychological review.

[59]  G. Gigerenzer.  On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996) , 1996 .

[60]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[61]  R. Nosofsky.  Overall similarity and the identification of separable-dimension stimuli: A choice model analysis , 1985, Perception & psychophysics.

[62]  R. Nosofsky,et al.  Combining exemplar-based category representations and connectionist learning rules. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[63]  Gregory Ashby,et al.  Decision rules in the perception and categorization of multidimensional stimuli. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[64]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[65]  D Kahneman,et al.  On the reality of cognitive illusions. , 1996, Psychological review.

[66]  S. S. Stevens.  The Psychophysics of Sensory Function. , 1960 .

[67]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[68]  D. F. Morrison,et al.  Multivariate Statistical Methods , 1968 .

[69]  Z. J. Ulehla,et al.  Optimality of perceptual decision criteria. , 1966, Journal of experimental psychology.