A test of the optimal classifier’s independence assumption in perceptual categorization

Observers completed perceptual categorization tasks that included separate base-rate/payoff manipulations, corresponding simultaneous base-rate/payoff manipulations, and conflicting simultaneous base-rate/payoff manipulations. Performance (1) was closer to optimal for 2:1 than for 3:1 baserate/ payoff ratios and when base rates as opposed to payoffs were manipulated, and (2) was more in line with the predictions from the flat-maxima hypothesis than from the independence assumption of the optimal classifier in corresponding and conflicting simultaneous base-rate/payoff conditions. A hybrid model that instantiated simultaneously the flat-maxima and the competition between reward and accuracy maximization (COBRA) hypotheses was applied to the data. The hybrid model was superior to a model that incorporated the independence assumption, suggesting that violations of the independence assumption are to be expected and are well captured by the flat-maxima hypothesis without requiring any additional assumptions. The parameters indicated that observers’ reward-maximizing decision criterion rapidly approaches the optimal value and that more weight is placed on accuracy maximization in separate and corresponding simultaneous base-rate/payoff conditions than in conflicting simultaneous base-rate/payoff conditions.

[1]  R. Nosofsky,et al.  Predicting similarity and categorization from identification. , 1991, Journal of experimental psychology. General.

[2]  W. T. Maddox,et al.  A response time theory of separability and integrality in speeded classification , 1994 .

[3]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[4]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[5]  W T Maddox,et al.  On the dangers of averaging across observers when comparing decision bound models and generalized context models of categorization , 1999, Perception & psychophysics.

[6]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[7]  J. Kruschke,et al.  A model of probabilistic category learning. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Maddox Wt,et al.  Selective attention and the formation of linear decision boundaries: comment on McKinley and Nosofsky (1996). , 1998 .

[9]  N. Perrin,et al.  Varieties of perceptual independence. , 1986, Psychological review.

[10]  Jerome R. Busemeyer,et al.  Judgment and decision-making theory. , 1990 .

[11]  Ido Erev.  Signal detection by human observers: a cutoff reinforcement learning model of categorization decisions under uncertainty. , 1998 .

[12]  R. Nosofsky,et al.  Selective attention and the formation of linear decision boundaries. , 1996, Journal of experimental psychology. Human perception and performance.

[13]  R. Selten.  Evolution, learning, and economic behavior , 1991 .

[14]  Corey J. Bohil,et al.  Costs and benefits in perceptual categorization , 2000, Memory & cognition.

[15]  Gregory Ashby,et al.  On the Dangers of Averaging Across Subjects When Using Multidimensional Scaling or the Similarity-Choice Model , 1994 .

[16]  W T Maddox,et al.  On the relation between base-rate and cost-benefit learning in simulated medical diagnosis. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[17]  A. E. Dusoir,et al.  Some evidence on additive learning models , 1980 .

[18]  Thomas R. Zentall,et al.  Factorial effects in the categorization of externally distributed stimulus samples , 1966 .

[19]  Corey J. Bohil,et al.  Base-rate and payoff effects in multidimensional perceptual categorization. , 1998, Journal of Experimental Psychology. Learning, Memory and Cognition.

[20]  Ewart A. C. Thomas,et al.  Probability matching as a basis for detection and recognition decisions. , 1970 .

[21]  F. Gregory Ashby,et al.  Chapter 4 – Stimulus Categorization , 1998 .

[22]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[23]  William J. Mathis,et al.  Costs and Benefits , 2003 .

[24]  W Todd Maddox,et al.  Toward a unified theory of decision criterion learning in perceptual categorization. , 2002, Journal of the experimental analysis of behavior.

[25]  T. Marill.  Detection theory and psychophysics , 1956 .

[26]  W T Maddox,et al.  Selective attention and the formation of linear decision boundaries: comment on McKinley and Nosofsky (1996). , 1998, Journal of experimental psychology. Human perception and performance.

[27]  Gregory Ashby,et al.  Decision rules in the perception and categorization of multidimensional stimuli. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[28]  Ewart A. C. Thomas.  Criterion adjustment and probability matching , 1975 .

[29]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[30]  Corey J. Bohil,et al.  Category discriminability, base-rate, and payoff effects in perceptual categorization , 2001, Perception & psychophysics.

[31]  W T Maddox,et al.  Comparing decision bound and exemplar models of categorization , 1993, Perception & psychophysics.

[32]  Estes Wk.  The problem of inference from curves based on group data. , 1956 .

[33]  W. T. Maddox,et al.  Relations between prototype, exemplar, and decision bound models of categorization , 1993 .

[34]  Daniel Gopher,et al.  Toward a generalization of signal detection theory to N -person games: the example of two-person safety problem , 1995 .

[35]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[36]  M. Kubovy,et al.  Probability matching and the formation of conservative decision rules in a numerical analog of signal detection. , 1981 .

[37]  W. Estes.  The problem of inference from curves based on group data. , 1956, Psychological bulletin.

[38]  Jerome R. Busemeyer,et al.  An adaptive approach to human decision making: Learning theory, decision theory, and human performance. , 1992 .

[39]  T. Wickens.  Models for Behavior: Stochastic Processes in Psychology , 1982 .

[40]  W. Lee,et al.  CATEGORIZING EXTERNALLY DISTRIBUTED STIMULUS SAMPLES FOR THREE CONTINUA. , 1964, Journal of experimental psychology.

[41]  Claudia González-Vallejo,et al.  Statement Verification: A Stochastic Model of Judgment and Response. , 1994 .

[42]  W. Edwards,et al.  Costs and payoffs in perceptual research. , 1982 .

[43]  M. Kalish,et al.  Decision boundaries in one-dimensional categorization. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[44]  J. D. Smith,et al.  Prototypes in the Mist: The Early Epochs of Category Learning , 1998 .

[45]  Corey J Bohil,et al.  A theoretical framework for understanding the effects of simultaneous base-rate and payoff manipulations on decision criterion learning in perceptual categorization. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[46]  F. Gregory Ashby,et al.  Multivariate probability distributions. , 1992 .

[47]  F. Gregory Ashby,et al.  Multidimensional models of categorization. , 1992 .

[48]  M. Janke,et al.  Categorizing Externally Distributed Stimulus Samples for Unequal Molar Probabilities , 1965, Psychological reports.

[49]  A. Tversky,et al.  Causal Schemata in Judgments under Uncertainty , 1982 .

[50]  Alice F. Healy,et al.  The decision rule in probabilistic categorization: What it is and how it is learned. , 1977 .