Plausible measurement analogies to some psychometric models of test performance.

Psychometricians hypothesize that cognitive abilities such as reading, writing and spelling are measurable. However, they prefer to model item response probabilities than to study the internal structure of cognitive attributes. The theory of conjoint measurement, via its unique capacity to detect the quantitative structure of non-extensive attributes, can be used for the latter purpose. It is shown that conjoint systems analogous to the numerical composition rules advanced by the Rasch, many facet Rasch and two-parameter logistic models can be formulated using well-established axioms, representation theorems and proofs. Examples using empirical and synthetic data are presented. It was concluded that the lack of descriptive, behavioural theory remains the biggest obstacle to the scientific measurement of cognitive abilities.

[1]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[2]  R. Angier,et al.  The structure and synthesis of the liver L. casei factor. , 1946, Science.

[3]  G. Goude,et al.  On fundamental measurement in psychology , 1962 .

[4]  R. Luce,et al.  Simultaneous conjoint measurement: A new type of fundamental measurement , 1964 .

[5]  D. Scott Measurement structures and linear inequalities , 1964 .

[6]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[7]  R. Luce Sufficient Conditions for the Existence of a Finitely Additive Probability Measure , 1967 .

[8]  A. Tversky,et al.  Conjoint-measurement analysis of composition rules in psychology. , 1971 .

[9]  J. Falmagne Random Conjoint Measurement and Loudness Summation. , 1976 .

[10]  Hubert E. Brogden,et al.  The rasch model, the law of comparative judgment and additive conjoint measurement , 1977 .

[11]  G. Rasch,et al.  On Specific Objectivity. An Attempt at Formalizing the Request for Generality and Validity of Scientific Statements in Symposium on Scientific Objectivity, Vedbaek, Mau 14-16, 1976. , 1977 .

[12]  G. McClelland A note on Arbuckle and Larimer, “the number of two-way tables satisfying certain additivity axioms” , 1977 .

[13]  Howard Wainer,et al.  The Rasch Model as Additive Conjoint Measurement , 1979 .

[14]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[15]  T. Nygren Limitations of Additive Conjoint Scaling Procedures: Detecting Nonadditivity When Additivity Is Known to Be Violated , 1980 .

[16]  Louis Narens,et al.  On qualitative axiomatizations for probability theory , 1980, J. Philos. Log..

[17]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[18]  Louis Narens,et al.  On the scales of measurement , 1981 .

[19]  G Gigerenzer,et al.  Are there limits to binaural additivity of loudness? , 1983, Journal of experimental psychology. Human perception and performance.

[20]  A. Jackson Stenner,et al.  TOWARD A THEORY OF CONSTRUCT DEFINITION , 1983 .

[21]  Paul Jansen,et al.  A New Derivation of the Rasch Model , 1984 .

[22]  G. McClelland,et al.  Scaling Distortion in Numerical Conjoint Measurement , 1984 .

[23]  Robert J. Mislevy,et al.  Chapter 6: Recent Developments in Item Response Theory with Implications for Teacher Certification , 1987 .

[24]  Robert J. Mislevy,et al.  Recent Developments in Item Response Theory with Implications for Teacher Certification , 1987 .

[25]  David Andrich,et al.  Rasch Models For Measurement , 1988 .

[26]  D. Grayson,et al.  Two-group classification in latent trait theory: Scores with monotone likelihood ratio , 1988 .

[27]  Joel Mitchell,et al.  Some problems in testing the double cancellation condition in conjoint measurement , 1988 .

[28]  Richard M. Smith The Distributional Properties of Rasch Standardized Residuals , 1988 .

[29]  Ronald E. Wilson,et al.  CPCJM: A Set of Programs for Checking Polynomial Conjoint Measurement and Additivity Aximos of Three-Dimensional Matrices , 1990 .

[30]  Richard M. Smith The Distributional Properties of Rasch Item Fit Statistics , 1991 .

[31]  P. Suppes,et al.  The definability of the qualitative independence of events in terms of extended indicator functions , 1994 .

[32]  Louis Narens,et al.  Fifteen Problems Concerning the Representational Theory of Measurement , 1994 .

[33]  Rob J Hyndman,et al.  Sample Quantiles in Statistical Packages , 1996 .

[34]  R. Duncan Luce,et al.  Several unresolved conceptual problems of mathematical psychology , 1997 .

[35]  H. Scheiblechner Additive conjoint isotonic probabilistic models (ADISOP) , 1999 .

[36]  M. García-Pérez,et al.  Fitting Logistic IRT Models: Small Wonder , 1999, The Spanish Journal of Psychology.

[37]  Clark,et al.  The Measurement of Qualitative Probability. , 2000, Journal of mathematical psychology.

[38]  G Karabatsos A critique of Rasch residual fit statistics. , 2000, Journal of applied measurement.

[39]  G. Karabatsos,et al.  The Rasch model, additive conjoint measurement, and new models of probabilistic measurement theory. , 2001, Journal of applied measurement.

[40]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[41]  George Karabatsos,et al.  Enumerating and testing conjoint measurement models , 2002, Mathematical Social Sciences.

[42]  R. Luce,et al.  Measurement analogies: comparisons of behavioral and physical measures* , 2004 .

[43]  A Jackson Stenner,et al.  How accurate are lexile text measures? , 2006, Journal of applied measurement.

[44]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[45]  Attitudes, order and quantity: deterministic and direct probabilistic tests of unidimensional unfolding. , 2007, Journal of applied measurement.

[46]  The Benefits and Limitations of Formality , 2008 .

[47]  Andrew Kyngdon,et al.  The Rasch Model from the Perspective of the Representational Theory of Measurement , 2008 .

[48]  On quantity calculus and units of measurement , 2008 .

[49]  David Andrich,et al.  Understanding the unit in the Rasch model. , 2008, Journal of applied measurement.

[50]  C. T. Ng,et al.  Utility of gambling under p(olynomial)-additive joint receipt and segregation or duplex decomposition , 2009 .

[51]  J. Michell The psychometricians' fallacy: too clever by half? , 2009, The British journal of mathematical and statistical psychology.

[52]  C. Davis-Stober Analysis of multinomial models under inequality constraints: Applications to measurement theory , 2009 .