Generalizing over conditions by combining the multitrait-multimethod matrix and the representative design of experiments.

Abstract : Analytical methods should be substituted for the current largely intuitive methods for generalizing results over conditions. Toward that end we present a methodology that combines Campbell and Fiske's (1959) multitrait multimethod matrix and Brunswik's (1956) representative design of experiments. A description of a study of expert judgement and a critique of current practices illustrate the methodology. Keywords: Multitrait multimethod; Representative design; Expert judgement; Generalization; Methodology.

[1]  R. Carnap,et al.  INTERNATIONAL ENCYCLOPEDIA OF UNIFIED SCIENCE. , 1939, Science.

[2]  E. Brunswik.  Organismic achievement and environmental probability. , 1943 .

[3]  E. Brunswik,et al.  The Conceptual Framework of Psychology , 1954 .

[4]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[5]  E. Brunswik.  Perception and the Representative Design of Psychological Experiments , 1957 .

[6]  Herbert Feigl,et al.  The Mental and the Physical: The Essay and a Postscript , 1967 .

[7]  Michael Scriven,et al.  Concepts, Theories, and the Mind-Body Problem , 1959 .

[8]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[9]  Koch Sigmund Ed,et al.  Psychology: A Study of A Science , 1962 .

[10]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[11]  E. Brunswik,et al.  The psychology of Egon Brunswik , 1966 .

[12]  P. Wiener,et al.  The Encyclopedia of Philosophy. , 1968 .

[13]  Michael I. Posner,et al.  Abstraction and The Process of Recognition , 1970 .

[14]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[15]  D. Mcclelland.  Testing for competence rather than for "intelligence". , 1973, The American psychologist.

[16]  John R. Anderson,et al.  Verbatim and Propositional Representation of Sentences in Immediate and Long-Term Memory. , 1974 .

[17]  J. Jenkins.  Remember that old theory of memory? Well, forget it. , 1974 .

[18]  L. Cronbach.  Beyond the Two Disciplines of Scientific Psychology. , 1975 .

[19]  A. Greenwald.  Significance, nonsignificance, and interpretation of an ESP experiment , 1975 .

[20]  A. Greenwald.  Within-subjects designs: To use or not to use? , 1976 .

[21]  Bryan W. Coyle,et al.  A Review And Critique Of Analyses Of Multitrait-Multimethod Matrices. , 1977, Multivariate behavioral research.

[22]  A. Tversky.  Features of Similarity , 1977 .

[23]  Neal Schmitt,et al.  Path Analysis of Multitrait-Multimethod Matrices , 1978 .

[24]  P. Meehl.  Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. , 1978 .

[25]  F. Craik,et al.  Levels of Processing in Human Memory , 1979 .

[26]  Seymour Epstein,et al.  The stability of behavior: I. On predicting most of the people much of the time. , 1979 .

[27]  D. A. Kenny,et al.  Correlation and causality , 1979 .

[28]  H. Simon,et al.  Models of Thought , 1979 .

[29]  K. R. Hammond,et al.  Realizations of Brunswik's representative design , 1980 .

[30]  John R. Anderson.  Cognitive Psychology and Its Implications , 1980 .

[31]  Seymour Epstein,et al.  The stability of behavior: II. Implications for psychological research. , 1980 .

[32]  N. Pennington,et al.  Human judgment and decision making: Theories, methods, and procedures , 1980 .

[33]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[34]  Donald T. Campbell,et al.  Scientific inquiry and the social sciences , 1981 .

[35]  A. Tversky,et al.  Similarity, separability, and the triangle inequality. , 1982, Psychological review.

[36]  David Brinberg,et al.  Forms of validity in research , 1982 .

[37]  Herbert W. Marsh,et al.  Confirmatory Factor Analysis of Multitrait Multimethod Matrices. , 1983 .

[38]  Robert M. Hamm,et al.  The Relative Efficacy of Intuitive and Analytical Cognition: A Second Direct Comparison , 1984 .

[39]  Jiing-Lih Farh,et al.  ASSESSING ENVIRONMENTAL SCANNING AT THE SUBUNIT LEVEL: A MULTITRAIT‐MULTIMETHOD ANALYSIS* , 1984 .

[40]  Gerardo R. Ungson,et al.  Decision Making: An Interdisciplinary Inquiry. , 1984 .

[41]  A. Tversky,et al.  Weighting common and distinctive features in perceptual and conceptual judgments , 1984, Cognitive Psychology.

[42]  Achieving Generality over Conditions: Combining the Multitrait Multimethod Matrix and the Representative Design of Experiments. , 1984 .

[43]  G. Pitz,et al.  Judgment and decision: theory and application. , 1984, Annual review of psychology.

[44]  K. Widaman.  Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data , 1985 .

[45]  Ronald C. Serlin,et al.  Rationality in psychological research: The good-enough principle. , 1985 .

[46]  Lawrence A. Pervin,et al.  Personality: Current Controversies, Issues, and Directions , 1985 .

[47]  B. Farell,et al.  Same-different judgments: a review of current controversies in perceptual comparisons. , 1985, Psychological bulletin.

[48]  John R. Anderson.  Cognitive psychology and its implications, 2nd ed. , 1985 .

[49]  R. Hastie,et al.  The relationship between memory and judgment depends on whether the judgment task is memory-based or on-line , 1986 .