An Evaluation of the Validity of Correlational Research Conducted in Organizations

Much of the research conducted in organizational settings uses correlational techniques to infer associations among variables of interest. This paper reviews some of the problems with this type of research and develops a checklist for judging the validity of the research methods and designs employed. A sample of published correlational studies is evaluated, using the checklist. In many cases these studies were found to have serious design problems. Potential remedies and responses to these problems are discussed.

[1]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[2]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[3]  L. Cronbach.  The two disciplines of scientific psychology. , 1957 .

[4]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[5]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[6]  John E. Hunter,et al.  Development of a general solution to the problem of validity generalization. , 1977 .

[7]  Marvin D. Dunnette,et al.  The Handbook of Industrial and Organizational Psychology. , 1978 .

[8]  B. Maher.  A reader's, writer's, and reviewer's guide to assessing research reports in clinical psychology. , 1978, Journal of consulting and clinical psychology.

[9]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[10]  James G. Hunt,et al.  Leadership: The Cutting Edge. , 1979 .

[11]  R. L. Dipboye,et al.  Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory? , 1979 .

[12]  H. G. Osburn,et al.  Development and test of a new model for validity generalization. , 1980 .

[13]  E. P. Willems,et al.  The external validity of papers on external validity. , 1980 .

[14]  Joseph E. McGrath,et al.  Dilemmatics: The Study of Research Choices and Dilemmas , 1981 .

[15]  R. Guion,et al.  A note on concurrent and predictive validity designs: A critical reanalysis. , 1982 .

[16]  Robert J. House,et al.  Judgment calls in research , 1982 .

[17]  Fritz Drasgow,et al.  Psychometric and substantive issues in scale construction and validation , 1982 .

[18]  Henry L. Tosi.  What to Study: Generating and Developing Research Questions , 1982 .

[19]  L. Berkowitz,et al.  External validity is more than skin deep: Some answers to criticisms of laboratory experiments. , 1982 .

[20]  C. Schriesheim.  Causal Analysis: Assumptions, Models, and Data , 1982 .

[21]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[22]  David Brinberg,et al.  Forms of validity in research , 1982 .

[23]  M. Wittrock.  Handbook of research on teaching , 1986 .