Does aggregation produce spuriously high estimates of behavior stability?

A number of arguments as to why aggregation produces spurious correlations are considered and shown to be specious. A series of computer-simulated studies, claimed by H. D. Day and his colleagues to demonstrate that aggregation produces artifactually high stability coefficients, was shown to involve bizarre distributions and inappropriate conclusions. Nevertheless, their data actually indicated the potency of aggregation in detecting whatever empirical relations they built into their data. This was not true of their analyses of their unaggregated data, which, as a result of a high level of noise of measurement, failed to enable them to detect anomalies in their data. No amount of aggregation produced evidence of stability in its absence. It is concluded that aggregation provides a powerful tool for reducing error of measurement and for establishing and enhancing generality as well as stability in measurement. Although there is nothing intrinsic in aggregation that fosters spurious correlations, it like any other technique can be used wisely or foolishly. In order to achieve the former, aggregation must be guided by psychometric principles and theoretical considerations. A procedure guaranteed to achieve the latter is to simply aggregate whatever can be assigned a common label.

[1]  Bert F. Green,et al.  In defense of measurement. , 1978 .

[2]  J. Stroop Is the judgment of the group better than that of the average member of the group , 1932 .

[3]  Robert A. Zucker,et al.  Personality and the Prediction of Behavior , 1984 .

[4]  J. P. Rushton,et al.  Behavioral Development and Construct Validity: The Principle of Aggregation , 1983 .

[5]  B. Hamilton,et al.  Some cautionary notes regarding the use of aggregated scores as a measure of behavioral stability , 1983 .

[6]  J. Cheek Aggregation, moderator variables, and the validity of personality tests: A peer-rating study. , 1982 .

[7]  S. Epstein Explorations in personality today and tomorrow: A tribute to Henry A. Murray , 1979 .

[8]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[9]  D. Magnusson,et al.  Personality at the crossroads : current issues in interactional psychology , 1977 .

[10]  S. Paunonen The reliability of aggregated measurements: Lessons to be learned from psychometric theory , 1984 .

[11]  Seymour Epstein,et al.  Aggregation and beyond: Some basic issues on the prediction of behavior. , 1983, Journal of personality.

[12]  Douglas N. Jackson,et al.  Construct validity and the predictability of behavior. , 1985 .

[13]  B. P. Allen,et al.  Just as arbitrary as ever: Comments on Zuckerman's rejoinder. , 1983 .

[14]  B. P. Allen,et al.  Variability of self-description on a day-to-day basis: longitudinal use of the adjective generation technique. , 1973, Journal of personality.

[15]  D. Schroeder,et al.  The adjective generation technique: consistency of self-description in psychiatric patients. , 1983, Journal of personality.

[16]  S. Epstein A research paradigm for the study of personality and emotions. , 1983, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[17]  N. Endler,et al.  Interactionism: a personality model, but not yet a theory. , 1983, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[18]  Seymour Epstein,et al.  The stability of behavior: II. Implications for psychological research. , 1980 .

[19]  K. Gordon,et al.  Group judgments in the field of lifted weights. , 1924 .

[20]  James T. Lamiell,et al.  Toward an idiothetic psychology of personality. , 1981 .

[21]  W. Eaton,et al.  Measuring Activity Level with Actometers: Reliability, Validity, and Arm Length. , 1983 .

[22]  James J. Conley Relation of temporal stability and cross-situational consistency in personality: comment on the Mischel-Epstein debate. , 1984, Psychological review.

[23]  W. Mischel,et al.  Beyond déjà vu in the search for cross-situational consistency. , 1982 .

[24]  D. Moskowitz,et al.  Validity comparison of behavior counts and ratings by knowledgeable informants. , 1982 .

[25]  S. Epstein The stability of confusion: A reply to Mischel and Peake. , 1983 .

[26]  D. Bem Predicting more of the people more of the time: some thoughts on the Allen-Potkay studies of intraindividual variability. , 1977, Journal of personality.

[27]  Seymour Epstein,et al.  The stability of behavior: I. On predicting most of the people much of the time. , 1979 .