Too Many Questions? The Uses of Incomplete Cyclic Designs for Paired Comparisons

The author describes a method for constructing incomplete designs for paired comparisons data, using cyclic designs that place each item in the same number of pairings. He tests the reliability of the method using judged similarity data on twenty-one animal names and finds that designs that use 30% of the data have an acceptable level of reliability. The method has great potential value in field research as a means of reducing the number of questions required.

[1]  S. Nerlove,et al.  Balanced designs for triads tests: Two examples from English , 1976 .

[2]  D. Treiman.  Occupational Prestige in Comparative Perspective , 1977 .

[3]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[4]  Ernest J. McCormick,et al.  Paired comparison ratings: 2. The reliability of ratings based on partial pairings. , 1952 .

[5]  P. Moran.  On the method of paired comparisons. , 1947, Biometrika.

[6]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS , 1952 .

[7]  I. Spence,et al.  Single subject incomplete designs for nonmetric multidimensional scaling , 1974 .

[8]  Roger R. Davidson,et al.  A Bibliography on the Method of Paired Comparisons , 1973 .

[9]  R. A. Bradley,et al.  Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , 1952 .

[10]  Peter W. M. John,et al.  Incomplete Block Designs. , 1982 .

[11]  Suzanne Winsberg,et al.  Metric scaling correspondence analysis , 1992 .

[12]  A. Romney,et al.  Metric Scaling: Correspondence Analysis , 1990 .

[13]  Michael L. Burton,et al.  Constructing a Scale of Female Contributions to Agriculture: Methods for Imputing Missing Data , 1996 .

[14]  H. Gulliksen.  A least squares solution for paired comparisons with incomplete data , 1956 .

[15]  Ernest J. McCormick,et al.  Paired comparison ratings. I. The effect of ratings of reductions in the number of pairs. , 1952 .

[16]  C. Behrens.  Shipibo Food Categorization and Preference: Relationships Between Indigenous and Western Dietary Concepts , 1986 .

[17]  A K Romney,et al.  Statistical methods for characterizing similarities and differences between semantic structures. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[19]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[20]  J A John,et al.  Cyclic Designs , 1987 .

[21]  L. Thurstone.  The method of paired comparisons for social values , 1927 .