Comparing repertory grids to integrate knowledge from multiple statisticians

Abstract When acquiring knowledge from multiple experts, one has to be aware of the fact that differences of opinion among them may exist. A procedure has been devised that allows for a structured comparison of ideas of multiple experts. Perceived similarities and dissimilarities between statistical analysis methods have been elicited using a card-sorting technique based on the Repertory Grid. Both the elements to be judged and the constructs generated could be chosen freely by each individual expert. Grids were compared by transforming them through principal components analyses into configurations. These configurations have been matched using Procrustes analysis and dimension weighting. This analysis procedure uncovers systematic differences in perceptions, that would otherwise have gone unnoticed.

[1]  Brian R. Gaines,et al.  An Interactive Knowledge-Elicitation Technique Using Personal Construct Technology , 1987 .

[2]  Van den Berg,et al.  Choosing an analysis method : an empirical study of statisticians' ideas in view of the design of computerized support , 1994 .

[3]  R. Sternberg.  Implicit Theories: An Alternative to Modeling Cognition and Its Development , 1987 .

[4]  Brian R. Gaines,et al.  Comparing conceptual structures: consensus, conflict, correspondence and contrast , 1989 .

[5]  John H. Boose,et al.  Rapid Acquisition and Combination of Knowledge from Multiple Experts in the Same Domain , 1985, Conference on Artificial Intelligence Applications.

[6]  Bo Göranzon.  The practice of the use of computers. A paradoxical encounter between different traditions of knowledge , 1988 .

[7]  Ingwer Borg,et al.  A direct approach to individual differences scaling using increasingly complex transformations , 1978 .

[8]  Mildred L. G. Shaw,et al.  Validation in a Knowledge Support System: Construing and Consistency with Multiple Experts , 1988, Int. J. Man Mach. Stud..

[9]  G. Kelly.  The Psychology of Personal Constructs , 2020 .

[10]  Nigel Shadbolt,et al.  The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise , 1990 .

[11]  John G. Gammack.  Different Techniques and Different Aspects on Declarative Knowledge , 1987 .

[12]  W. Heiser,et al.  Implicit Personality Theory and Social Judgment: Effects of Familiarity with a Target Person. , 1991, Multivariate behavioral research.

[13]  James E. McDonald,et al.  The Application of Psychological Scaling Techniques to Knowledge Elicitation for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[14]  Roger N. Shepard,et al.  Multidimensional scaling : theory and applications in the behavioral sciences , 1974 .

[15]  J. Gower.  Generalized procrustes analysis , 1975 .

[16]  Gerda M. van den Berg.  Ideas of statistical experts on the choice of an analysis method , 1991 .

[17]  Bob Wielinga,et al.  Models of Expertise in Knowledge Acquisition , 1989 .

[18]  D. Hand.  Statistical expert systems: design , 1984 .

[19]  John H. Boose,et al.  Uses of Repertory Grid-Centred Knowledge Acquisition Tools for Knowledge-Based Systems , 1988, Int. J. Man Mach. Stud..