Structural knowledge assessment: comparison of referent structures

Network representations of student knowledge are usually evaluated by comparing them to an expert «referent» structure. This study compared referent structures produced by the instructor, other experts, averaged experts, and an average based on the best students in the class. The referents were compared in their ability to predict exam performance in 2 college level computer programming courses and to differentiate among levels of expertise. Results showed that in terms of these criteria, (a) instructor-based referents were no better than other experts; (b) there was substantial variability among experts; and (c) structures derived from both averaged experts and averaged best students provided valid referents, but the expert-based referent was superior

[1]  Thomas J. Shuell,et al.  Phases of Meaningful Learning , 1990 .

[2]  G. Diekhoff.  Testing Through Relationship Judgments. , 1983 .

[3]  R. Sternberg.  Advances in the psychology of human intelligence , 1982 .

[4]  D. Herrmann,et al.  Problem perception and knowledge structure in expert and novice mathematical problem solvers. , 1982 .

[5]  Mary Patricia Thro.  Relationships between Associative and Content Structure of Physics Concepts. , 1978 .

[6]  R. Shavelson.  Some Aspects of the Correspondence between Content Structure and Cognitive Structure in Physics Instruction. , 1972 .

[7]  M. Chi,et al.  The Nature of Expertise , 1988 .

[8]  S. C. Johnson.  Hierarchical clustering schemes , 1967, Psychometrika.

[9]  Peder J. Johnson,et al.  Assessing Structural Knowledge. , 1991 .

[10]  R. Shavelson.  Methods for examining representations of A subject-matter structure in a student's memory , 1974 .

[11]  Richard M. Fenker,et al.  The organization of conceptual materials: A methodology for measuring ideal and actual cognitive structures , 1975 .

[12]  Robert J. Sternberg,et al.  Domain-Generality versus Domain-Specificity: The Life and Impending Death of a False Dichotomy. , 1989 .

[13]  Francis T. Durso,et al.  Network Structures in Proximity Data , 1989 .

[14]  J. Novak,et al.  Educational Psychology: A Cognitive View , 1969 .

[15]  Michelene T. H. Chi,et al.  Expertise in Problem Solving. , 1981 .

[16]  S. Paul.  Estimation of and testing significance for a common correlation coefficient , 1988 .

[17]  T. Goldsmith,et al.  Assessing structural similarity of graphs , 1990 .

[18]  D. Dansereau,et al.  A Convergent Paradigm for Examining Knowledge Mapping as a Learning Strategy , 1991 .

[19]  Robert F. Stanners,et al.  The Assessment and Modification of Concept Interrelationships , 1983 .

[20]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[21]  David H. Jonassen,et al.  Designing structured hypertext and structuring access to hypertext , 1988 .

[22]  G. Bower,et al.  Human Associative Memory , 1973 .

[23]  Francis T. Durso,et al.  Recall and Measures of Memory Organization , 1986 .

[24]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .