Assessing Knowledge Structures: Relations With Experience and Posttraining Performance

This research focuses on the construct validity of two methodologies for assessing cognitive organization or knowledge structures. Validity evidence is evaluated by considering the complex interrelations among experience, knowledge structures, and training outcomes. These relations are explored in the context of a laboratory-based, computer-related training initiative. In this article, results are presented that suggest that certain types of prior experience and some indicators of knowledge structures have significant relations with posttraining performance. However, the validity evi- dence gathered in this study does not support the notion that the two knowledge struc- ture assessment methods used are capturing equivalent aspects of knowledge. Moreover, context effects are indicated such that the relations among knowledge structures, experience, and training outcomes vary as a function of the set of concepts used in structural assessment. General implications for research on training, knowl- edge acquisi...

[1]  Jon M. Werner,et al.  Computer training through behavior modeling, self-paced, and instructional approaches : A field experiment , 1996 .

[2]  D. King.  Similar as well as dissimilar contextual stimuli increase rated similarity , 1988, Memory & cognition.

[3]  Roger W. Schvaneveldt,et al.  Measuring the Structure of Expertise , 1985, Int. J. Man Mach. Stud..

[4]  R. Glaser,et al.  Learning Theory and the Study of Instruction , 1989 .

[5]  R. Shavelson.  Methods for examining representations of A subject-matter structure in a student's memory , 1974 .

[6]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[7]  Joan R. Rentsch,et al.  What You Know is What You Get from Experience , 1994 .

[8]  L. E. Klopfer,et al.  Multitechnique-Multimethod Matrix Methodology for Construct Validation and its Application for the Construct of Cognitive Structure , 1992 .

[9]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[10]  Harold F. O'Neil,et al.  Instructional strategies to help learners build relevant mental models in inferential statistics , 1992 .

[11]  R. Glaser,et al.  Knowledge-based cognition and performance assessment in the science classroom , 1996 .

[12]  P. Preece,et al.  Mapping Cognitive Structure: A Comparison of Methods. , 1976 .

[13]  J. Reitman,et al.  Knowledge organization and skill differences in computer programmers , 1981, Cognitive Psychology.

[14]  Nancy J. Cooke,et al.  Effects of Computer Programming Experience on Network Representations of Abstract Programming Concepts , 1988, Int. J. Man Mach. Stud..

[15]  Richard C. Anderson.  The notion of schemata and the educational enterprise , 1977 .

[16]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[17]  D. Ausubel.  The psychology of meaningful verbal learning : an introduction to school learning / David P. Ausubel , 1963 .

[18]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[19]  James E. McDonald,et al.  The Application of Psychological Scaling Techniques to Knowledge Elicitation for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[20]  S. Brodt,et al.  When is a “KO” OK? Capitalizing on existing knowledge structures to facilitate pre-training transfer , 1994 .

[21]  Bela H. Banathy.  Cognitive mapping of educational systems for future generations , 1991 .

[22]  Francis T. Durso,et al.  Graphs in the social and psychological sciences: empirical contributions of pathfinder , 1990 .

[23]  Valerie J. Shute,et al.  Practice Effects on Skill Acquisition, Learning Outcome, Retention, and Sensitivity to Relearning , 1995, Hum. Factors.

[24]  Mark S. Teachout,et al.  THE RELATIONSHIP BETWEEN WORK EXPERIENCE AND JOB PERFORMANCE: A CONCEPTUAL AND META‐ANALYTIC REVIEW , 1995 .

[25]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[26]  Nancy J. Cooke,et al.  Toward an on-line knowledge assessment methodology: Building on the relationship between knowing and doing , 1996 .

[27]  Eduardo Salas,et al.  Measuring Knowledge Organization as a Method for Assessing Learning during Training , 1995, Hum. Factors.

[28]  A. Tversky.  Features of Similarity , 1977 .