The Effects of Memory Structure on Using Rule‐Based Expert Systems for Training: A Framework and an Empirical Test*

One justification for eliciting and representing the judgment strategy of an expert in a rule-based expert system (RBES) is to facilitate knowledge transfer to individuals with less expertise. However, prior research suggests complexities and potential problems when using RBESs for training. In this paper, a conceptual framework of user learning from RBESs is presented. It is proposed that learning may be ineffective when the problem representation of the RBES is inconsistent with the user's mental representation of the task-domain knowledge. An experiment was conducted to examine the effects of consistency (inconsistency) between the problem-solving strategy of RBESs and individuals' memory structures. Groups of subjects whose memory structure either matched or did not match two RBESs' problem-solving strategies were examined using an internal control evaluation task. The results suggest that learning was facilitated only for groups with congruence between the RBES's problem-solving strategy and a subject's memory structure.

[1]  Charles R. Hildreth,et al.  Online Library Catalog Systems: An Analysis of User Errors , 1986, Int. J. Man Mach. Stud..

[2]  S. Fiske,et al.  The novice and the expert: Knowledge-based strategies in political cognition , 1983 .

[3]  Anita L. Kamouri.  Computer-Based Training: A Cognitive Framework for Evaluating Systems' Designs , 1984 .

[4]  Christine L. Borgman.  The User's Mental Model of an Information Retrieval System: An Experiment on a Prototype Online Catalog , 1986, Int. J. Man Mach. Stud..

[5]  J. Fox.  Formal and knowledge-based methods in decision technology , 1984 .

[6]  P E Johnson,et al.  What kind of expert should a system be? , 1983, The Journal of medicine and philosophy.

[7]  Daniel G. Bobrow,et al.  Expert systems: perils and promise , 1986, CACM.

[8]  Richard E. Mayer,et al.  A diagnosis of beginning programmers' misconceptions of BASIC programming statements , 1983, Commun. ACM.

[9]  Stanley B. Woll,et al.  Memory discrimination for information typical or atypical of person schemata. , 1982 .

[10]  Mandler JeanM..  A code in the node: The use of a story schema in retrieval , 1978 .

[11]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[12]  Ting-Peng Liang,et al.  META‐DESIGN CONSIDERATIONS IN DEVELOPING MODEL MANAGEMENT SYSTEMS* , 1988 .

[13]  P. Thorndyke.  Cognitive structures in comprehension and memory of narrative discourse , 1977, Cognitive Psychology.

[14]  W. Kintsch,et al.  Summarizing scrambled stories , 1977, Memory & cognition.

[15]  H. Simon,et al.  Perception in chess , 1973 .

[16]  E. Rosch,et al.  Categorization of Natural Objects , 1981 .

[17]  B. Fischhoff,et al.  Fault trees: Sensitivity of estimated failure probabilities to problem representation. , 1978 .

[18]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[19]  Barbara Hayes-Roth,et al.  The use of schemata in the acquisition and transfer of knowledge , 1979, Cognitive Psychology.

[20]  John D. Bransford,et al.  Prerequisites for the Utilization of Knowledge in the Recall of Prose Passages. , 1979 .

[21]  Ramesh Sharda,et al.  Decision support system effectiveness: a review and an empirical test , 1988 .

[22]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[23]  Albert L. Schmidt,et al.  Effects of Experience and Comprehension on Reading Time and Memory for Computer Programs , 1986, Int. J. Man Mach. Stud..

[24]  John C. Thomas,et al.  Metaphor and the Cognitive Representation of Computing Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Alison L. Kidd,et al.  Man-Machine Interface Issues in the Construction and Use of an Expert System , 1985, Int. J. Man Mach. Stud..

[26]  Gerardine DeSanctis,et al.  COMPUTER GRAPHICS AS DECISION AIDS: DIRECTIONS FOR RESEARCH* , 1984 .

[27]  Leonard Adelman.  Involving Users in the Development of Decision-Analytic Aids: The Principal Factor in Successful Implementation , 1982 .

[28]  Edward J. Joyce,et al.  Anchoring and Adjustment In Probabilistic Inference in Auditing , 1981 .

[29]  B. Adelson.  Problem solving and the development of abstract categories in programming languages , 1981, Memory & cognition.

[30]  Richard Davis.  User Error or Computer Error? Observations on a Statistics Package , 1983, Int. J. Man Mach. Stud..

[31]  CARL MARTIN ALLWOOD,et al.  Novices on the Computer: A Review of the Literature , 1986, Int. J. Man Mach. Stud..

[32]  George J. Spilich,et al.  Acquisition of domain-related information in relation to high and low domain knowledge. , 1979 .

[33]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[34]  Janice S. Aikins,et al.  Prototypical Knowledge for Expert Systems , 1983, Artif. Intell..

[35]  W. Waller,et al.  The auditor and learning from experience: Some conjectures , 1984 .

[36]  Marcia K. Johnson,et al.  Human learning and memory. , 1987, Annual review of psychology.

[37]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[38]  Theodore J. Mock,et al.  An Investigation Of Auditor Decision-Processes In The Evaluation Of Internal Controls And Audit Scope Decisions , 1983 .

[39]  Jacob G. Birnberg,et al.  The role of attention and memory in accounting decisions , 1984 .

[40]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[41]  Kirk H. Smith,et al.  Training by Exploration: Facilitating the Transfer of Procedural Knowledge Through Analogical Reasoning , 1986, Int. J. Man Mach. Stud..

[42]  Arkalgud Ramaprasad,et al.  Cognitive process as a basis for MIS and DSS design , 1987 .

[43]  Richard E. Mayer,et al.  Instructional Manipulation of Users' Mental Models for Electronic Calculators , 1984, Int. J. Man Mach. Stud..

[44]  Herbert A. Simon,et al.  Cognitive Science: The Newest Science of the Artificial , 1980, Cogn. Sci..

[45]  Mark Weiser,et al.  Programming Problem Representation in Novice and Expert Programmers , 1983, Int. J. Man Mach. Stud..

[46]  Richard E. Mayer,et al.  The Psychology of How Novices Learn Computer Programming , 1981, CSUR.

[47]  N. S. Johnson,et al.  Remembrance of things parsed: Story structure and recall , 1977, Cognitive Psychology.

[48]  D. Kieras,et al.  Representation-saving effects of prior knowledge in memory for simple technical prose , 1983, Memory & cognition.

[49]  T. K. Srull,et al.  Associative storage and retrieval processes in person memory. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[50]  Lynn Hasher,et al.  Is memory schematic , 1983 .

[51]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[52]  J. Reitman,et al.  Knowledge organization and skill differences in computer programmers , 1981, Cognitive Psychology.

[53]  Ron Weber,et al.  Some Characteristics of the Free Recall of Computer Controls by EDP Auditors , 1980 .

[54]  Sam C. Brown,et al.  Comparison of measures for the estimation of clustering in free recall. , 1971 .

[55]  James M. Royer,et al.  Facilitated Learning in Connected Discourse. , 1975 .

[56]  R M Boynton,et al.  Uniqueness of perceived hues investigated with a continuous judgmental technique. , 1966, Journal of experimental psychology.

[57]  Daniel J. Power,et al.  AN EMPIRICAL ASSESSMENT OF COMPUTER‐ASSISTED DECISION ANALYSIS* , 1986 .

[58]  John M. Carroll,et al.  Learning to use word processors: problems and prospects , 1983, TOIS.

[59]  B. Ross.  This is like that: The use of earlier problems and the separation of similarity effects. , 1987 .

[60]  Allan G. Bateson,et al.  Cognitive Processing Differences Between Novice and Expert Computer Programmers , 1987, Int. J. Man Mach. Stud..

[61]  Robert Libby,et al.  Availability And The Generation Of Hypotheses In Analytical Review , 1985 .

[62]  R. Glaser.  Education and Thinking: The Role of Knowledge. , 1984 .

[63]  F. Reif,et al.  Effects of Knowledge Organization on Task Performance , 1984 .

[64]  Yvonne Waern.  Learning computerized tasks as related to prior task knowledge , 1985 .

[65]  G. Murphy,et al.  Changes in conceptual structure with expertise: Differences between real-world experts and novices. , 1984 .

[66]  John R. Anderson,et al.  The Transfer of Text-Editing Skill , 1985, Int. J. Man Mach. Stud..

[67]  James F. Voss,et al.  Star Wars: A developmental study of expert and novice knowledge structures , 1985 .