Knowledge-refinement is a central problem in the field of expert systems. For rule-based systems, refinement implies the addition, deletion and modification of rules in the system so as to improve the system''s overall performance. The goal of this research effort is to understand the methodology for refining large rule-based systems, as well as to develop tools that will be useful in refining such systems. The vehicle for our investigation is Spam, a production system (rule-based system) for the interpretation of aerial imagery. Complex and compute-intensive systems like Spam impose some unique constraints on knowledge refinement. More specifically, the credit/blame assignment problem for locating pieces of knowledge to refine becomes difficult. Given that constraint, we approach the problem in a bottom-up fashion, i.e., begin by refining portions of Spam''s knowledge base, and then attempt to understand the interactions between them. We begin by identifying gaps and/or faults in the knowledge base by comparing spam''s intermediate output to that of an expert, then modifying the knowledge base so that the system''s output more accurately matches the expert''s output. While this approach leads to some improvements, it also raises some interesting issues concerning the evaluation of refined knowledge at intermediate levels and of interaction between the refinements. This paper presents our initial efforts toward addressing these issues.
[1]
J. McDermott,et al.
Rule-Based Interpretation of Aerial Imagery
,
1984,
IEEE Transactions on Pattern Analysis and Machine Intelligence.
[2]
Edward H. Shortliffe,et al.
Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence)
,
1984
.
[3]
Allen Newell,et al.
Parallel OPS5 User's Manual
,
1988
.
[4]
Derek H. Sleeman,et al.
The Flexibility of Speculative Refinement
,
1991,
ML.
[5]
Bruce G. Buchanan,et al.
The MYCIN Experiments of the Stanford Heuristic Programming Project
,
1985
.
[6]
Sholom M. Weiss,et al.
Using Empirical Analysis to Refine Expert System Knowledge Bases
,
1984,
Artif. Intell..
[7]
Sholom M. Weiss,et al.
Automatic Knowledge Base Refinement for Classification Systems
,
1988,
Artif. Intell..
[8]
David M. McKeown,et al.
Automating Knowledge Acquisition For Aerial Image Interpretation
,
1987,
Photonics West - Lasers and Applications in Science and Engineering.
[9]
R. Cooke.
Experts in Uncertainty: Opinion and Subjective Probability in Science
,
1991
.