Knowledge engineering for industrial expert systems

Abstract The inherent difficulties involved in the process of extracting knowledge from experts are discussed and identified. Such difficulties have resulted in few expert systems progressing beyond the prototyping stage. The conflicting terminology used to describe the whole process is examined and, as a result, knowledge engineering is defined as the appropriate term for the whole process. This is then further split into knowledge acquisition and system implementation. Finally, knowledge acquisition is further subdivided into knowledge elicitation and machine induction. The particular problems associated with the construction of expert systems in industrial control applications are discussed. Such systems are characterised by the nature of their user population, the type of support provided and whether they operate on-line or off-line. The importance of defining functionality and goals at the outset is stressed. The need for user models is also highlighted. The various techniques used in knowledge elicitation—interviews, questionnaires, observations, protocol analyses, teachback interviewing, walkthroughs and formal techniques—are briefly reviewed. The alternative approach using machine induction techniques is also discussed. An examination is made of the competing approaches involving bottom-up and top-down techniques. The benefits resulting from the application of cognitive task analyses rather than technology-driven approaches are also stressed. Current knowledge acquisition tools such as KRITON, KADS, ACQUIST, KEATS and ROGET are reviewed. Examples are given of the use of time-line techniques in power plant knowledge acquisition, knowledge and task analyses in the construction of a failure management expert system and of the use of inductive techniques in gas-oil separator design and satellite power systems control. In the latter case, the use of qualitative modelling is highlighted. The possiblity of domain experts in industrial control carrying out their own knowledge engineering is examined but rejected as unlikely, unless better tools exist. The provision of better tools is identified as one of the key factors required to simplify the knowledge engineering process.

[1]  N. Lance,et al.  Processes in construction of failure management expert systems from device design information , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Leslie Johnson,et al.  Knowledge Elicitation Involving Teachback Interviewing , 1987 .

[3]  James L. Alty,et al.  Knowledge-based dialogue for dynamic systems , 1989, Autom..

[4]  Randall Davis,et al.  Expert Systems: Where Are We? And Where Do We Go from Here? , 1982, AI Mag..

[5]  Ian H. Witten,et al.  A framework for knowledge acquisition through techniques of concept learning , 1989, IEEE Trans. Syst. Man Cybern..

[6]  Joachim Diederich Knowledge-based Knowledge Elicitation , 1987, IJCAI.

[7]  Randall Davis,et al.  Reasoning from First Principles in Electronic Troubleshooting , 1983, Int. J. Man Mach. Stud..

[8]  Bob Wielinga,et al.  Use of Models in the Interpretation of Verbal Data , 1987 .

[9]  Paul R. Cohen,et al.  Design for Acquisition: Principles of Knowledge-System Design to Facilitate Knowledge Acquisition , 1987, Int. J. Man Mach. Stud..

[10]  G. A. Sundström User Modelling: A New Technique to Support Designers of Graphical Support Systems in Conventional Power Plants , 1988 .

[11]  Diana E. Forsythe,et al.  Knowledge acquisition for expert systems: some pitfalls and suggestions , 1989, IEEE Trans. Syst. Man Cybern..

[12]  M. Azad,et al.  The role of human factors in expert systems design and acceptance , 1988 .

[13]  John Fox,et al.  A Systematic Study of Knowledge Base Refinement in the Diagnosis of Leukemia , 1987 .

[14]  Mark Chignell,et al.  Strategic Issues in Knowledge Engineering , 1988 .

[15]  Tom M. Mitchell,et al.  Learning by experimentation: acquiring and refining problem-solving heuristics , 1993 .

[16]  N. Hari Narayanan,et al.  A Methodology for Knowledge Acquisition and Reasoning in Failure Analysis of Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  William B. Rouse,et al.  On capturing human skills and knowledge; algorithmic approaches to model identification , 1989, IEEE Trans. Syst. Man Cybern..

[18]  G. Johannsen,et al.  Task and knowledge analysis in coal-fired power plants , 1987, IEEE Control Systems Magazine.

[19]  T. Koi,et al.  USER-FRIENDLY EXPERT SYSTEM FOR TURBINE/GENERATOR VIBRATION DIAGNOSIS , 1989 .

[20]  Erik Hollnagel Plan recognition in modelling of users , 1988 .

[21]  G. Johannsen Categories of human operator behaviour in fault management situations , 1988 .

[22]  Ingo Ruhmann,et al.  KRITON: A Knowledge-Acquisition Tool for Expert Systems , 1987, Int. J. Man Mach. Stud..

[23]  Enrico Motta,et al.  Support for knowledge acquisition in the Knowledge Engineer's Assistant (KEATS) , 1988 .

[24]  John P. McDermott,et al.  R1 Revisited: Four Years in the Trenches , 1984, AI Mag..

[25]  Emilie M. Roth,et al.  Cognitive Task Analysis: An Approach to Knowledge Acquisition for Intelligent System Design , 1989 .

[26]  Bob J. Wielinga,et al.  Structured Analysis of Knowledge , 1987, Int. J. Man Mach. Stud..

[27]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[28]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[29]  Paul E. Lehner,et al.  Expert decision-making in evolving situations , 1989, IEEE Trans. Syst. Man Cybern..

[30]  Anna Hart,et al.  Role of Induction in Knowledge Elicitation , 1987 .

[31]  Christoph Crasemann,et al.  Der Wissens-Ingenieur - ein neuer Hut auf altem Kopf - Zur Diskussion gestellt , 1988, Inform. Spektrum.

[32]  Brian R. Gaines,et al.  Knowledge Acquisition Tools for Expert Systems , 1988 .

[33]  Gunnar Johannsen Towards a New Quality of Automation in Complex Man-machine Systems , 1990 .

[34]  Theresa M. Mullin,et al.  Experts' estimation of uncertain quantities and its implications for knowledge acquisition , 1989, IEEE Trans. Syst. Man Cybern..

[35]  William B. Rouse,et al.  On the value of information in system design: A framework for understanding and aiding designers , 1986, Inf. Process. Manag..

[36]  J A Breuker,et al.  KADS—structured knowledge acquisition for expert systems , 1987 .

[37]  Ivan Bratko,et al.  KARDIO‐E‐an expert system for electrocardiographic diagnosis of cardiac arrhythmias , 1985 .

[38]  Jeffrey M. Bradshaw,et al.  Expertise Transfer and Complex Problems: Using AQUINAS as a Knowledge-Acquisition Workbench for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[39]  R. Shirley Some lessons learned using expert systems for process control , 1987, IEEE Control Systems Magazine.