论文信息 - Evaluating expert systems

Evaluating expert systems

: Evaluation is crucial for improving expert system design and performance. This paper stresses the need for considering system evaluation throughout the development process. It highlights the importance of evaluating system usability and discusses key usability issues. A number of basic evaluation methods are described, including interviews, questionnaires, observation, system logging, user diaries, laboratory experiments and field trials. Finally, the paper looks at evaluating systems within organisations, and assessing other long term effects of expert systems.

Dianne C. Berry | Anna Hart

[1] Jeremy Wyatt,et al. The evaluation of clinical decision support systems: a discussion of the methodology used in the ACORN project , 1987 .

[2] P E Johnson,et al. What kind of expert should a system be? , 1983, The Journal of medicine and philosophy.

[3] John P. McDermott,et al. R1: The Formative Years , 1981, AI Mag..

[4] Dianne C. Berry,et al. The problem of implicit knowledge , 1987 .

[5] D. Broadbent,et al. Explanation and Verbalization in a Computer-Assisted Search Task , 1987 .

[6] Enid Mumford,et al. Defining System Requirements to Meet Business Needs: A Case Study Example , 1985, Comput. J..

[7] Ching Y. Suen,et al. Verifying, validating, and measuring the performance of expert systems , 1990 .

[8] M Stefanelli,et al. A performance evaluation of the expert system ANEMIA. , 1988, Computers and biomedical research, an international journal.

[9] Dianne C. Berry,et al. Expert systems and the man–machine interface , 1986 .

[10] Elizabeth F Loftus,et al. Leading questions and the eyewitness report , 1975, Cognitive Psychology.

[11] Dianne C. Berry,et al. Expert systems and the man‐machine interface. Part Two: The user interface. , 1987 .

[12] Anne Morris,et al. Expert systems in the United Kingdom: an evaluation of development methodologies , 1989 .

[13] D. Norman. Categorization of action slips. , 1981 .

[14] Jay Liebowitz,et al. Useful approach for evaluating expert systems , 1986 .