The importance of detailed evaluation for KBS implementation in the engineering industry

Abstract The evaluation of a knowledge based system(s) (KBS) is discussed, with particular relevance to the development of KBS intended for implementation in the engineering industry. This discussion is based on the practical experiences of the authors when evaluating a KBS for use in the conceptual design of bridges. Consequently, detailed references are made to the actual evaluation carried out and the results found. The way in which systems have previously been evaluated is also discussed. The deficiencies of these past evaluation techniques are identified and ways in which the evaluation process could be improved are suggested.