Standardising the elimination of unnecessary data from interview transcripts for the purposes of knowledge-based systems? A case study

: Although knowledge elicitation, the process of extracting knowledge from human experts to be incorporated into a knowledge-based system, has been the subject of some notable studies, less attention has been paid to the methods of analysing the raw data once it has been extracted from the expert. When knowledge elicitation sessions are interview-based, the resultant form of raw data is usually a transcript of the interviewee's utterances. This paper describes an investigation into the preliminary stage of analysing such transcripts. It outlines the development of an approach to eliminate unnecessary detail from interview transcripts, thus enabling attention to be focused upon the remaining, more relevant data via a simple technique based upon cheap and readily available technology. The paper then outlines a rapid-prototyping approach for evaluating this method, the results of which were felt to be very encouraging.

[1]  Prafulla Joglekar,et al.  The development and validation of a campus recruiting expert system using expert opinions and historical data , 1994 .

[2]  George Wright,et al.  The quality of expert probability judgement: issues and analysis , 1994 .

[3]  Z. Chen,et al.  Building expert critics for ethical issue testing , 1995 .

[4]  Kristian Sandahl.  Transferring knowledge from active expert to end-user environment , 1994 .

[5]  Franz Schmalhofer,et al.  An integration of knowledge acquisition techniques and EBL for real-world production planning , 1994 .

[6]  Ritu Agarwal,et al.  Formal validation of a knowledge-based system using a variation of the Turing test , 1993 .

[7]  Glenn G. Shephard.  Providing descriptive power to guided self-elicitation , 1993 .

[8]  Alberto M. Segre,et al.  Extending the role of bias in probabilistic theory revision , 1994 .

[9]  Ross Peter Clement,et al.  Learning Expert Systems by Being Corrected , 1992, Int. J. Man Mach. Stud..

[10]  Clyde W. Holsapple,et al.  An exploratory study of two KA methods , 1994 .

[11]  Nigel Shadbolt,et al.  Laddering: technique and tool use in knowledge acquisition , 1994 .

[12]  Norman Sadeh,et al.  MICRO-BOSS: A micro-opportunistic factory scheduler , 1993 .

[13]  Mary A. Meyer,et al.  How to apply the anthropological technique of participant observation to knowledge acquisition for expert systems , 1992, IEEE Trans. Syst. Man Cybern..

[14]  James E. McDonald,et al.  The Application of Psychological Scaling Techniques to Knowledge Elicitation for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[15]  Frank von Martial,et al.  Preparation and support of scheduling employing knowledge acquisition, planning, and rule-based decision making , 1993 .

[16]  Jean-Yves Potvin,et al.  Learning techniques for an expert vehicle dispatching system , 1995 .

[17]  Jen-Her Wu,et al.  Operator effects in the choice of certainty factor algebras: an experimental study , 1993 .

[18]  Stanley Letovsky,et al.  Cognitive processes in program comprehension , 1986, J. Syst. Softw..

[19]  Charalambos Tsatsarakis,et al.  Supporting preprocessing and postprocessing for machine learning algorithms: a workbench for ID3 , 1993 .

[20]  Jay T. Runkel,et al.  Knowledge acquisition in the small: building knowledge-acquisition tools from pieces , 1993 .

[21]  Manfred Aben,et al.  Formally specifying reusable knowledge model components , 1993 .

[22]  Nigel Shadbolt,et al.  Knowledge Elicitation Techniques in Classification Domains , 1988, ECAI.

[23]  Katharina Morik,et al.  What online machine learning can do for knowledge acquisition—a case study , 1994 .

[24]  Jong Uk Choi,et al.  A constructive synthesis approach to a knowledge-based internal control evaluation system design , 1994 .

[25]  Gheorghe Tecuci,et al.  Consistency-driven Knowledge Elicitation: Using a Learning-oriented Knowledge Representation that Su , 1993 .

[26]  Gavriel Salvendy,et al.  Fuzzy sets based knowledge systems and knowledge elicitation , 1991 .

[27]  Jacky Akoka,et al.  An expert system for feasibility assessment of product development , 1994 .

[28]  Huan Liu,et al.  Joint concept formation , 1994 .

[29]  Inderpal Bhandari,et al.  Attribute focusing: machine-assisted knowledge discovery applied to software production process control , 1993 .

[30]  Kathleen Foley Curley,et al.  The impact of knowledge and technology complexity on information systems development , 1995 .

[31]  Mark D. Grover,et al.  A Pragmatic Knowledge Acquisition Methodology , 1983, IJCAI.

[32]  Yolanda Gil,et al.  Towards method-independent knowledge acquisition , 1994 .

[33]  Nigel Shadbolt,et al.  Locating generic tasks , 1993 .

[34]  Jan Willem Spee,et al.  The semantics of K BS SF, a language for KBS design , 1994 .

[35]  Giuseppina Gini,et al.  PRODS: A shell for industrial diagnosis☆ , 1995 .

[36]  Toshiyuki Hama,et al.  Configuring problem-solving methods: a CAKE perspective , 1994 .

[37]  John McDermott,et al.  The Active Glossary: taking integration seriously , 1993 .

[38]  Lorenza Saitta,et al.  A semiautomated methodology for knowledge elicitation , 1993, IEEE Trans. Syst. Man Cybern..

[39]  Christopher A. Miller,et al.  Linked-learning for knowledge acquisition: a pilot's associate case study , 1994 .

[40]  Euiho Suh,et al.  Human resource management expert systems technology , 1994 .

[41]  Reid G. Smith,et al.  The Dipmeter Advisor System - A Case Study in Commercial Expert System Development , 1983, IJCAI.

[42]  Robert Plant,et al.  An integrated methodology for knowledge-based system development , 1994 .

[43]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[44]  Bing Liu.  Problem acquisition in scheduling domains , 1993 .

[45]  Douglas Skuce,et al.  A multi-functional knowledge management system , 1993 .

[46]  Janice C. Sipior,et al.  Multimedia as a vehicle for knowledge modeling in expert systems , 1994 .

[47]  Yves Kodratoff,et al.  Acquiring first-order knowledge about air traffic control , 1993 .

[48]  David C. Wilkins,et al.  Using apprenticeship techniques to guide constructive induction , 1994 .

[49]  Cheng-Seen Ho,et al.  A primitives-based generic approach to knowledge acquisition , 1994 .

[50]  Richard T. Gill,et al.  Conceptual Graph Analysis: Knowledge Acquisition for Instructional System Design , 1993 .

[51]  Stephen Slade,et al.  The Yale artificial intelligence project , 1987 .

[52]  K. Ford,et al.  The structure of personal construct systems and the logic of confirmation , 1991 .

[53]  W. Bruce Croft,et al.  Acquisition and support of goal-based tasks , 1993 .

[54]  Jeffrey M. Bradshaw,et al.  Knowledge acquisition techniques for group decision support , 1993 .

[55]  Trevor J. M. Bench-Capon,et al.  Domain-driven knowledge modelling for knowledge acquisition , 1994 .

[56]  Adam Mrózek,et al.  A New Method for Discovering Rules from Examples in Expert Systems , 1992, Int. J. Man Mach. Stud..

[57]  Arun Sen,et al.  MODELER: Incorporating experiences to support model formulation—A case-based planning approach , 1993 .

[58]  John Bradley,et al.  A framework for expert system implementation , 1995 .

[59]  Gabriele Di Stefano,et al.  On the representation and management of medical records in a knowledge-based system , 1993 .

[60]  Nancy J. Cooke,et al.  Eliciting Semantic Relations for Empirically Derived Networks , 1992, Int. J. Man Mach. Stud..

[61]  Uma G. Gupta.  The academic quality of AI journals and the role of AI in the MIS curriculum: Perspectives of business faculty , 1994 .

[62]  Mihai Barbuceanu,et al.  Models: toward integrated knowledge modeling environments , 1993 .

[63]  Youpeng Zong,et al.  An expert system using an exchange heuristic for the resource-constrained scheduling problem , 1993 .

[64]  Catherine Baudin,et al.  Increasing levels of assistance in refinement of knowledge-based retrieval systems , 1994 .

[65]  Margaret Welbank,et al.  An Overview of Knowledge Acquisition Methods , 1990, Interact. Comput..

[66]  Victor Lesser,et al.  The Evolution of Blackboard Control Architectures , 1992 .

[67]  Henrik Eriksson.  Models for knowledge-acquisition tool design , 1994 .

[68]  James E. Bowen,et al.  An expert system for police investigators of economic crimes , 1994 .

[69]  Nathalie Bonnardel.  Expertise transfer, knowledge elicitation, and delayed recall in a design context , 1993, Behav. Inf. Technol..

[70]  Ranjit Bose,et al.  CMS: An intelligent knowledge-based tool for organizational procedure modeling and execution , 1995 .

[71]  Nick F. Pidgeon,et al.  The Use of Grounded Theory for Conceptual Analysis in Knowledge Elicitation , 1991, Int. J. Man Mach. Stud..

[72]  Michael D. McNeese,et al.  Capturing multiple perspectives: a user-centered approach to knowledge and design acquisition , 1993 .

[73]  Sylvie Szulman,et al.  Acquisition and validation of software requirements , 1994 .

[74]  Guus Schreiber,et al.  Foundations for a methodology for medical KBS development , 1994 .

[75]  Matthew J. Liberatore,et al.  Toward a framework for developing knowledge-based decision support systems for customer satisfaction assessment: An application in new product development , 1995 .

[76]  Marc Linster,et al.  Integrating conceptual and operational modeling: a case study , 1993 .

[77]  Alok R. Chaturvedi.  FMS scheduling and control: Learning to achieve multiple goals , 1993 .

[78]  David L. Olson,et al.  The role of rules and examples in the process of knowledge acquisition in direct classification tasks , 1995 .