Conceptual knowledge acquisition in biomedicine: A methodological review

The use of conceptual knowledge collections or structures within the biomedical domain is pervasive, spanning a variety of applications including controlled terminologies, semantic networks, ontologies, and database schemas. A number of theoretical constructs and practical methods or techniques support the development and evaluation of conceptual knowledge collections. This review will provide an overview of the current state of knowledge concerning conceptual knowledge acquisition, drawing from multiple contributing academic disciplines such as biomedicine, computer science, cognitive science, education, linguistics, semiotics, and psychology. In addition, multiple taxonomic approaches to the description and selection of conceptual knowledge acquisition and evaluation techniques will be proposed in order to partially address the apparent fragmentation of the current literature concerning this domain.

[1]  Daniel Chandler,et al.  Semiotics: The Basics , 2001 .

[2]  Suzanne Bakken,et al.  Review: Collaborative Efforts for Representing Nursing Concepts in Computer-based Systems: International Perspectives , 2001, J. Am. Medical Informatics Assoc..

[3]  George Hripcsak,et al.  An evaluation of natural language processing methodologies , 1998, AMIA.

[4]  Gordon Rugg,et al.  The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts , 1997, Expert Syst. J. Knowl. Eng..

[5]  Carol Friedman,et al.  Two biomedical sublanguages: a description based on the theories of Zellig Harris , 2002, J. Biomed. Informatics.

[6]  Michel Dojat,et al.  Application of Information Technology: A UMLS-based Knowledge Acquisition Tool for Rule-based Clinical Decision Support System Development , 2001, J. Am. Medical Informatics Assoc..

[7]  Carol Friedman,et al.  Research Paper: The Canon Group's Effort: Working Toward a Merged Model , 1995, J. Am. Medical Informatics Assoc..

[8]  M. Walton.  The Deming management method , 1986 .

[9]  Adam Pease,et al.  Towards a standard upper ontology , 2001, FOIS.

[10]  James J. Cimino,et al.  Review: From Data to Knowledge through Concept-oriented Terminologies: Experience with the Medical Entities Dictionary , 2000, J. Am. Medical Informatics Assoc..

[11]  M. Ashburner,et al.  Gene Ontology: tool for the unification of biology , 2000, Nature Genetics.

[12]  Tom Rodden,et al.  The role of ethnography in interactive systems design , 1995, INTR.

[13]  Vimla L. Patel,et al.  A framework for analyzing the cognitive complexity of computer-assisted clinical ordering , 2003, J. Biomed. Informatics.

[14]  Edward H. Shortliffe,et al.  Viewpoint: The Unified Medical Language System: Toward a Collaborative Approach for Solving Terminologic Problems , 1998, J. Am. Medical Informatics Assoc..

[15]  Carol Friedman,et al.  Research Paper: A General Natural-language Text Processor for Clinical Radiology , 1994, J. Am. Medical Informatics Assoc..

[16]  Anne E. James,et al.  A general approach to ethnographic analysis for systems design , 2005, SIGDOC '05.

[17]  Brian R. Gaines,et al.  Knowledge Acquisition Tools for Expert Systems , 1988 .

[18]  G Hripcsak,et al.  Natural language processing and its future in medicine. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[19]  John Haugeland.  Mind design , 1985 .

[20]  Nicola Guarino,et al.  Formal ontology, conceptual analysis and knowledge representation , 1995, Int. J. Hum. Comput. Stud..

[21]  S. M. Huff,et al.  Research Paper: Evaluation of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) Semantic Structure as a Terminology Model for Standardized Assessment Measures , 2000, J. Am. Medical Informatics Assoc..

[22]  Vimla L. Patel,et al.  Review: A Primer on Aspects of Cognition for Medical Informatics , 2001, J. Am. Medical Informatics Assoc..

[23]  J J Cimino,et al.  Toward a medical-concept representation language. The Canon Group. , 1994, Journal of the American Medical Informatics Association : JAMIA.

[24]  G Hripcsak,et al.  Evaluating Natural Language Processors in the Clinical Domain , 1998, Methods of Information in Medicine.

[25]  Brian Everitt,et al.  Cluster analysis , 1974 .

[26]  P. Compton,et al.  A philosophical basis for knowledge acquisition , 1990 .

[27]  Don M. Gottfredson,et al.  Prediction and Classification in Criminal Justice Decision Making , 1987, Crime and Justice.

[28]  Jiajie Zhang,et al.  Representations of health concepts: a cognitive perspective , 2002, J. Biomed. Informatics.

[29]  Gerd Stumme,et al.  Conceptual Knowledge Discovery and Data Analysis , 2000, ICCS.

[30]  Vimla L. Patel,et al.  To err is not entirely human: Complex technology and user cognition , 2005, J. Biomed. Informatics.

[31]  Nina Tayar.  A model for developing large shared knowledge bases , 1993, CIKM '93.

[32]  Jarek Rossignac,et al.  Proceedings of the third ACM symposium on Solid modeling and applications , 1995, SIGGRAPH 1995.

[33]  W. DuMouchel,et al.  Unlocking Clinical Data from Narrative Reports: A Study of Natural Language Processing , 1995, Annals of Internal Medicine.

[34]  Brian R. Gaines,et al.  Knowledge acquisition for knowledge-based systems , 1991, IEEE Expert.

[35]  Peter Becker,et al.  Agreement Contexts in Formal Concept Analysis , 2004, ICFCA.

[36]  Nada Lavrac,et al.  Methods for knowledge acquisition and refinement in second generation expert systems , 1989, SGAR.

[37]  Bernhard Ganter,et al.  Proceedings of the Linguistic on Conceptual Structures: Logical Linguistic, and Computational Issues , 2000 .

[38]  Stephen D. Kleban,et al.  GMS: preserving multiple expert voices in scientific knowledge management , 2003, DUX '03.

[39]  Matjaz Mulej,et al.  REQUISITELY HOLISTIC ISO 9000 AUDIT LEADS TO CONTINUOUS INNOVATION/IMPROVEMENT , 2004, Cybern. Syst..

[40]  George Hripcsak,et al.  Measuring agreement in medical informatics reliability studies , 2002, J. Biomed. Informatics.

[41]  Vimla L. Patel,et al.  Computer-based drug ordering: evaluation of interaction with a decision-support system , 2004, MedInfo.

[42]  G. Kelly.  The Psychology of Personal Constructs , 2020 .

[43]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[44]  Frederick W. Rook,et al.  Knowledge acquisition for AI system requirements analysis: a systems engineeringmethodology , 1988, IEA/AIE '88.

[45]  W. Edwards Deming,et al.  Out of the Crisis , 1982 .

[46]  Alexa T. McCray,et al.  Research Paper: Evaluating the Coverage of Controlled Health Data Terminologies: Report on the Results of the NLM/AHCPR Large Scale Vocabulary Test , 1997, J. Am. Medical Informatics Assoc..

[47]  Roberta M. Roth,et al.  A Delphi approach to acquiring knowledge from single and multiple experts , 1990, SIGBDP '90.

[48]  Alun Preece.  Evaluating Verification and Validation Methods in Knowledge Engineering , 2001 .

[49]  G Wickström,et al.  The "Hawthorne effect"--what did the original Hawthorne studies actually show? , 2000, Scandinavian journal of work, environment & health.

[50]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[51]  R. McCormick.  Conceptual and Procedural Knowledge , 1997 .

[52]  Yves A. Lussier,et al.  Partitioning knowledge bases between advanced notification and clinical decision support systems , 2007, Decis. Support Syst..

[53]  Samson W. Tu,et al.  Protégé-2000: An Open-Source Ontology-Development and Knowledge-Acquisition Environment: AMIA 2003 Open Source Expo , 2003, AMIA.

[54]  Yuming Zhou,et al.  A comparative study of graph theory-based class cohesion measures , 2004, SOEN.

[55]  Frank van Harmelen,et al.  Editorial: Evaluating knowledge engineering techniques , 1999, Int. J. Hum. Comput. Stud..

[56]  Brian R. Gaines.  Social and cognitive processes in knowledge acquisition , 1989 .

[57]  Roberta M. Roth,et al.  A workshop approach to acquiring knowledge from single and multiple experts , 1990, SIGBDP '90.

[58]  Andreas Hotho,et al.  Conceptual Knowledge Processing with Formal Concept Analysis and Ontologies , 2004, ICFCA.

[59]  Omolola Ogunyemi,et al.  Review Paper: The InterMed Approach to Sharable Computer-interpretable Guidelines: A Review , 2004, J. Am. Medical Informatics Assoc..

[60]  Rosío Alvarez,et al.  Discourse analysis of requirements and knowledge elicitation interviews , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[61]  Uta Priss.  Formal concept analysis in information science , 2006 .

[62]  Robert R. Hoffman,et al.  A survey of methods for eliciting the knowledge of experts , 1989, SGAR.

[63]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[64]  Morgan M. Shepherd,et al.  Group consensus: do we know it when we see it? , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[65]  Kenneth J. Delano.  Identifying Factors that Contribute to Program Success , 1998 .

[66]  Robert A. Greenes,et al.  Research Paper: Experiments in Concept Modeling for Radiographic Image Reports , 1994, J. Am. Medical Informatics Assoc..

[67]  George Hripcsak,et al.  Reference Standards, Judges, and Comparison Subjects , 2002 .

[68]  O. W. Salomons,et al.  Conceptual graphs in constraint based re-design , 1995, SMA '95.

[69]  Kent A. Spackman,et al.  Review: Representing Thoughts, Words, and Things in the UMLS , 1998, J. Am. Medical Informatics Assoc..

[70]  James Hiebert.  Missing Links@@@Conceptual and Procedural Knowledge: The Case of Mathematics , 1987 .

[71]  David Hawkins,et al.  An Analysis of Expert Thinking , 1983, Int. J. Man Mach. Stud..

[72]  John Millar Carroll.  Interfacing Thought: Cognitive Aspects of Human-Computer Interaction , 2003 .

[73]  Stanley M. Huff,et al.  Position Paper: Toward a Medical-concept Representation Language , 1994, J. Am. Medical Informatics Assoc..

[74]  Riccardo Dondi,et al.  Stimulating knowledge discovery and sharing , 2003, GROUP.

[75]  Justin Starren,et al.  Quantifying Visual Similarity in Clinical Iconic Graphics , 2003, AMIA.

[76]  Russ B. Altman,et al.  Knowledge acquisition, consistency checking and concurrency control for Gene Ontology (GO) , 2003, Bioinform..

[77]  John E. Mattison,et al.  Kaiser Permanente's Convergent Medical Terminology , 2004, MedInfo.

[78]  Vimla L. Patel,et al.  The Cognitive Complexity of a Provider Order Entry Interface , 2003, AMIA.

[79]  T. D. Wilson.  Review of: Cronin, Blaise, (Ed.). Annual review of information science and technology. Volume 40. 2006. Medford, NJ: Information Today, Inc. on behalf of ASIS&T, 2006 , 2006, Inf. Res..

[80]  Robert A. Greenes,et al.  Methods of Cognitive Analysis to Support the Design and Evaluation of Biomedical Systems: The Case of Clinical Practice Guidelines , 2001, J. Biomed. Informatics.

[81]  Y. I. Liou,et al.  Knowledge acquisition: issues, techniques, and methodology , 1990, SIGBDP '90.

[82]  R. Glaser.  Education and Thinking: The Role of Knowledge. , 1984 .

[83]  Stephen B. Johnson,et al.  From multimodal sublanguages to medical data presentations , 1997 .

[84]  Nigel Shadbolt,et al.  Laddering: technique and tool use in knowledge acquisition , 1994 .

[85]  Guy A. Boy,et al.  The group elicitation method for participatory design and usability testing , 1996, INTR.

[86]  Olivier Bodenreider,et al.  Aspects of the taxonomic relation in the biomedical domain , 2001, FOIS.

[87]  J. E. Davidson.  Topics in Discourse Analysis , 1977 .

[88]  David Leake,et al.  Managing, Mapping, and Manipulating Conceptual Knowledge* , 1999 .

[89]  Karl Bühler,et al.  Theory of Language: The Representational Function of Language , 2011 .

[90]  Deborah L. McGuinness,et al.  Knowledge representation, connectionism and conceptual retrieval , 1988, SIGIR '88.

[91]  George Hripcsak,et al.  Review Paper: Reference Standards, Judges, and Comparison Subjects: Roles for Experts in Evaluating System Performance , 2002, J. Am. Medical Informatics Assoc..

[92]  George Hripcsak,et al.  Research Paper: Knowledge-based Approaches to the Maintenance of a Large Controlled Medical Terminology , 1994, J. Am. Medical Informatics Assoc..

[93]  Gilad J. Kuperman,et al.  Case Report: Comprehensive Analysis of a Medication Dosing Error Related to CPOE , 2005, J. Am. Medical Informatics Assoc..

[94]  J. Cimino.  Desiderata for Controlled Medical Vocabularies in the Twenty-First Century , 1998, Methods of Information in Medicine.

[95]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[96]  Robert L. Griffith,et al.  Three principles of representation for semantic networks , 1982, TODS.

[97]  Hal Berghel,et al.  Proceedings of the 1993 ACM/SIGAPP Symposium on Applied Computing: States of the Art and Practice, SAC'93, Indianapolis, IN, USA, February 14-16, 1993 , 1993, ACM Symposium on Applied Computing.

[98]  Peter G. Polson,et al.  A quantitative theory of human-computer interaction , 1987 .

[99]  Sylvia Scribner,et al.  Knowledge at Work. , 1985 .

[100]  P Carpenter,et al.  Phase II evaluation of clinical coding schemes: completeness, taxonomy, mapping, definitions, and clarity. CPRI Work Group on Codes and Structures. , 1997, Journal of the American Medical Informatics Association : JAMIA.

[101]  Ralph Grishman,et al.  Analyzing language in restricted domains : sublanguage description and processing , 1986 .

[102]  Alan L. Rector,et al.  Untangling taxonomies and relationships: personal and practical problems in loosely coupled development of large ontologies , 2001, K-CAP '01.

[103]  Brian R. Gaines,et al.  Knowledge acquisition tools based on personal construct psychology , 1993, The Knowledge Engineering Review.

[104]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[105]  Gi-Chul Yang,et al.  Knowledge acquisition and retrieval based on conceptual graphs , 1993, SAC '93.

[106]  John F. Sowa.  A conceptual schema for Knowledge-based systems , 1981, SIGMOD 1981.

[107]  Mark Pendergast,et al.  GROUP'03 : proceedings of the 2003 International ACM SIGGROUP Conference on Supporting Group Work : November 9-12, 2003, Sundial Resort on Sanibel Island, Florida, USA , 2003 .