Evaluation of a Semantic Data Model for Chest Radiology: Application of aNew Methodology

An essential step toward the effective processing of the medical language is the development of representational models that formalize the language semantics. These models, also known as semantic data models, help to unlock the meaning of descriptive expressions, making them accessible to computer systems. The present study tries to determine the quality of a semantic data model created to encode chest radiology findings. The evaluation methodology relied on the ability of physicians to extract information from textual and encoded representations of chest X-ray reports, whilst answering questions associated with each report. The evaluation demonstrated that the encoded reports seemed to have the same information content of the original textual reports. The methodology generated useful data regarding the quality of the data model, demonstrating that certain segments were creating ambiguous representations and that some details were not being represented.

[1]  H. Warner,et al.  An interlingua for electronic interchange of medical information: using frames to map between clinical vocabularies. , 1991, Computers and biomedical research, an international journal.

[2]  Beth Sundheim,et al.  MUC-5 Evaluation Metrics , 1993, MUC.

[3]  Naomi Sager,et al.  Research Paper: Natural Language Processing and the Representation of Clinical Data , 1994, J. Am. Medical Informatics Assoc..

[4]  P J Haug,et al.  Designing a controlled medical vocabulary server: the VOSER project. , 1994, Computers and biomedical research, an international journal.

[5]  Mark A. Musen,et al.  Research Paper: A Logical Foundation for Representation of Clinical Data , 1994, J. Am. Medical Informatics Assoc..

[6]  L A Lenert,et al.  Monitoring free-text data using medical language processing. , 1993, Computers and biomedical research, an international journal.

[7]  P J Haug,et al.  Text management in a healthcare information system. , 1994, Journal of AHIMA.

[8]  J. Reggia,et al.  HELP: A Dynamic Hospital Information System , 1991, Computers and Medicine.

[9]  Carol Friedman,et al.  Research Paper: The Canon Group's Effort: Working Toward a Merged Model , 1995, J. Am. Medical Informatics Assoc..

[10]  Ralph Grishman,et al.  Analyzing language in restricted domains : sublanguage description and processing , 1986 .

[11]  J R Scherrer,et al.  Natural language processing of medical texts within the HELIOS environment. , 1994, Computer methods and programs in biomedicine.

[12]  K Kuhn,et al.  Structured data collection and knowledge-based user guidance for abdominal ultrasound reporting. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[13]  Carol Friedman,et al.  Research Paper: A General Natural-language Text Processor for Clinical Radiology , 1994, J. Am. Medical Informatics Assoc..

[14]  P Zweigenbaum,et al.  MENELAS: an access system for medical records using natural language. , 1994, Computer methods and programs in biomedicine.

[15]  S Kaihara,et al.  Quantitative evaluation of English-Japanese machine translation of medical literature. , 1991, Methods of information in medicine.

[16]  Sergei Nirenburg,et al.  Book Reviews: Machine Translation: A Knowledge-Based Approach , 1993, CL.

[17]  A. Rector,et al.  Foundations for an Electronic Medical Record , 1991, Methods of Information in Medicine.

[18]  Alan L. Rector,et al.  Research Paper: Medical-Concept Models and Medical Records: An Approach Based on GALENand PEN&PAD , 1995, J. Am. Medical Informatics Assoc..

[19]  R Haux,et al.  The LBI-method for automated indexing of diagnoses by using SNOMED. Part 2. Evaluation. , 1995, International journal of bio-medical computing.

[20]  Craig A. Will Comparing human and machine performance for natural language information extraction: results for English microelectronics from the MUC-5 evaluation , 1993, MUC.

[21]  Lawrence M. Fagan,et al.  A continuous-speech interface to a decision support system: I. Techniques to accommodate for misrecognized input. , 1995, Journal of the American Medical Informatics Association : JAMIA.

[22]  W. DuMouchel,et al.  Unlocking Clinical Data from Narrative Reports: A Study of Natural Language Processing , 1995, Annals of Internal Medicine.

[23]  Catherine Berrut Indexing medical reports: The rime approach , 1990, Inf. Process. Manag..

[24]  Lynette Hirschman,et al.  Evaluating Message Understanding Systems: An Analysis of the Third Message Understanding Conference (MUC-3) , 1993, CL.

[25]  L M Lau,et al.  A natural language understanding system combining syntactic and semantic techniques. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[26]  Beth M. Sundheim,et al.  TIPSTER/MUC-5 Information Extraction System Evaluation , 1993, TIPSTER.

[27]  Jerry R. Hobbs The Generic Information Extraction System , 1993, MUC.

[28]  C. McDonald Protocol-based computer reminders, the quality of care and the non-perfectability of man. , 1976, The New England journal of medicine.

[29]  S Kay,et al.  A Framework for Modelling the Electronic Medical Record , 1993, Methods of Information in Medicine.

[30]  A L Rector,et al.  Goals for concept representation in the GALEN project. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[31]  David A. Evans,et al.  Initial phase in developing representations for mapping medical knowledge : INTERNIST-I QMR, HELP, and MeSH , 1987 .

[32]  George M. White,et al.  Natural language understanding and speech recognition , 1990, CACM.

[33]  Mark T. Keane,et al.  Effective retrieval in Hospital Information Systems: the use of context in answering queries to Patient Discharge Summaries , 1994, Artif. Intell. Medicine.

[34]  R A Greenes,et al.  Form-based clinical input from a structured vocabulary: initial application in ultrasound reporting. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[35]  G. Keppel,et al.  Design and Analysis: A Researcher's Handbook , 1976 .

[36]  J. Cimino,et al.  Toward a Medical-concept Representation Language , 2022 .

[37]  Georges Van Slype Conception d’une méthodologie générale d’evaluation de la traduction automatique , 1982 .

[38]  Y Satomura,et al.  Structuring medical information into a language-independent database. , 1994, Medical informatics = Medecine et informatique.

[39]  P J Haug,et al.  An event model of medical information representation. , 1995, Journal of the American Medical Informatics Association : JAMIA.

[40]  J R Scherrer,et al.  Natural Language Processing and Semantical Representation of Medical Texts , 1992, Methods of Information in Medicine.

[41]  J Bernauer,et al.  Models for representation of terminologies and coding systems in medicine. , 1993, Studies in health technology and informatics.

[42]  Peter J. Haug,et al.  The HELP System Development Tools , 1989 .

[43]  Danny Goodman The complete HyperCard 2.2 handbook , 1987 .