Randomised crossover trial comparing the performance of Clinical Terms Version 3 and Read Codes 5 byte set coding schemes in general practice

Abstract Objective To determine whether Clinical Terms Version 3 provides greater accuracy and consistency in coding electronic patient records than the Read Codes 5 byte set. Design Randomised crossover trial. Clinicians coded patient records using both schemes after being randomised in pairs to use one scheme before the other. Setting 10 general practices in urban, suburban, and rural environments in Norfolk. Participants 10 general practitioners. Source of data Concepts were collected from records of 100 patient encounters. Main outcome measures Percentage of coded choices ranked as being exact representations of the original terms; percentage of cases where coding choice of paired general practitioners was identical; length of time taken to find a code. Results A total of 995 unique concepts were collected. Exact matches were more common with Clinical Terms (70% (95% confidence interval 67% to 73%)) than with Read Codes (50% (47% to 53%)) (P < 0.001), and this difference was significant for each of the 10 participants individually. The pooled proportion with exact and identical matches by paired participants was greater for Clinical Terms (0.58 (0.55 to 0.61)) than Read Codes (0.36 (0.33 to 0.39)) (P < 0.001). The time taken to code with Clinical Terms (30 seconds per term) was not significantly longer than that for Read Codes. Conclusions Clinical Terms Version 3 performed significantly better than Read Codes 5 byte set in capturing the meaning of concepts. These findings suggest that improved coding accuracy in primary care electronic patient records can be achieved with the use of such a clinical terminology.

[1]  James R. Campbell,et al.  n Phase II Evaluation of Clinical Coding Schemes : Completeness , Taxonomy , Mapping , Definitions , and Clarity , 2022 .

[2]  R. A. Fisher,et al.  Statistical Tables for Biological, Agricultural and Medical Research , 1956 .

[3]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[4]  Philip J. B. Brown,et al.  Does size matter?-Evaluation of value added content of two decades of successive coding schemes in secondary care , 2001, AMIA.

[5]  D. Symmons,et al.  The clinical terms project. , 1992, British journal of rheumatology.

[6]  Stanley M. Huff,et al.  Position Paper: Toward a Medical-concept Representation Language , 1994, J. Am. Medical Informatics Assoc..

[7]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[8]  C Payne,et al.  Read Codes Version 3: A User Led Terminology , 1995, Methods of Information in Medicine.

[9]  C. Chute,et al.  The content coverage of clinical classifications. For The Computer-Based Patient Record Institute's Work Group on Codes & Structures. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[10]  A W Hahn,et al.  Representation of clinical problem assessment phrases in U.S. family practice using Read version 3.1 terms: a preliminary study. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[11]  J. Wishart Statistical tables , 2018, Global Education Monitoring Report.

[12]  J. Cimino,et al.  Toward a Medical-concept Representation Language , 2022 .

[13]  Philip J. B. Brown,et al.  Evaluation of the quality of information retrieval of clinical findings from a computerized patient database using a semantic terminological model. , 2000, Journal of the American Medical Informatics Association : JAMIA.

[14]  W. Grove Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[15]  H C Mullins,et al.  The efficacy of SNOMED, Read Codes, and UMLS in coding ambulatory family practice clinical records. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[16]  M. Palmer Clinical Trials: A Practical Approach , 1985 .

[17]  Alexa T. McCray,et al.  Research Paper: Evaluating the Coverage of Controlled Health Data Terminologies: Report on the Results of the NLM/AHCPR Large Scale Vocabulary Test , 1997, J. Am. Medical Informatics Assoc..

[18]  Kent A. Spackman,et al.  SNOMED clinical terms: overview of the development process and project status , 2001, AMIA.

[19]  V. Patel,et al.  Studying the human-computer-terminology interface. , 2001, Journal of the American Medical Informatics Association : JAMIA.

[20]  B. Efron Better Bootstrap Confidence Intervals , 1987 .

[21]  J Carpenter,et al.  Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. , 2000, Statistics in medicine.