Abstract Objective: To develop methods of measuring the validity and utility of electronic patient records in general practice. Design: A survey of the main functional areas of a practice and use of independent criteria to measure the validity of the practice database. Setting: A fully computerised general practice in Skipton, north Yorkshire. Subjects: The records of all registered practice patients. Main outcome measures: Validity of the main functional areas of the practice clinical system. Measures of the completeness, accuracy, validity, and utility of the morbidity data for 15 clinical diagnoses using recognised diagnostic standards to confirm diagnoses and identify further cases. Development of a method and statistical toolkit to validate clinical databases in general practice. Results: The practice electronic patient records were valid, complete, and accurate for prescribed items (99.7%), consultations (98.1%), laboratory tests (100%), hospital episodes (100%), and childhood immunisations (97%). The morbidity data for 15 clinical diagnoses were complete (mean sensitivity=87%) and accurate (mean positive predictive value=96%). The presence of the Read codes for the 15 diagnoses was strongly indicative of the true presence of those conditions (mean likelihood ratio=3917). New interpretations of descriptive statistics are described that can be used to estimate both the number of true cases that are unrecorded and quantify the benefits of validating a clinical database for coded entries. Conclusion: This study has developed a method and toolkit for measuring the validity and utility of general practice electronic patient records. What is already known on this topic Delivering the performance management agenda in the NHS will depend on the availability of high quality information in general practice Record entries in GP systems generally consist of a mixture of text and Read coded entries Sensitivity and positive predictive value have been used to measure the completeness and accuracy of data recording in electronic patient record systems What this study adds This study has developed a standard method and toolkit for measuring the validity and utility of electronic patient record systems The principal innovation in this study is to consider the Read codes in the records as tests for the true presence of the associated diagnoses This study has developed a new approach to the validation of electronic patient record systems.
[1]
R J Lilford,et al.
For Debate: The statistical basis of public policy: a paradigm shift is overdue
,
1996,
BMJ.
[2]
Michael Bainbridge,et al.
An Adult Learning Model for Improving Information Management in Family Practice.
,
1996
.
[3]
D. Metcalfe.
A TEXTBOOK OF FAMILY MEDICINE
,
1990
.
[4]
Huw Thomas,et al.
Collecting morbidity data in general practice: the Somerset morbidity project
,
1996,
BMJ.
[5]
A E Wilson,et al.
Can general practice provide useful information?--evaluation of a primary health care information project in northern England.
,
1995,
Journal of epidemiology and community health.
[6]
M Pringle,et al.
Assessment of the completeness and accuracy of computer medical records in four practices committed to recording data on computer.
,
1995,
The British journal of general practice : the journal of the Royal College of General Practitioners.
[7]
S. Satya‐Murti.
Evidence-based Medicine: How to Practice and Teach EBM
,
1997
.
[8]
R M Milne,et al.
Completeness and accuracy of morbidity and repeat prescribing records held on general practice computers in Scotland.
,
1996,
The British journal of general practice : the journal of the Royal College of General Practitioners.
[9]
C. Warwick.
The new NHS: modern dependable
,
1998
.
[10]
D. Plamping,et al.
The new NHS.
,
1991,
BMJ.
[11]
P L Heywood,et al.
Real world data--retrieval and validation of consultation data from four general practices.
,
1996,
Family practice.
[12]
P. Brink.
On reliability and validity in qualitative research.
,
1987,
Western journal of nursing research.
[13]
R. Lloyd‐Mostyn.
National service framework for coronary heart disease
,
2000,
BMJ : British Medical Journal.
[14]
A. Watt,et al.
Morbidity and prescribing patterns for the middle-aged population of Scotland.
,
1996,
The British journal of general practice : the journal of the Royal College of General Practitioners.