Intra-observer and overall agreement in the radiological assessment of tuberculosis.

OBJECTIVE To assess the intra-observer and overall agreement in the interpretation of chest X-rays (CXRs) performed for detecting tuberculosis (TB) among immigrants in Switzerland. METHOD Four hundred digitalised CXRs from the files of immigrant registration centres were selected and read twice in random order by three readers. The readers had to assess (1) if the picture was normal or abnormal; (2) if an abnormality was suggestive of TB; and (3) if the suspicion of TB needed an immediate examination (potentially smear-positive TB). The intra-observer and overall agreements were expressed as kappa with standard error. RESULTS Due to losses for technical reasons, 377 of the 400 pictures were analysed. The intra-observer agreement was 0.39-0.90 for any abnormality, and 0.60-0.82 for TB needing an urgent examination. The overall agreements were: 0.55 (all three readers) and 0.84 (two best readers) for any abnormality, and 0.64 (all three readers) and 0.80 (two best readers) for active TB. CONCLUSIONS The intra-observer and overall agreements for the detection of abnormalities on digitalised CXRs and for the presence of possible active TB depend on the reader's experience. It was good between experienced readers and fair between and within the inexperienced reader.

[1]  D. Menzies,et al.  Chest radiograph abnormalities associated with tuberculosis: reproducibility and yield of active cases. , 2002, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[2]  K. Lessnau,et al.  Radiographic findings in HIV-positive patients with sensitive and resistant tuberculosis. , 1994, Chest.

[3]  G. Bickler,et al.  The public health management of tuberculosis among the single homeless: is mass miniature x ray screening effective? , 1992, Journal of epidemiology and community health.

[4]  R. Davidson,et al.  Pulmonary tuberculosis among political asylum seekers screened at Heathrow Airport, London, 1995–9 , 2002, Thorax.

[5]  W. Grove Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[6]  B. Duvoisin,et al.  [Routine thoracic radiography at admission to a psychogeriatric hospital: why continue to perform such a procedure when it has but little effect on treatment?]. , 1995, Revue medicale de la Suisse romande.

[7]  A. Pozniak,et al.  Clinical and chest radiographic features of tuberculosis associated with human immunodeficiency virus in Zimbabwe. , 1995, American journal of respiratory and critical care medicine.

[8]  K. Sebro,et al.  Are routine chest X-rays for students entering university worthwhile? , 2001, Journal of quality in clinical practice.

[9]  M. Døssing,et al.  Radiographic spectrum of adult pulmonary tuberculosis in a developed country. , 1998, Respiratory medicine.

[10]  J. Richard Landis,et al.  Large sample variance of kappa in the case of different sets of raters. , 1979 .

[11]  M. Shoukri,et al.  Measures of Interobserver Agreement , 2003 .

[12]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[13]  W. Schaffner,et al.  Miniature chest radiograph screening for tuberculosis in jails: a cost-effectiveness analysis. , 2001, American journal of respiratory and critical care medicine.

[14]  E. Bateman,et al.  Development and evaluation of a new chest radiograph reading and recording system for epidemiological surveys of tuberculosis and lung disease. , 2005, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[15]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[16]  K. Toman Mass radiography in tuberculosis control. , 1976, WHO chronicle.

[17]  W. Miller Tuberculosis in the normal host: radiological findings. , 1993, Seminars in roentgenology.

[18]  N. Chaturvedi,et al.  Tuberculosis screening in health service employees: who needs chest X-rays? , 1992, Occupational medicine.

[19]  R. Wood,et al.  Pulmonary tuberculosis in HIV infection: radiographic appearance is related to CD4+ T-lymphocyte count. , 1995, Tubercle and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[20]  D. Menzies Screening immigrants to Canada for tuberculosis: chest radiography or tuberculin skin testing? , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[21]  K. Schwartzman,et al.  Tuberculosis screening of immigrants to low-prevalence countries. A cost-effectiveness analysis. , 2000, American journal of respiratory and critical care medicine.

[22]  R. Atun,et al.  Variability in interpretation of chest radiographs among Russian clinicians and implications for screening programmes: observational study , 2005, BMJ : British Medical Journal.