Variability in interpretation of chest radiographs among Russian clinicians and implications for screening programmes: observational study

Abstract Objective To determine variability in interpretation of chest radiographs among tuberculosis specialists, radiologists, and respiratory specialists. Design Observational study. Setting Tuberculosis and respiratory disease services, Samara region, Russian Federation. Participants 101 clinicians involved in the diagnosis and management of pulmonary tuberculosis and respiratory diseases. Main outcome measures Interobserver and intraobserver agreement on the interpretation of 50 digital chest radiographs, using a scale of poor to very good agreement (κ coefficient: ≤ 0.20 poor, 0.21-0.40 fair, 0.41-0.60 moderate, 0.61-0.80 good, and 0.81-1.00 very good). Results Agreement on the presence or absence of an abnormality was fair only (κ = 0.380, 95% confidence interval 0.376 to 0.384), moderate for localisation of the abnormality (0.448, 0.444 to 0.452), and fair for a diagnosis of tuberculosis (0.387, 0.382 to 0.391). The highest levels of agreement were among radiologists. Level of experience (years of work in the specialty) influenced agreement on presence of abnormalities and cavities. Levels of intraobserver agreement were fair. Conclusions Population screening for tuberculosis in Russia may be less than optimal owing to limited agreement on interpretation of chest radiographs, and may have implications for radiological screening programmes in other countries.

[1]  A. Norman Radiography , 1913, The Hospital.

[2]  O. Eden,et al.  Inter-Observer Variation in Interpretation of Chest X-Rays , 1990, Scottish medical journal.

[3]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[4]  D. Alton,et al.  Observer variation in detecting the radiologic features associated with bronchiolitis. , 1991, Investigative radiology.

[5]  Observer variation in detecting the radiologic features associated with bronchiolitis. , 1991, Investigative radiology.

[6]  D Alland,et al.  Transmission of tuberculosis in New York City. An analysis by DNA fingerprinting and conventional epidemiologic methods. , 1994, The New England journal of medicine.

[7]  A. Zitting Prevalence of radiographic small lung opacities and pleural abnormalities in a representative adult population sample. , 1995, Chest.

[8]  C A Britton,et al.  Interobserver reliability of the chest radiograph in community-acquired pneumonia. PORT Investigators. , 1996, Chest.

[9]  N L Müller,et al.  Miliary Tuberculosis: Diagnostic Accuracy of Chest Radiography , 1996 .

[10]  F. Drobniewski,et al.  Tuberculosis in Siberia: 2. Diagnosis, chemoprophylaxis and treatment. , 1996, Tubercle and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[11]  N Taub,et al.  An assessment of inter-observer agreement and accuracy when reporting plain radiographs. , 1997, Clinical radiology.

[12]  Matthew G. Potter,et al.  Measuring performance in chest radiography. , 2000, Radiology.

[13]  J. V. van Engelshoven,et al.  Detection of lung cancer on the chest radiograph: a study on observer performance. , 2001, European journal of radiology.

[14]  A. Scally,et al.  Bias in plain film reading performance studies. , 2001, The British journal of radiology.

[15]  Evidence for action? Patterns of clinical and public health research on tuberculosis in South Africa, 1994-1998. , 2001, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[16]  S. Brealey Measuring the effects of image interpretation: an evaluative framework. , 2001, Clinical radiology.

[17]  G. Swingler,et al.  Observer variation in detecting lymphadenopathy on chest radiography. , 2002, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[18]  C. Wakeley,et al.  Error review: can this improve reporting performance. , 2002, Clinical radiology.

[19]  A. Liddicoat,et al.  Assessment of agreement between general practitioners and radiologists as to whether a radiation exposure is justified. , 2002, The British journal of radiology.

[20]  R. Atun,et al.  Tuberculosis control in Samara Oblast, Russia: institutional and regulatory environment. , 2003, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[21]  Erokhin Vv,et al.  [New organizational forms of antituberculosis care under present conditions. Results and experience exchange of work in pilot regions. Scientific-and-Practical Conference (Moscow, September 25-27, 2002)]. , 2003 .

[22]  Medical and social analysis of prisoners with tuberculosis in a Russian prison colony: an observational study. , 2003, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[23]  R. Coker Migration , public health and compulsory screening for TB and HIV , 2003 .