Low agreement of visual rating for detailed quantification of pulmonary emphysema in whole-lung CT

Background Multidetector spiral computed tomography (CT) has opened the possibility of quantitative evaluation of emphysema extent in the whole lung. Visual assessment can be used for such a purpose, but its reproducibility has not been established. Purpose To assess agreement of detailed assessment of pulmonary emphysema on whole-lung CT using a visual scale. Material and Methods Thirty patients with chronic obstructive pulmonary disease underwent whole-lung inspiratory CT. Four chest radiologists rated the same 22 ± 2 thin sections using a visual scale which defines a range of emphysema extent between 0 and 100. Two of them repeated the rating two months later. Inter- and intra-operator agreement was evaluated with the Bland and Altman method. In addition, the percentage of emphysema at –950 Hounsfield units in the whole lung was determined using fully automated commercially available software for 3D densitometry. Results In three of six operator pairs and in one of two intra-operator pairs the Kendall τ test showed a significant correlation between the difference and the average magnitude of visual scores. Among different operators the half-width of 95% limits of agreement (95% LoA) was wide ranging between a score of 14.2–27.7 for an average visual score of 20 and between 18.5–36.8 for an average visual score of 80. Within the same operator the half-width of 95% LoA ranged between a score of 10.9–21.0 for an average visual score of 20 and between 25.1–30.1 for an average visual score of 80. The visual scores of the four radiologists were correlated with the results of densitometry (P < 0.001; r = 0.65–0.81). Conclusion The inter- and intra-operator agreement of detailed assessment of emphysema in the whole lung using a visual scale is low and decreases with increasing emphysema extent.

[1]  R. Pauwels,et al.  Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: National Heart, Lung, and Blood Institute and World Health Organization Global Initiative for Chronic Obstructive Lung Disease (GOLD): executive summary. , 2001, Respiratory care.

[2]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[3]  Raúl San José Estépar,et al.  Interobserver variability in the determination of upper lobe-predominant emphysema. , 2007, Chest.

[4]  Ye Xu,et al.  MDCT-based 3-D texture classification of emphysema and early smoking related lung pathologies , 2006, IEEE Transactions on Medical Imaging.

[5]  G Gamsu,et al.  Pulmonary function abnormalities in patients with CT-determined emphysema. , 1987, Journal of computer assisted tomography.

[6]  G. Bastarrika,et al.  Low-dose Volumetric Computed Tomography for Quantification of Emphysema in Asymptomatic Smokers Participating in an Early Lung Cancer Detection Trial , 2009, Journal of thoracic imaging.

[7]  D. Hansell,et al.  Obstructive lung diseases: texture classification for differentiation at CT. , 2003, Radiology.

[8]  A A Bankier,et al.  Pulmonary emphysema: subjective visual grading versus objective quantification with macroscopic morphometry and thin-section CT densitometry. , 1999, Radiology.

[9]  R. Nakashima,et al.  Emphysema detected by lung cancer screening with low‐dose spiral CT: Prevalence, and correlation with smoking habits and pulmonary function in Japanese male subjects , 2006, Respirology.

[10]  P. Gevenois,et al.  CT quantification of pulmonary emphysema: which level? , 1994 .

[11]  D. Lynch,et al.  Quantitative imaging of COPD. , 2009, Journal of thoracic imaging.

[12]  N. Sverzellati,et al.  How much do GOLD stages reflect CT abnormalities in COPD patients? , 2008, La radiologia medica.

[13]  A. Miller,et al.  Lung function testing: selection of reference values and interpretative strategies. , 1992, The American review of respiratory disease.

[14]  D. Hansell,et al.  Quantification of emphysema: a composite physiologic index derived from CT estimation of disease extent , 2007, European Radiology.

[15]  N. Sverzellati,et al.  Early smoking-induced lung lesions in asymptomatic subjects. Correlations between high resolution dynamic CT and pulmonary function testing. , 2005, La Radiologia medica.

[16]  J. Best,et al.  CT measurements of lung density in life can quantitate distal airspace enlargement--an essential defining feature of human emphysema. , 1988, The American review of respiratory disease.

[17]  H. Sostman,et al.  [Quantification of pulmonary emphysema with computerized tomography. Comparison with various methods]. , 1995, La Radiologia medica.

[18]  Kunihiro Yagihashi,et al.  Morphological Progression of Emphysema on Thin-section CT: Analysis of Longitudinal Change in the Number and Size of Low-Attenuation Clusters , 2006, Journal of computer assisted tomography.

[19]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[20]  P. Gevenois,et al.  Pulmonary emphysema: radiation dose and section thickness at multidetector CT quantification--comparison with macroscopic and microscopic morphometry. , 2007, Radiology.

[21]  B. Stoel,et al.  Detection of emphysema progression in alpha 1-antitrypsin deficiency using CT densitometry; Methodological advances , 2008, Respiratory research.

[22]  Jan Stolk,et al.  Optimization and Standardization of Lung Densitometry in the Assessment of Pulmonary Emphysema , 2004, Investigative radiology.

[23]  H A Vrooman,et al.  A randomized clinical trial of alpha(1)-antitrypsin augmentation therapy. , 1999, American journal of respiratory and critical care medicine.

[24]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[25]  D. Altman,et al.  Applying the right statistics: analyses of measurement studies , 2003, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[26]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[27]  E. Hoffman,et al.  Quantification of pulmonary emphysema from lung computed tomography images. , 1997, American journal of respiratory and critical care medicine.

[28]  N J Morrison,et al.  Quantitation of emphysema by computed tomography using a "density mask" program and correlation with pulmonary function tests. , 1990, Chest.

[29]  M. Reiser,et al.  Automated classification of normal and pathologic pulmonary tissue by topological texture features extracted from multi-detector CT in 3D , 2008, European Radiology.

[30]  B. Hochhegger,et al.  CT of pulmonary emphysema: current status, challenges, and future directions , 2009, European Radiology.

[31]  Phillips Yy,et al.  Standards for the diagnosis and care of patients with chronic obstructive pulmonary disease (COPD) and asthma. This official statement of the American Thoracic Society was adopted by the ATS Board of Directors, November 1986. , 1987, The American review of respiratory disease.

[32]  J. Remy,et al.  Longitudinal follow-up study of smoker's lung with thin-section CT in correlation with pulmonary function tests. , 2002, Radiology.

[33]  Stefano Diciotti,et al.  Whole-lung densitometry versus visual assessment of emphysema , 2009, European Radiology.

[34]  N. Müller,et al.  "Density mask". An objective method to quantitate emphysema using computed tomography. , 1988, Chest.

[35]  H. Coxson,et al.  Computed tomography and monitoring of emphysema , 2007, European Respiratory Journal.

[36]  G. Laszlo,et al.  Computed tomography in pulmonary emphysema. , 1982, Clinical radiology.