Diagnostic performance of a prototype dual-energy chest imaging system ROC analysis.

RATIONALE AND OBJECTIVES To assess the performance of an experimental prototype dual-energy (DE) chest imaging system in comparison to digital radiography (DR) in detection and characterization of lung lesions using receiver-operating characteristic (ROC) tests. MATERIALS AND METHODS A cohort of 129 patients (80 M, 49 F; mean age, 64.8 years) was drawn from a trial of patients referred for percutaneous biopsy of a lung lesion. DR and DE images were acquired of each patient (posteroanterior view) before biopsy using a prototype system developed in our laboratory. The system incorporated a flat-panel detector and previously reported imaging techniques optimized such that the total dose for the DE image was equivalent to that of a DR acquisition. Each DE image was decomposed to three components (soft-tissue, bone, and composite "equivalent radiograph") by log subtraction with optimized noise reduction techniques. ROC tests were performed to evaluate the diagnostic performance of DR imaging in comparison to DE for nodule detection, with 258 left/right "half-chest" images derived from the 129 cases to give a roughly equal number of disease and normal cases. Five chest radiologists scored 258 half-chest DE and 258 half-chest DR (516 in total) images on a 5-point scale, and results (including ROC and area under the curve [AUC]) were analyzed using the ROCkit toolkit. Statistical significance in the observed differences was evaluated in terms of P values determined by a z test. Performance was analyzed for all cases pooled (258 DE vs. 258 DR images) and by retrospective stratification of the data according to nodule size, density, gender, lung region, and chest thickness. RESULTS For results pooled over the entire cohort, there was no significant difference in ROC performance between DE and DR (AUC(DE) = 0.795 AUC(DR) = 0.789; P = .696). This finding is believed to be due to a large portion of lesions that were fairly conspicuous in either modality. In retrospective analysis of subgroups, a significant advantage was measured for DE imaging of small nodules (<1 cm diameter; AUC(DE) = 0.778; AUC(DR) = 0.706; P = .056), for nodules located in the right upper lobe (AUC(DE) = 0.836; AUC(DR) = 0.779; P = .003), and nodules located in right lower lobe (AUC(DE) = 0.804; AUC(DR) = 0.752; P = .054). DE imaging provided a clinically significant differential diagnosis in approximately one third of patients (49/158) (ie, disease cases in which the lesion was correctly identified in DE [(ROC rating > or =3], but missed in DR [ROC rating < or =2]). DE imaging also appeared to provide more definitive diagnosis (ie, a greater proportion of ROC ratings = 5 and 1 for identification of disease and normal cases, respectively), which presumably translates to increased confidence and a steeper ROC curve (even if the AUC are the same). CONCLUSIONS DE imaging at dose equivalent to DR exhibited similar overall ROC performance to DR, although the radiologists noted qualitatively improved visualization (eg, improved characterization of lesion margins, visibility of calcifications and rib fractures). DE imaging demonstrated significant improvement in diagnostic performance for specific subgroups, including subcentimeter lung lesions and lesions in the right upper lobe, each of which is a potentially important factor in detecting early-stage malignancy.

[1]  Richard L. Van Metter,et al.  New automatic tone-scale method for computed radiography , 1998, Medical Imaging.

[2]  L. S. Broderick,et al.  Dual-energy subtraction chest radiography: what to look for beyond calcified nodules. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[3]  M. Decramer,et al.  Imaging in lung disease , 2002, European Respiratory Journal.

[4]  D. Sugarbaker,et al.  Screening for Lung Cancer: Another Look; A Different View , 1997 .

[5]  W. Travis Pathology of lung cancer. , 2002, Clinics in chest medicine.

[6]  C A Mistretta,et al.  A correlated noise reduction algorithm for dual-energy digital subtraction angiography. , 1989, Medical physics.

[7]  Thomas Beyer,et al.  Radiation exposure of patients undergoing whole-body dual-modality 18F-FDG PET/CT examinations. , 2005, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[8]  S. Swensen,et al.  Lung cancer screening with CT: Mayo Clinic experience. , 2003, Radiology.

[9]  David Gur,et al.  Selection of a rating scale in receiver operating characteristic studies: some remaining issues. , 2008, Academic radiology.

[10]  R. Glynn,et al.  The Wilcoxon Signed Rank Test for Paired Comparisons of Clustered Data , 2006, Biometrics.

[11]  D. Dorfman,et al.  Maximum likelihood estimation of parameters of signal detection theory—A direct solution , 1968, Psychometrika.

[12]  E Samei,et al.  Detection of subtle lung nodules: relative influence of quantum and anatomic noise on chest radiographs. , 1999, Radiology.

[13]  J H Siewerdsen,et al.  Cardiac gating with a pulse oximeter for dual-energy imaging. , 2008, Physics in medicine and biology.

[14]  Yoshifumi Yasuhara,et al.  Clinical evaluation of pulmonary nodules with dual-exposure dual-energy subtraction chest radiography. , 2005, Radiation medicine.

[15]  L T Niklason,et al.  Calcification in pulmonary nodules: detection with dual-energy digital radiography. , 1986, Radiology.

[16]  Hany Kashani,et al.  Development of a high-performance dual-energy chest imaging system: initial investigation of diagnostic performance. , 2009, Academic radiology.

[17]  L. Haramati,et al.  Complications of CT scan-guided lung biopsy: lesion size and depth matter. , 2004, Chest.

[18]  Jens Ricke,et al.  CsI-detector-based dual-exposure dual energy in chest radiography for lung nodule detection: results of an international multicenter trial , 2008, European Radiology.

[19]  J H Siewerdsen,et al.  Investigation of lung nodule detectability in low-dose 320-slice computed tomography. , 2009, Medical physics.

[20]  Kenya Murase,et al.  Detectability of lung nodules using flat panel detector with dual energy subtraction by two shot method: evaluation by ROC method. , 2007, European journal of radiology.

[21]  Bernhard Erich Hermann Claus,et al.  Development and characterization of a dual-energy subtraction imaging system for chest radiography based on CsI:Tl amorphous silicon flat-panel technology , 2001, SPIE Medical Imaging.

[22]  Ehsan Samei,et al.  An experimental comparison of detector performance for direct and indirect digital radiography systems. , 2003, Medical physics.

[23]  W R Brody,et al.  A method for selective tissue and bone visualization using dual energy scanned projection radiography. , 1981, Medical physics.

[24]  N. A. Shkumat,et al.  High-performance dual-energy imaging with a flat-panel detector: imaging physics from blackboard to benchtop to bedside , 2006, SPIE Medical Imaging.

[25]  Frank Fischbach,et al.  Clinical results of CsI-detector-based dual-exposure dual energy in chest radiography , 2003, European Radiology.

[26]  Jeffrey H. Siewerdsen,et al.  MO‐D‐L100J‐09: A Multi‐Resolution, Multi‐Scale, Mutual Information Technique for Registration of High‐ and Low‐KVp Projections in Dual‐Energy Imaging , 2007 .

[27]  J Yorkston,et al.  Multiscale deformable registration for dual-energy x-ray imaging. , 2009, Medical physics.

[28]  M. Miyagawa,et al.  Detection of lung cancer using single-exposure dual-energy subtraction chest radiography , 2007, Radiation Medicine.

[29]  W. Thurlbeck,et al.  Number of alveoli in the human lung. , 1972, Journal of applied physiology.

[30]  J Yorkston,et al.  Empirical investigation of the signal performance of a high-resolution, indirect detection, active matrix flat-panel imager (AMFPI) for fluoroscopic and radiographic operation. , 1997, Medical physics.

[31]  J. Austin,et al.  Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially resectable lesion evident in retrospect. , 1992, Radiology.

[32]  Caroline Reinhold,et al.  Fundamentals of clinical research for radiologists , 2005 .

[33]  W. E. Miller,et al.  Lung cancer detected during a screening program using four-month chest radiographs. , 1983, Radiology.

[34]  M. Sonoda,et al.  Computed radiography utilizing scanning laser stimulated luminescence. , 1983, Radiology.

[35]  D. Christiani,et al.  Association between diet and lung cancer location. , 1998, American journal of respiratory and critical care medicine.

[36]  C Coblentz,et al.  The secondary pulmonary lobule: normal and abnormal CT appearances. , 1988, AJR. American journal of roentgenology.

[37]  D. Lynch,et al.  The National Lung Screening Trial: overview and study design. , 2011, Radiology.

[38]  Juan M. Taveras,et al.  Radiology : diagnosis, imaging, intervention , 1986 .

[39]  Jeffrey H Siewerdsen,et al.  Cascaded systems analysis of noise reduction algorithms in dual-energy imaging. , 2008, Medical physics.

[40]  C. Mountain,et al.  Revisions in the International System for Staging Lung Cancer. , 1997, Chest.

[41]  K. P. Kim,et al.  Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer. , 2009, Archives of internal medicine.

[42]  Jonathan M. Samet,et al.  Epidemiology of Lung Cancer* , 2002 .

[43]  J. Austin,et al.  Missed non-small cell lung cancer: radiographic findings of potentially resectable lesions evident only in retrospect. , 2003, Radiology.

[44]  I. Blevis,et al.  Digital radiology using active matrix readout of amorphous selenium: construction and evaluation of a prototype real-time detector. , 1997, Medical physics.

[45]  M J Yaffe,et al.  Theoretical optimization of dual-energy x-ray imaging with application to mammography. , 1985, Medical physics.

[46]  Richard L. Van Metter,et al.  Enhanced latitude for digital projection radiography , 1999, Medical Imaging.

[47]  Claude Deschamps,et al.  The role of positron emission tomography in the management of non-small cell lung cancer. , 2009, Canadian journal of surgery. Journal canadien de chirurgie.

[48]  S. Webb The Physics of Medical Imaging , 1990 .

[49]  C. Metz,et al.  "Proper" Binormal ROC Curves: Theory and Maximum-Likelihood Estimation. , 1999, Journal of mathematical psychology.

[50]  K. Kubo,et al.  Bradykinin stimulates type II alveolar cells to release neutrophil and monocyte chemotactic activity and inflammatory cytokines. , 1998, The American journal of pathology.

[51]  Jon C. Aster,et al.  Robbins BASIC PATHOLOGY , 2002, Robbins Basic Pathology.

[52]  C A Mistretta,et al.  Conventional chest radiography vs dual-energy computed radiography in the detection and characterization of pulmonary nodules. , 1994, AJR. American journal of roentgenology.

[53]  A pause for thought on lung cancer screening , 2009, Canadian Medical Association Journal.

[54]  Berkman Sahiner,et al.  Quasi-continuous and discrete confidence rating scales for observer performance studies: Effects on ROC analysis. , 2007, Academic radiology.

[55]  P. Goldstraw The 7th Edition of TNM in Lung Cancer: what now? , 2009, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[56]  B. Takkouche,et al.  The epidemiology of lung cancer: Review of risk factors and Spanish data , 1996, European Journal of Epidemiology.

[57]  L. Tanoue Computed Tomography — An Increasing Source of Radiation Exposure , 2009 .

[58]  J Yorkston,et al.  Dual-energy imaging of the chest: optimization of image acquisition techniques for the 'bone-only' image. , 2008, Medical physics.

[59]  J Yorkston,et al.  Optimization of image acquisition techniques for dual-energy imaging of the chest. , 2007, Medical physics.

[60]  Shoji Kido,et al.  Detection of simulated pulmonary nodules by single-exposure dual-energy computed radiography of the chest: effect of a computer-aided diagnosis system (Part 2). , 2002, European journal of radiology.

[61]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[62]  W. Heindel,et al.  Screening for early lung cancer with low-dose spiral CT: prevalence in 817 asymptomatic smokers. , 2002, Radiology.

[63]  Peter Vock,et al.  Single-exposure dual-energy subtraction chest radiography: Detection of pulmonary nodules and masses in clinical practice , 2007, European Radiology.

[64]  N. Obuchowski ROC analysis. , 2005, AJR. American journal of roentgenology.

[65]  L W Hedlund,et al.  Postnatal growth and size of the pulmonary acinus and secondary lobule in man. , 1983, AJR. American journal of roentgenology.

[66]  H. Abdi The Bonferonni and Šidák Corrections for Multiple Comparisons , 2006 .

[67]  W. Kalender,et al.  An algorithm for noise suppression in dual energy CT material density images. , 1988, IEEE transactions on medical imaging.