Computer-aided diagnosis for the detection and classification of lung cancers on chest radiographs ROC analysis of radiologists' performance.

RATIONALE AND OBJECTIVES The aim of the study is to investigate the effect of a computer-aided diagnostic (CAD) scheme on radiologist performance in the detection of lung cancers on chest radiographs. MATERIALS AND METHODS We combined two independent CAD schemes for the detection and classification of lung nodules into one new CAD scheme by use of a database of 150 chest images, including 108 cases with solitary pulmonary nodules and 42 cases without nodules. For the observer study, we selected 48 chest images, including 24 lung cancers, 12 benign nodules, and 12 cases without nodules, from the database to investigate radiologist performance in the detection of lung cancers. Nine radiologists participated in a receiver operating characteristic (ROC) study in which cases were interpreted first without and then with computer output, which indicated locations of possible lung nodules, together with a five-color scale illustrating the computer-estimated likelihood of malignancy of the detected nodules. RESULTS Performance of the CAD scheme indicated that sensitivity in detecting lung nodules was 80.6%, with 1.2 false-positive results per image, and sensitivity and specificity for classification of nodules by use of the same database for training and testing the CAD scheme were 87.7% and 66.7%, respectively. Average area under the ROC curve value for detection of lung cancers improved significantly (P = .008) from without (0.724) to with CAD (0.778). CONCLUSION This type of CAD scheme, which includes two functions, namely detection and classification, can improve radiologist accuracy in the diagnosis of lung cancer.

[1]  S. Armato,et al.  Automated detection of lung nodules in CT scans: preliminary results. , 2001, Medical physics.

[2]  M. McNitt-Gray,et al.  A pattern classification approach to characterizing solitary pulmonary nodules imaged on high resolution CT: preliminary results. , 1999, Medical physics.

[3]  O S Miettinen,et al.  Screening for lung cancer. , 2000, Radiologic clinics of North America.

[4]  Kunio Doi,et al.  Computer-aided diagnosis to distinguish benign from malignant solitary pulmonary nodules on radiographs: ROC analysis of radiologists' performance--initial experience. , 2003, Radiology.

[5]  C E Metz,et al.  Some practical issues of experimental design and data analysis in radiological ROC studies. , 1989, Investigative radiology.

[6]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[7]  David Gur,et al.  A comparison of two data analyses from two observer performance studies using Jackknife ROC and JAFROC. , 2005, Medical physics.

[8]  Quynh-Thu Le,et al.  Non-small cell lung cancer: Clinical practice guidelines in oncology , 2006 .

[9]  K. Doi,et al.  Computerized scheme for determination of the likelihood measure of malignancy for pulmonary nodules on low-dose CT images. , 2003, Medical physics.

[10]  M. Giger,et al.  Computerized Detection of Pulmonary Nodules in Computed Tomography Images , 1994, Investigative radiology.

[11]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[12]  M. Giger,et al.  Image feature analysis and computer-aided diagnosis in digital radiography. 3. Automated detection of nodules in peripheral lung fields. , 1988, Medical physics.

[13]  C. Metz,et al.  Visual detection and localization of radiographic images. , 1975, Radiology.

[14]  K. Berbaum,et al.  Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. , 1992, Investigative radiology.

[15]  James L Mulshine,et al.  Lung cancer screening. , 2005, The oncologist.

[16]  K. Doi,et al.  Image feature analysis for computer-aided diagnosis: detection of right and left hemidiaphragm edges and delineation of lung field in chest radiographs. , 1996, Medical physics.

[17]  C E Metz,et al.  The "proper" binormal model: parametric receiver operating characteristic curve estimation with degenerate data. , 1997, Academic radiology.

[18]  K. Doi,et al.  Effect of a computer-aided diagnosis scheme on radiologists' performance in detection of lung nodules on radiographs. , 1996, Radiology.

[19]  OS Miettinen,et al.  Early Lung Cancer Action Project , 1999, The Lancet.

[20]  B J Flehinger,et al.  Non-small-cell lung cancer: results of the New York screening program. , 1984, Radiology.

[21]  M. Melamed,et al.  The effect of surgical treatment on survival from early lung cancer. Implications for screening. , 1992, Chest.

[22]  T. Naruke,et al.  Survival for clinical stage I lung cancer not surgically treated. Comparison between screen‐detected and symptom‐detected cases , 1992, Cancer.

[23]  Arunabha S. Roy,et al.  Automated lung nodule classification following automated nodule detection on CT: a serial approach. , 2003, Medical physics.

[24]  Matthew T. Freedman,et al.  Computer-aided detection of lung cancer on chest radiographs: effect of machine CAD false-positive locations on radiologists' behavior , 2002, SPIE Medical Imaging.

[25]  Feng Li,et al.  Mass screening for lung cancer with mobile spiral computed tomography scanner , 1998, The Lancet.

[26]  M. Giger,et al.  Development of an improved CAD scheme for automated detection of lung nodules in digital chest images. , 1997, Medical physics.

[27]  W. E. Miller,et al.  Lung cancer detected during a screening program using four-month chest radiographs. , 1983, Radiology.

[28]  O. Miettinen,et al.  Early Lung Cancer Action Project: overall design and findings from baseline screening , 1999, The Lancet.

[29]  J C Wandtke,et al.  Computerized search of chest radiographs for nodules. , 1986, Investigative radiology.

[30]  K. Doi,et al.  Computerized scheme for automated detection of lung nodules in low-dose computed tomography images for lung cancer screening. , 2004, Academic radiology.

[31]  S. Armato,et al.  Computerized detection of pulmonary nodules on CT scans. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[32]  Dev P Chakraborty,et al.  Observer studies involving detection and localization: modeling, analysis, and validation. , 2004, Medical physics.

[33]  David Spizarny,et al.  Final results of the Lung Screening Study, a randomized feasibility study of spiral CT versus chest X-ray screening for lung cancer. , 2005, Lung cancer.

[34]  D. Chakraborty,et al.  Free-response methodology: alternate analysis and a new observer-performance experiment. , 1990, Radiology.

[35]  K. Doi,et al.  Effect of high sensitivity in a computerized scheme for detecting extremely subtle solitary pulmonary nodules in chest radiographs: observer performance study. , 2003, Academic radiology.

[36]  K Nakamura,et al.  Computerized analysis of the likelihood of malignancy in solitary pulmonary nodules with use of artificial neural networks. , 2000, Radiology.

[37]  Berkman Sahiner,et al.  Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. , 2002, Medical physics.

[38]  M. J. Carreira,et al.  Computer-aided diagnoses: automatic detection of lung nodules. , 1998, Medical physics.

[39]  K. Doi,et al.  Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system. , 2004, AJR. American journal of roentgenology.

[40]  J. Austin,et al.  Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially resectable lesion evident in retrospect. , 1992, Radiology.

[41]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in helical CT images based on an improved template-matching technique , 2001, IEEE Transactions on Medical Imaging.

[42]  K. Doi,et al.  Image feature analysis for computer-aided diagnosis: accurate determination of ribcage boundary in chest radiographs. , 1995, Medical physics.

[43]  M. Giger,et al.  Potential usefulness of computerized nodule detection in screening programs for lung cancer. , 1992, Investigative radiology.