Comparing the performance of trained radiographers against experienced radiologists in the UK lung cancer screening (UKLS) trial.

OBJECTIVE To compare the performance of radiographers against that of radiologists for CT lung nodule detection in the UK Lung Cancer Screening (UKLS) pilot trial. METHODS Four radiographers, trained in CT nodule detection, and three radiologists were prospectively evaluated. 290 CTs performed for the UKLS were independently read by 2 radiologists and 2 radiographers. The reference standard comprised all radiologist-identified positive nodules after arbitration of discrepancies. For each radiographer and radiologist, relative sensitivity and average false positives (FPs) per case were compared for all cases read, as well as for subsets of cases read by each radiographer-radiologist combination (10 combinations). RESULTS 599 nodules in 209/290 (72.1%) CT studies comprised the reference standard. The relative mean (±standard deviation) sensitivity of the four radiographers was 71.6 ± 8.5% compared with 83.3 ± 8.1% for the three radiologists. Radiographers were less sensitive and detected more FPs per case than radiologists in 7/10 and 8/10 radiographer-radiologist combinations, respectively (ranges of difference 11.2-33.8% and 0.4-2.6; p < 0.05). In 3/10 and 2/10 combinations, there was no difference in sensitivity and FPs per case between radiographers and radiologists. For nodules ≥100 mm(3) in volume or ≥5 mm in maximum diameter, radiographers were relatively less sensitive than radiologists in only 5/10 radiographer-radiologist combinations (range of difference 16.1-30.6%; p < 0.05) and not significantly different in the remaining 5/10 combinations. CONCLUSION Although overall radiographer performance was lower than that of experienced radiologists in this study, some radiographer performances were comparable with that of radiologists. ADVANCES IN KNOWLEDGE Overall, radiographers were less sensitive than radiologists reading the same CTs and also displayed higher average FP detections per case when compared with a reference standard derived from radiologist readings. However, some radiographers compared favourably with radiologists, especially when considering larger potentially clinically relevant nodules. Thus, while probably not sensitive enough to function as first readers, radiographers may still be able to fulfil the role of an assistant reader-that is, as a first or concurrent reader, who presents detected nodules for verification to a reading radiologist.

[1]  W. Heindel,et al.  Detection of pulmonary nodules at multirow-detector CT: effectiveness of double reading to improve sensitivity at standard-dose and low-dose chest CT , 2004, European Radiology.

[2]  An observational study to evaluate the performance of units using two radiographers to read screening mammograms. , 2012, Clinical radiology.

[3]  A. Leung,et al.  Computer-aided detection (CAD) of lung nodules in CT scans: radiologist performance and reading time with incremental CAD assistance , 2010, European Radiology.

[4]  C. Lauridsen,et al.  Effect of a tele-training programme on radiographers in the interpretation of CT colonography. , 2012, European journal of radiology.

[5]  C Beigelman-Aubry,et al.  thorax - Évaluation de l’impact d’un système CAD sur la performance des radiologues pour la détection des nodules pulmonaires sur des examens scanographiques multicoupes du thorax , 2007 .

[6]  John K Field,et al.  CT screening for lung cancer: countdown to implementation. , 2013, The Lancet. Oncology.

[7]  Geoffrey McLennan,et al.  Assessment of radiologist performance in the detection of lung nodules: dependence on the definition of "truth". , 2009, Academic radiology.

[8]  P. Grenier,et al.  Computer-aided detection of solid lung nodules on follow-up MDCT screening: evaluation of detection, tracking, and reading time. , 2007, AJR. American journal of roentgenology.

[9]  J. Austin,et al.  Primary carcinoma of the lung overlooked at CT: analysis of findings in 14 patients. , 1996, Radiology.

[10]  B. van Ginneken,et al.  Computer Vision Tool and Technician as First Reader of Lung Cancer Screening CT Scans , 2016, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[11]  C. Gatsonis,et al.  Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening , 2012 .

[12]  Harry J de Koning,et al.  Lung cancer probability in patients with CT-detected pulmonary nodules: a prespecified analysis of data from the NELSON trial of low-dose CT screening. , 2014, The Lancet. Oncology.

[13]  M. Revel,et al.  Are two-dimensional CT measurements of small noncalcified pulmonary nodules reliable? , 2004, Radiology.

[14]  J. Jett,et al.  Components necessary for high-quality lung cancer screening: American College of Chest Physicians and American Thoracic Society Policy Statement. , 2015, Chest.

[15]  S W Duffy,et al.  Clinical Studies , 1877, Journal of Psychological Medicine and Mental Pathology (London, England : 1875).

[16]  H. Fenlon,et al.  Effect of Directed Training on Reader Performance for CT Colonography: Multicenter study , 2007 .

[17]  K. Ashizawa,et al.  Comparison of sensitivity of lung nodule detection between radiologists and technologists on low-dose CT lung cancer screening images. , 2012, The British journal of radiology.

[18]  R. Pauli,et al.  Radiographers as film readers in screening mammography: an assessment of competence under test and screening conditions. , 1996, The British journal of radiology.

[19]  N J Wald,et al.  UK Lung Screen (UKLS) nodule management protocol: modelling of a single screen randomised controlled trial of low-dose CT screening for lung cancer , 2011, Thorax.

[20]  K. Marten,et al.  Computer-assisted detection of pulmonary nodules: performance evaluation of an expert knowledge-based detection system in consensus reading with experienced and inexperienced chest radiologists , 2004, European Radiology.

[21]  Matthijs Oudkerk,et al.  Prospects for population screening and diagnosis of lung cancer , 2013, The Lancet.

[22]  Anthony J. Sherbondy,et al.  Pulmonary nodules on multi-detector row CT scans: performance comparison of radiologists and computer-aided detection. , 2005, Radiology.

[23]  Carlo Catalano,et al.  Computer-aided Detection (CAD) in Lung Cancer Screening at Chest MDCT: ROC Analysis of CAD Versus Radiologist Performance , 2007, Journal of thoracic imaging.

[24]  N J Wald,et al.  UK Lung Cancer RCT Pilot Screening Trial: baseline findings from the screening arm provide evidence for the potential implementation of lung cancer screening , 2015, Thorax.

[25]  Qiang Li,et al.  Recent progress in computer-aided diagnosis of lung nodules on thin-section CT , 2007, Comput. Medical Imaging Graph..

[26]  The impact of radiologists’ expertise on screen results decisions in a CT lung cancer screening trial , 2015, European Radiology.

[27]  H. Ohmatsu,et al.  Detection failures in spiral CT screening for lung cancer: analysis of CT findings. , 1999, Radiology.

[28]  V. Moyer Screening for Lung Cancer: U.S. Preventive Services Task Force Recommendation Statement , 2014, Annals of Internal Medicine.