A method for evaluating the performance of computer-aided detection of pulmonary nodules in lung cancer CT screening: detection limit for nodule size and density.

OBJECTIVE We propose the application of virtual nodules to evaluate the performance of computer-aided detection (CAD) of lung nodules in cancer screening using low-dose CT. METHODS The virtual nodules were generated based on the spatial resolution measured for a CT system used in an institution providing cancer screening and were fused into clinical lung images obtained at that institution, allowing site specificity. First, we validated virtual nodules as an alternative to artificial nodules inserted into a phantom. In addition, we compared the results of CAD analysis between the real nodules (n = 6) and the corresponding virtual nodules. Subsequently, virtual nodules of various sizes and contrasts between nodule density and background density (ΔCT) were inserted into clinical images (n = 10) and submitted for CAD analysis. RESULTS In the validation study, 46 of 48 virtual nodules had the same CAD results as artificial nodules (kappa coefficient = 0.913). Real nodules and the corresponding virtual nodules showed the same CAD results. The detection limits of the tested CAD system were determined in terms of size and density of peripheral lung nodules; we demonstrated that a nodule with a 5-mm diameter was detected when the nodule had a ΔCT > 220 HU. CONCLUSION Virtual nodules are effective in evaluating CAD performance using site-specific scan/reconstruction conditions. Advances in knowledge: Virtual nodules can be an effective means of evaluating site-specific CAD performance. The methodology for guiding the detection limit for nodule size/density might be a useful evaluation strategy.

[1]  Marcos Salganicoff,et al.  Benefit of computer-aided detection analysis for the detection of subsolid and solid lung nodules on thin- and thick-section CT. , 2013, AJR. American journal of roentgenology.

[2]  Bertram J Jobst,et al.  Computer-aided detection of artificial pulmonary nodules using an ex vivo lung phantom: influence of exposure parameters and iterative reconstruction. , 2015, European journal of radiology.

[3]  Kyung Soo Lee,et al.  Computer-Aided Detection of Lung Nodules: Influence of the Image Reconstruction Kernel for Computer-Aided Detection Performance , 2010, Journal of computer assisted tomography.

[4]  K. Murao,et al.  Feasible Method to Assess the Performance of a Lung Cancer CT Screening CAD System in Clinical Practice: Dependence on Nodule Size and Density , 2014 .

[5]  K. Murao,et al.  Accuracy of lung nodule density on HRCT: analysis by PSF‐based image simulation , 2012, Journal of applied clinical medical physics.

[6]  D. Aberle,et al.  Results of initial low-dose computed tomographic screening for lung cancer. , 2013, The New England journal of medicine.

[7]  Toru Matsumoto,et al.  Determination of point spread function in computed tomography accompanied with verification. , 2009, Medical physics.

[8]  A. Huber,et al.  Lung cancer screening with CT: evaluation of radiologists and different computer assisted detection software (CAD) as first and second readers for lung nodule detection at different dose levels. , 2013, European journal of radiology.

[9]  Toru Matsumoto,et al.  Imaging of small spherical structures in CT: simulation study using measured point spread function , 2007, Medical & Biological Engineering & Computing.

[10]  Kunio Doi,et al.  Evaluation of automated lung nodule detection on low-dose computed tomography scans from a lung cancer screening program(1). , 2005, Academic radiology.

[11]  K. Awai,et al.  Pulmonary nodules at chest CT: effect of computer-aided diagnosis on radiologists' detection performance. , 2004, Radiology.

[12]  H. Genant,et al.  Accuracy of CT-based thickness measurement of thin structures: modeling of limited spatial resolution in all three dimensions. , 2002, Medical physics.

[13]  Masaki Ohkubo,et al.  Accurate determination of CT point‐spread‐function with high precision , 2013, Journal of applied clinical medical physics.

[14]  W A Kalender,et al.  Measurement of slice sensitivity profiles in spiral CT. , 1994, Medical physics.

[15]  Toru Matsumoto,et al.  An effective method to verify line and point spread functions measured in computed tomography. , 2006, Medical physics.

[16]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[17]  Y. Tsuda,et al.  The Development and Use of a Chest Phantom for Optimizing Scanning Techniques on a Variety of Low‐Dose Helical Computed Tomography Devices , 2003, Journal of computer assisted tomography.

[18]  K. Murao,et al.  Application of CT-PSF-based computer-simulated lung nodules for evaluating the accuracy of computer-aided volumetry , 2012, Radiological Physics and Technology.

[19]  Jacob D. Furst,et al.  Consensus Versus Disagreement in Imaging Research: a Case Study Using the LIDC Database , 2012, Journal of Digital Imaging.

[20]  Toru Matsumoto,et al.  Image filtering as an alternative to the application of a different reconstruction kernel in CT imaging: feasibility study in lung cancer screening. , 2011, Medical physics.

[21]  Wiro J Niessen,et al.  Imaging of small high-density structures in CT A phantom study. , 2006, Academic radiology.

[22]  Hoen-oh Shin,et al.  Insertion of virtual pulmonary nodules in CT data of the chest: development of a software tool , 2006, European Radiology.

[23]  Ekta Dharaiya,et al.  Lung nodule CAD software as a second reader: a multicenter study. , 2008, Academic radiology.

[24]  S. Sone,et al.  Small peripheral lung carcinomas with five-year post-surgical follow-up: assessment by semi-automated volumetric measurement of tumour size, CT value and growth rate on TSCT , 2011, European Radiology.

[25]  Luca Bogoni,et al.  Performance of computer-aided detection of pulmonary nodules in low-dose CT , 2018 .