Repeatability of 18F‐FDG PET radiomic features: A phantom study to explore sensitivity to image reconstruction settings, noise, and delineation method

Background 18F‐fluoro‐2‐deoxy‐D‐Glucose positron emission tomography (18F‐FDG PET) radiomics has the potential to guide the clinical decision making in cancer patients, but validation is required before radiomics can be implemented in the clinical setting. The aim of this study was to explore how feature space reduction and repeatability of 18F‐FDG PET radiomic features are affected by various sources of variation such as underlying data (e.g., object size and uptake), image reconstruction methods and settings, noise, discretization method, and delineation method. Methods The NEMA image quality phantom was scanned with various sphere‐to‐background ratios (SBR), simulating different activity uptakes, including spheres with low uptake, that is, SBR smaller than 1. Furthermore, images of a phantom containing 3D printed inserts reflecting realistic heterogeneity uptake patterns were acquired. Data were reconstructed using various matrix sizes, reconstruction algorithms, and scan durations (noise). For every specific reconstruction and noise level, ten statistically equal replicates were generated. The phantom inserts were delineated using CT and PET‐based segmentation methods. A total of 246 radiomic features was extracted from each image dataset. Images were discretized with a fixed number of 64 bins (FBN) and a fixed bin width (FBW) of 0.25 for the high and a FBW of 0.05 for the low uptake data. In terms of feature reduction, we determined the impact of these factors on the composition of feature clusters, which were defined on the basis of Spearman's correlation matrices. To assess feature repeatability, the intraclass correlation coefficient was calculated over the ten replicates. Results In general, larger spheres with high uptake resulted in better repeatability compared to smaller low uptake spheres. In terms of repeatability, features extracted from heterogeneous phantom inserts were comparable to features extracted from bigger high uptake spheres. For example, for an EARL‐compliant reconstruction, larger and smaller high uptake spheres yielded good repeatability for 32% and 30% of the features, while the heterogeneous inserts resulted in 34% repeatable features. For the low uptake spheres, this was the case for 22% and 20% of the features for bigger and smaller spheres, respectively. Images reconstructed with point‐spread‐function (PSF) resulted in the highest repeatability when compared with OSEM or time‐of‐flight, for example, 53%, 30%, and 32% of repeatable features, respectively (for unsmoothed data, discretized with FBN, 300 s scan duration). Reducing image noise (increasing scan duration and smoothing) and using CT‐based segmentation for the low uptake spheres yielded improved repeatability. FBW discretization resulted in higher repeatability than FBN discretization, for example, 89% and 35% of the features, respectively (for the EARL‐compliant reconstruction and larger high uptake spheres). Conclusion Feature space reduction and repeatability of 18F‐FDG PET radiomic features depended on all studied factors. The high sensitivity of PET radiomic features to image quality suggests that a high level of image acquisition and preprocessing standardization is required to be used as clinical imaging biomarker.

[1]  M. Mukaka,et al.  Statistics corner: A guide to appropriate use of correlation coefficient in medical research. , 2012, Malawi medical journal : the journal of Medical Association of Malawi.

[2]  Masoom A. Haider,et al.  Radiomics-based Prognosis Analysis for Non-Small Cell Lung Cancer , 2017, Scientific Reports.

[3]  O. van Gómez López,et al.  Heterogeneity in [18F]Fluorodeoxyglucose Positron Emission Tomography/Computed Tomography of Non–Small Cell Lung Carcinoma and Its Relationship to Metabolic Parameters and Pathologic Staging , 2014, Molecular imaging.

[4]  P. Lambin,et al.  Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach , 2014, Nature Communications.

[5]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[6]  Ji-Hoon Jung,et al.  Prognostic Significance of Intratumoral Metabolic Heterogeneity on 18F-FDG PET/CT in Pathological N0 Non–Small Cell Lung Cancer , 2015, Clinical nuclear medicine.

[7]  Dong Soo Lee,et al.  Autoclustering of Non-small Cell Lung Carcinoma Subtypes on 18F-FDG PET Using Texture Analysis: A Preliminary Result , 2014, Nuclear Medicine and Molecular Imaging.

[8]  Geoffrey G. Zhang,et al.  Reproducibility of F18‐FDG PET radiomic features for different cervical tumor segmentation methods, gray‐level discretization, and reconstruction algorithms , 2017, Journal of applied clinical medical physics.

[9]  Dimitris Visvikis,et al.  Characterization of PET/CT images using texture analysis: the past, the present… any future? , 2016, European Journal of Nuclear Medicine and Molecular Imaging.

[10]  A. Rahmim,et al.  Resolution modeling in PET imaging: theory, practice, benefits, and pitfalls. , 2013, Medical physics.

[11]  M. Soussan,et al.  18F-FDG PET-Derived Textural Indices Reflect Tissue-Specific Uptake Pattern in Non-Small Cell Lung Cancer , 2015, PloS one.

[12]  El Naqa,et al.  A radiomics model from joint FDG-PET and MRI texture features for the prediction of lung metastases in soft-tissue sarcomas of the extremities , 2015 .

[13]  Wolfgang Weber,et al.  Reliability of PET/CT Shape and Heterogeneity Features in Functional and Morphologic Components of Non–Small Cell Lung Cancer Tumors: A Repeatability Analysis in a Prospective Multicenter Cohort , 2016, The Journal of Nuclear Medicine.

[14]  W. Huang,et al.  Value of Metabolic Tumor Volume on Repeated 18F-FDG PET/CT for Early Prediction of Survival in Locally Advanced Non–Small Cell Lung Cancer Treated with Concurrent Chemoradiotherapy , 2014, The Journal of Nuclear Medicine.

[15]  Eric J. W. Visser,et al.  FDG PET/CT: EANM procedure guidelines for tumour imaging: version 2.0 , 2014, European Journal of Nuclear Medicine and Molecular Imaging.

[16]  L. Martí-Bonmatí,et al.  Evaluation of PET texture features with heterogeneous phantoms: complementarity and effect of motion and segmentation method , 2017, Physics in medicine and biology.

[17]  Irène Buvat,et al.  Tumor Texture Analysis in 18F-FDG PET: Relationships Between Texture Parameters, Histogram Indices, Standardized Uptake Values, Metabolic Volumes, and Total Lesion Glycolysis , 2014, The Journal of Nuclear Medicine.

[18]  Andre Dekker,et al.  Radiomics: the process and the challenges. , 2012, Magnetic resonance imaging.

[19]  Irène Buvat,et al.  Multiscale Texture Analysis: From 18F-FDG PET Images to Histologic Images , 2016, The Journal of Nuclear Medicine.

[20]  Fei Yang,et al.  Quantitative radiomics: impact of stochastic effects on textural feature analysis implies the need for standards , 2015, Journal of medical imaging.

[21]  Irène Buvat,et al.  Understanding Changes in Tumor Texture Indices in PET: A Comparison Between Visual Assessment and Index Values in Simulated and Patient Data , 2017, The Journal of Nuclear Medicine.

[22]  Thomas Carlier,et al.  Revisiting the Robustness of PET-Based Textural Features in the Context of Multi-Centric Trials , 2016, PloS one.

[23]  Vicky Goh,et al.  Are Pretreatment 18F-FDG PET Tumor Textural Features in Non–Small Cell Lung Cancer Associated with Response and Survival After Chemoradiotherapy? , 2013, The Journal of Nuclear Medicine.

[24]  Ana María García Vicente,et al.  Heterogeneity in [¹⁸F]fluorodeoxyglucose positron emission tomography/computed tomography of non-small cell lung carcinoma and its relationship to metabolic parameters and pathologic staging. , 2014, Molecular imaging.

[25]  Robert J. Gillies,et al.  The effect of SUV discretization in quantitative FDG-PET Radiomics: the need for standardized methodology in tumor texture analysis , 2015, Scientific Reports.

[26]  Vicky Goh,et al.  The effects of segmentation algorithms on the measurement of 18F-FDG PET texture parameters in non-small cell lung cancer , 2017, EJNMMI Research.

[27]  Arman Rahmim,et al.  The impact of image reconstruction settings on 18F-FDG PET radiomic features: multi-scanner phantom and patient studies , 2017, European Radiology.

[28]  M. Hatt,et al.  18F-FDG PET Uptake Characterization Through Texture Analysis: Investigating the Complementary Nature of Heterogeneity and Functional Tumor Volume in a Multi–Cancer Site Patient Cohort , 2015, The Journal of Nuclear Medicine.

[29]  Ronald Boellaard,et al.  Repeatability of Radiomic Features in Non-Small-Cell Lung Cancer [18F]FDG-PET/CT Studies: Impact of Reconstruction and Delineation , 2016, Molecular Imaging and Biology.

[30]  M. Hatt,et al.  Intratumor Heterogeneity Characterized by Textural Features on Baseline 18F-FDG PET Images Predicts Response to Concomitant Radiochemotherapy in Esophageal Cancer , 2011, The Journal of Nuclear Medicine.

[31]  A. Zwanenburg,et al.  EP-1677: Multicentre initiative for standardisation of image biomarkers , 2017 .

[32]  Ana María García Vicente,et al.  Heterogeneity in [18F]fluorodeoxyglucose positron emission tomography/computed tomography of non-small cell lung carcinoma and its relationship to metabolic parameters and pathologic staging. , 2014, Molecular imaging.

[33]  M. A. Garcia-Fidalgo,et al.  Identification of low variability textural features for heterogeneity quantification of 18F-FDG PET/CT imaging. , 2016, Revista espanola de medicina nuclear e imagen molecular.

[34]  M. L. Belli,et al.  Quantifying the robustness of [18F]FDG-PET/CT radiomic features with respect to tumor delineation in head and neck and pancreatic cancer patients. , 2018, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[35]  P. Lambin,et al.  Machine Learning methods for Quantitative Radiomic Biomarkers , 2015, Scientific Reports.

[36]  W. Oyen,et al.  FDG PET and PET/CT: EANM procedure guidelines for tumour PET imaging: version 1.0 , 2009, European Journal of Nuclear Medicine and Molecular Imaging.

[37]  I. El Naqa,et al.  A radiomics model from joint FDG-PET and MRI texture features for the prediction of lung metastases in soft-tissue sarcomas of the extremities , 2015, Physics in medicine and biology.

[38]  R. Jeraj,et al.  Variability of textural features in FDG PET images due to different acquisition modes and reconstruction parameters , 2010, Acta oncologica.

[39]  G. Parker,et al.  Imaging Intratumor Heterogeneity: Role in Therapy Response, Resistance, and Clinical Outcome , 2014, Clinical Cancer Research.

[40]  M. Hatt,et al.  Robustness of intratumour 18F-FDG PET uptake heterogeneity quantification for therapy response prediction in oesophageal carcinoma , 2013, European Journal of Nuclear Medicine and Molecular Imaging.

[41]  J. S. Karp,et al.  Recent developments in time-of-flight PET , 2016, EJNMMI Physics.

[42]  D. Townsend,et al.  Impact of Image Reconstruction Settings on Texture Features in 18F-FDG PET , 2015, The Journal of Nuclear Medicine.