The emerging role of radiation therapists in the contouring of organs at risk in radiotherapy: analysis of inter-observer variability with radiation oncologists for the chest and upper abdomen

Aims To compare the contouring of organs at risk (OAR) between a clinical specialist radiation therapist (CSRT) and radiation oncologists (ROs) with different levels of expertise (senior–SRO, junior–JRO, fellow–FRO). Methods On ten planning computed tomography (CT) image sets of patients undergoing breast radiotherapy (RT), the observers independently contoured the contralateral breast, heart, left anterior descending artery (LAD), oesophagus, kidney, liver, spinal cord, stomach and trachea. The CSRT was instructed by the JRO e SRO. The inter-observer variability of contoured volumes was measured using the Dice similarity coefficient (DSC) (threshold of ≥ 0.7 for good concordance) and the centre of mass distance (CMD). The analysis of variance (ANOVA) was performed and a p-value < 0.01 was considered statistically significant. Results Good overlaps (DSC > 0.7) were obtained for all OARs, except for LAD (DSC = 0.34 ± 0.17, mean ± standard deviation) and oesophagus (DSC = 0.66 ± 0.06, mean ± SD). The mean CMD < 1 cm was achieved for all the OARs, but spinal cord (CMD = 1.22 cm). By pairing the observers, mean DSC > 0.7 and mean CMD < 1 cm were achieved in all cases. The best overlaps were seen for the pairs JRO-CSRT(DSC = 0.82; CMD = 0.49 cm) and SRO-JRO (DSC = 0.80; CMD = 0.51 cm). Conclusions Overall, good concordance was found for all the observers. Despite the short training in contouring, CSRT obtained good concordance with his tutor (JRO). Great variability was seen in contouring the LAD, due to its difficult visualization and identification of CT scans without contrast.

[1]  R. Orecchia,et al.  Hypofractionated postmastectomy radiotherapy with helical tomotherapy in patients with immediate breast reconstruction: dosimetric results and acute/intermediate toxicity evaluation , 2018, Medical Oncology.

[2]  C. Catton,et al.  Evaluation of high dose volumetric CT to reduce inter-observer delineation variability and PTV margins for prostate cancer radiotherapy. , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[3]  M. Bignardi,et al.  Variability in axillary lymph node delineation for breast cancer radiotherapy in presence of guidelines on a multi-institutional platform , 2017, Acta oncologica.

[4]  Kazem Rahimi,et al.  A cardiac contouring atlas for radiotherapy , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[5]  K. Hua,et al.  Development of delineation for the left anterior descending coronary artery region in left breast cancer radiotherapy: An optimized organ at risk. , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[6]  T. Purdie,et al.  Building a New Model of Care for Rapid Breast Radiotherapy Treatment Planning: Evaluation of the Advanced Practice Radiation Therapist in Cavity Delineation. , 2016, Clinical oncology (Royal College of Radiologists (Great Britain)).

[7]  L. Holloway,et al.  Uncertainties in volume delineation in radiation oncology: A systematic review and recommendations for future studies. , 2016, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[8]  P. Yadav,et al.  Radiation therapy for breast cancer: Literature review. , 2016, Medical dosimetry : official journal of the American Association of Medical Dosimetrists.

[9]  P. Franco,et al.  Delineation of the larynx as organ at risk in radiotherapy: a contouring course within “Rete Oncologica Piemonte-Valle d’Aosta” network to reduce inter- and intraobserver variability , 2016, La radiologia medica.

[10]  Michael G Jameson,et al.  A review of interventions to reduce inter‐observer variability in volume delineation in radiation oncology , 2016, Journal of medical imaging and radiation oncology.

[11]  Mechthild Krause,et al.  ESTRO consensus guideline on target volume delineation for elective radiation therapy of early stage breast cancer, version 1.1. , 2016, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[12]  Ya-di Wang,et al.  Dosimetric Evaluation of Different Intensity-Modulated Radiotherapy Techniques for Breast Cancer After Conservative Surgery , 2015, Technology in cancer research & treatment.

[13]  Mechthild Krause,et al.  ESTRO consensus guideline on target volume delineation for elective radiation therapy of early stage breast cancer. , 2015, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[14]  M. Di Tommaso,et al.  Inter-observer variability of clinical target volume delineation in radiotherapy treatment of pancreatic cancer: a multi-institutional contouring experience , 2014, Radiation Oncology.

[15]  Electronic portal imaging registration in breast cancer radiotherapy verification: analysis of inter-observer agreement among different categories of health practitioners. , 2013, Neoplasma.

[16]  R. Pötter,et al.  Competencies in radiation oncology: a new approach for education and training of professionals for Radiotherapy and Oncology in Europe. , 2012, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[17]  Benjamin Movsas,et al.  Consideration of dose limits for organs at risk of thoracic radiotherapy: atlas for lung, proximal bronchial tree, esophagus, spinal cord, ribs, and brachial plexus. , 2011, International journal of radiation oncology, biology, physics.

[18]  R Peto,et al.  Effect of radiotherapy after breast-conserving surgery on 10-year recurrence and 15-year breast cancer death: meta-analysis of individual patient data for 10 801 women in 17 randomised trials , 2011, The Lancet.

[19]  Aamer Chughtai,et al.  Development and validation of a heart atlas to study cardiac exposure to radiation following treatment for breast cancer. , 2011, International journal of radiation oncology, biology, physics.

[20]  Issam El Naqa,et al.  Tools for consensus analysis of experts' contours for radiotherapy structure definitions. , 2010, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[21]  W. Woodward,et al.  Variability of target and normal structure delineation for breast cancer radiotherapy: an RTOG Multi-Institutional and Multiobserver Study. , 2007, International journal of radiation oncology, biology, physics.

[22]  Lucyna Kepka,et al.  Delineation variation of lymph node stations for treatment planning in lung cancer radiotherapy. , 2007, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[23]  Brian O'Sullivan,et al.  Intraobserver and interobserver variability in GTV delineation on FDG-PET-CT images of head and neck cancers. , 2007, International journal of radiation oncology, biology, physics.

[24]  Aaron Fenster,et al.  Prostate contouring uncertainty in megavoltage computed tomography images acquired with a helical tomotherapy unit during image-guided radiation therapy. , 2006, International journal of radiation oncology, biology, physics.

[25]  Marcel van Herk,et al.  Reduction of observer variation using matched CT-PET for lung cancer delineation: a three-dimensional analysis. , 2006, International Journal of Radiation Oncology, Biology, Physics.

[26]  C. Raaijmakers,et al.  Interobserver variability of clinical target volume delineation of glandular breast tissue and of boost volume in tangential breast irradiation. , 2005, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[27]  C. Fiorino,et al.  Intra- and inter-observer variability in contouring prostate and seminal vesicles: implications for conformal treatment planning. , 1998, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[28]  H. O. Wyckoff,et al.  International Commission on Radiation Units and Measurements , 1975 .

[29]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .