The influence of automation on tumor contouring

Fully or semi-automatic contouring tools are increasingly being used in the tumor contouring task for radiotherapy. While the fully automatic contouring tools have not reached sufficient efficiency, the semi-automatic contouring tools balance more effectively between the human interaction and automation. This study evaluates the influences of a semi-automation contouring tool, called between-slice interpolation, on the resulting contours and the contouring process. The tumor contouring study was conducted on three patient cases with five physicians in a naturalistic setting. The contouring task consisted of initiating the 2D contour manually or with the interpolation tool and correcting that initial contour. The similarity of the resulting contours was pairwise measured within the manual or the interpolated category. Interactions with the software were recorded, and variations in the contouring workflows steps were compared. Results indicated that using the between-slice interpolation tool for creating the initial contour, instead of initiating it manually, influenced both the contouring process and outcomes. First, it was identified that contours initiated by the interpolation tool showed an increased similarity among themselves compared to the manually initiated contours. At the same time, influences to the resulting contours were below clinical relevance, and toward the desired direction—improved consistency of contours. Second, when interpolation was used, in two cases out of three, the average contouring time also decreased significantly. Therefore, the use of such an automation tool can be encouraged.

[1]  R J Dowsett,et al.  Contouring structures for 3-dimensional treatment planning. , 1992, International journal of radiation oncology, biology, physics.

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..

[4]  Sridhar Yaddanapudi,et al.  Automated radiation therapy treatment plan workflow using a commercial application programming interface. , 2014, Practical radiation oncology.

[5]  C. W. Johnson,et al.  Why did that happen? Exploring the proliferation of barely usable software in healthcare systems , 2006, Quality and Safety in Health Care.

[6]  Marcel van Herk,et al.  Errors and margins in radiotherapy. , 2004, Seminars in radiation oncology.

[7]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Marcel van Herk,et al.  Using a contextualized sensemaking model for interaction design: A case study of tumor contouring , 2017, J. Biomed. Informatics.

[9]  R. Yancik,et al.  Cancer in older persons: an international issue in an aging world. , 2004, Seminars in oncology.

[10]  Stefan V. Pantazi,et al.  Case-based medical informatics , 2004, BMC Medical Informatics Decis. Mak..

[11]  Stewart Gaede,et al.  Inter-observer and intra-observer reliability for lung cancer target volume delineation in the 4D-CT era. , 2010, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[12]  Claudia Mello-Thoms,et al.  Time course of perception and decision making during mammographic interpretation. , 2002, AJR. American journal of roentgenology.

[13]  M. Leech,et al.  Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck , 2016, Acta oncologica.

[14]  Jhony Ostos,et al.  Performance in computer-mediated work: the moderating role of level of automation , 2017, Cognition, Technology & Work.

[15]  I. Olivotto,et al.  Peer Review of Radiotherapy Planning: Quantifying Outcomes and a Proposal for Prospective Data Collection. , 2016, Clinical oncology (Royal College of Radiologists (Great Britain)).

[16]  B. Raaymakers,et al.  Development and clinical introduction of automated radiotherapy treatment planning for prostate cancer , 2016, Physics in Medicine and Biology.

[17]  R. Mirimanoff,et al.  Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. , 2005, The New England journal of medicine.

[18]  M. Stock,et al.  Critical discussion of evaluation parameters for inter-observer variability in target definition for radiation therapy , 2012, Strahlentherapie und Onkologie.

[19]  Douglas L. Jones ICRU Report 50—Prescribing, Recording and Reporting Photon Beam Therapy , 1994 .

[20]  Daniel P. J. Bruneau,et al.  A self-analysis of the NASA-TLX workload measure , 2007, Ergonomics.

[21]  Stanislaw Zabramski Careless touch: a comparative evaluation of mouse, pen, and touch input in shape tracing task , 2011, OZCHI.

[22]  E Pedroni,et al.  The precision of proton range calculations in proton radiotherapy treatment planning: experimental verification of the relation between CT-HU and proton stopping power. , 1998, Physics in medicine and biology.

[23]  Romney B. Duffey,et al.  Know the Risk: Learning from errors and accidents: safety and risk in today's technology , 2012 .

[24]  M. Brundage,et al.  A real-time audit of radiation therapy in a regional cancer center. , 1999, International journal of radiation oncology, biology, physics.

[25]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[26]  K. Hoang-Xuan,et al.  Primary brain tumours in adults , 2003, The Lancet.

[27]  Geoff Delaney M.B.B.S.,et al.  The role of radiotherapy in cancer treatment , 2005 .

[28]  S. Plevritis,et al.  Glioblastoma multiforme: exploratory radiogenomic analysis by using quantitative image features. , 2014, Radiology.

[29]  Geoff Delaney,et al.  The role of radiotherapy in cancer treatment , 2005, Cancer.

[30]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[31]  Claus Belka,et al.  ESTRO-ACROP guideline "target delineation of glioblastomas". , 2016, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[32]  L. Xing,et al.  Overview of image-guided radiation therapy. , 2006, Medical dosimetry : official journal of the American Association of Medical Dosimetrists.

[33]  Ben Shneiderman,et al.  Workplace user frustration with computers: an exploratory investigation of the causes and severity , 2006, Behav. Inf. Technol..

[34]  Marcel van Herk,et al.  Observer variation in target volume delineation of lung cancer related to radiation oncologist-computer interaction: a 'Big Brother' evaluation. , 2005, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[35]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[36]  A. Hillstrom Repetition effects in visual search , 2000, Perception & psychophysics.

[37]  Shivani Kumar,et al.  Survey of image‐guided radiotherapy use in Australia , 2017, Journal of medical imaging and radiation oncology.

[38]  J Dinkel,et al.  Inter-observer reproducibility of semi-automatic tumor diameter measurement and volumetric analysis in patients with lung cancer. , 2013, Lung cancer.

[39]  N. Burnet,et al.  Defining the tumour and target volumes for radiotherapy , 2004, Cancer imaging : the official publication of the International Cancer Imaging Society.

[40]  C. Hess,et al.  The Impact of Gross Tumor Volume (GTV) and Clinical Target Volume (CTV) Definition on the Total Accuracy in Radiotherapy , 2003, Strahlentherapie und Onkologie.

[41]  R. Prabhakar,et al.  A study on the tumor volume computation between different 3D treatment planning systems in radiotherapy. , 2011, Journal of cancer research and therapeutics.

[42]  M. Mackenzie,et al.  Quantifying appropriate PTV setup margins: analysis of patient setup fidelity and intrafraction motion using post-treatment megavoltage computed tomography scans. , 2007, International journal of radiation oncology, biology, physics.

[43]  Erwin W. Hans,et al.  Operations research for resource planning and -use in radiotherapy: a literature review , 2016, BMC Medical Informatics and Decision Making.

[44]  T. Pawlicki,et al.  Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary , 2013, Practical radiation oncology.

[45]  R. Steenbakkers,et al.  Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. , 2011, Medical physics.

[46]  Edit Varga,et al.  Manipulation of mental models of anatomy in interventional radiology and its consequences for design of human–computer interaction , 2013, Cognition, Technology & Work.

[47]  C. Njeh,et al.  Tumor delineation: The weakest link in the search for accuracy in radiotherapy , 2008, Journal of medical physics.

[48]  Jonathan Sykes,et al.  Reflections on the current status of commercial automated segmentation systems in clinical practice , 2014, Journal of medical radiation sciences.

[49]  Trafton Drew,et al.  Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images? , 2013, Radiographics : a review publication of the Radiological Society of North America, Inc.

[50]  Jan Hendrik Moltz,et al.  Sketch‐Based Editing Tools for Tumour Segmentation in 3D Medical Images , 2013, Comput. Graph. Forum.

[51]  David Wesley,et al.  Complacency and Automation Bias in the Enbridge Pipeline Disaster , 2017 .

[52]  Fred Röhner,et al.  Visualization of data in radiotherapy using web services for optimization of workflow , 2015, Radiation Oncology.

[53]  G. Snow,et al.  The role of radiotherapy , 1980, The Journal of Laryngology & Otology.

[54]  Wiro J. Niessen,et al.  User Interaction in Semi-Automatic Segmentation of Organs at Risk: a Case Study in Radiotherapy , 2015, Journal of Digital Imaging.

[55]  C J Moore,et al.  Automated delineation of radiotherapy volumes: are we going in the right direction? , 2013, The British journal of radiology.

[56]  Linda Onnasch,et al.  Human Performance Consequences of Automated Decision Aids , 2012 .

[57]  V. Budach,et al.  Protection of quality and innovation in radiation oncology: The prospective multicenter trial the German Society of Radiation Oncology (DEGRO-QUIRO study) , 2014, Strahlentherapie und Onkologie.

[58]  M Vermandel,et al.  Interactive contour delineation of organs at risk in radiotherapy: Clinical evaluation on NSCLC patients. , 2016, Medical physics.

[59]  D P Dearnaley,et al.  Intensity modulated radiation therapy: a clinical review. , 2000, The British journal of radiology.

[60]  Timothy K. Nguyen,et al.  Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature. , 2016, International journal of radiation oncology, biology, physics.

[61]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..