Distributed Radiotherapy Simulation with the Webcom Workflow System

Accurate radiotherapy plans are a vital tool in combating cancer. The verification of such plans is a computationally intensive task, and providing clinical experts with access to sufficient resources to conduct plan verification simulations in a suitable and timely manner is a genuine challenge. In this paper we present a new approach to the problem, incorporating the Monte Carlo method for treatment verification. A fully integrated radiotherapy treatment verification workflow built on the BEAM simulation package has been developed within the scope of this work. The Monte Carlo approach is recognized as being superior to the standard clinical techniques available. To be useful in clinical practice, accurate results must be generated within a short time frame. Consequently, turnaround times must be predictable, and results must be of a consistently high standard. These requirements are the key challenges that drive this work. The development of this application is being conducted within the context of the Webcom project. Webcom is an interpreter for a graph-oriented model of computing, implemented as a distributed virtual machine. This platform has been used to construct a workflow tool suite and a novel methodology for dynamic resource federation. These components are applied to the execution of Monte Carlo radiotherapy simulation application on heterogeneous dynamically coordinated resources. The Webcom-based model of workflow management facilitates the execution of resource intensive workflows and provides a basis for the development of scalable services in the heterogeneous environments formed through the dynamic aggregation of mixed autonomous resources. We discuss the motivation behind the project and present the methodology, describe the software design of the current implementation, and demonstrates the utility of the system via experiments conducted in a real and deeply heterogeneous testbed environment.

[1]  John A. Sharp Data flow computing , 1985 .

[2]  Zhou Lei,et al.  The portable batch scheduler and the maui scheduler on linux clusters , 2000 .

[3]  D. Rogers Fifty years of Monte Carlo simulations for medical physics , 2006, Physics in medicine and biology.

[4]  Paul Lu,et al.  Practical Heterogeneous Placeholder Scheduling in Overlay Metacomputers: Early Experiences , 2002, JSSPP.

[5]  Francine Berman,et al.  Using Moldability to Improve the Performance of Supercomputer Jobs , 2002, J. Parallel Distributed Comput..

[6]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[7]  Oisín Curran,et al.  Fine-Grained Workflow in Heterogeneous Environments , 2008, 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008).

[8]  B. Allen,et al.  Designing a Runtime System for Volunteer Computing , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[9]  Douglas Thain,et al.  Distributed computing in practice: the Condor experience , 2005, Concurr. Pract. Exp..

[10]  Oisín Curran,et al.  The MarineGrid project in Ireland with Webcom , 2009, Comput. Geosci..

[11]  Oisín Curran,et al.  A workflow model for heterogeneous computing environments , 2009, Future Gener. Comput. Syst..

[12]  David W. O. Rogers,et al.  Presta: The parameter reduced electron-step transport algorithm for electron monte carlo transport , 1986 .

[13]  A. Ahnesjö Collapsed cone convolution of radiant energy for photon dose calculation in heterogeneous media. , 1989, Medical physics.

[14]  Andrew A. Chien,et al.  Entropia: architecture and performance of an enterprise desktop grid system , 2003, J. Parallel Distributed Comput..

[15]  Simon N. Foley,et al.  WEBCOM-G: A Candidate Middleware for Grid-Ireland , 2006, Int. J. High Perform. Comput. Appl..

[16]  John P. Morrison,et al.  Condensed graphs : unifying availability-driven, coercion-driven and control-driven computing , 1996 .

[17]  Yaohang Li,et al.  Analysis of Large-Scale Grid-Based Monte Carlo Applications , 2003, Int. J. High Perform. Comput. Appl..

[18]  Kento Aida,et al.  Distributed computing with hierarchical master-worker paradigm for parallel branch and bound algorithm , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[19]  A. Ahnesjö,et al.  Dose calculations for external photon beams in radiotherapy. , 1999, Physics in medicine and biology.

[20]  Bobby Bhattacharjee,et al.  Matching Jobs to Resources in Distributed Desktop Grid Environments , 2006 .

[21]  Florian Schintke,et al.  Peer-to-Peer Computing , 2010, Euro-Par.

[22]  Tatu Ylönen,et al.  The Secure Shell (SSH) Protocol Architecture , 2006, RFC.

[23]  Virginia Mary Lo,et al.  Wave Scheduler: Scheduling for Faster Turnaround Time in Peer-Based Desktop Grid Systems , 2005, JSSPP.

[24]  Francine Berman,et al.  Adaptive scheduling of master/worker applications on distributed computational resources , 2001 .

[25]  Jonathan Schaeffer,et al.  TrellisDAG: A System for Structured DAG Scheduling , 2003, JSSPP.

[26]  T. Krieger,et al.  Monte Carlo- versus pencil-beam-/collapsed-cone-dose calculation in a heterogeneous multi-layer phantom , 2005, Physics in medicine and biology.

[27]  Per Nilsson,et al.  Limitations of a pencil beam approach to photon dose calculations in the head and neck region , 1996 .

[28]  I. Kawrakow Accurate condensed history Monte Carlo simulation of electron transport. II. Application to ion chamber response simulations. , 2000, Medical physics.

[29]  James Kenevan,et al.  An extensible job scheduling system for massively parallel processor architectures , 1998 .

[30]  A. Ahnesjö,et al.  A pencil beam model for photon dose calculation. , 1992, Medical physics.

[31]  Warren Smith,et al.  Using Run-Time Predictions to Estimate Queue Wait Times and Improve Scheduler Performance , 1999, JSSPP.

[32]  Allen B. Downey,et al.  Using Queue Time Predictions for Processor Allocation , 1997, JSSPP.

[33]  John P. Morrison,et al.  Resource Aggregation and Workflow with Webcom , 2007, HPCC.

[34]  John P. Morrison,et al.  A grid application development platform for WebCom-G , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[35]  I. Kawrakow Accurate condensed history Monte Carlo simulation of electron transport. I. EGSnrc, the new EGS4 version. , 2000, Medical physics.

[36]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[37]  S B Jiang,et al.  Monte Carlo modelling of electron beams from medical accelerators. , 1999, Physics in medicine and biology.

[38]  D. Rogers,et al.  EGS4 code system , 1985 .

[39]  Frank Leymann,et al.  Web Services Platform Architecture: SOAP, WSDL, WS-Policy, WS-Addressing, WS-BPEL, WS-Reliable Messaging, and More , 2005 .

[40]  Rajesh Raman,et al.  High Throughput Monte Carlo , 1999, PPSC.

[41]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[42]  P. Andreo Monte Carlo techniques in medical radiation physics. , 1991, Physics in medicine and biology.

[43]  Stephen M. Seltzer,et al.  An Overview of ETRAN Monte Carlo Methods , 1988 .

[44]  S E Middleton,et al.  GEMSS: grid-infrastructure for medical service provision. , 2005, Methods of information in medicine.

[45]  John P. Morrison,et al.  WebCom-G: Grid Enabled Metacomputing , 2004, Neural Parallel Sci. Comput..

[46]  Francine Berman,et al.  When the Herd Is Smart: Aggregate Behavior in the Selection of Job Request , 2003, IEEE Trans. Parallel Distributed Syst..

[47]  Carl Kesselman,et al.  Optimizing Grid-Based Workflow Execution , 2005, Journal of Grid Computing.

[48]  Richard Wolski,et al.  Predicting bounds on queuing delay for batch-scheduled parallel machines , 2006, PPoPP '06.

[49]  Yaohang Li,et al.  GCIMCA: A Globus and SPRNG Implementation of a Grid-Computing Infrastructure for Monte Carlo Applications , 2003, PDPTA.

[50]  Maria Grazia Pia,et al.  DISTRIBUTED PROCESSING, MONTECARLO AND CT INTERFACE FOR MEDICAL TREATMENT PLANNING , 2004 .

[51]  J. Baró,et al.  PENELOPE: An algorithm for Monte Carlo simulation of the penetration and energy loss of electrons and positrons in matter , 1995 .

[52]  T Knöös,et al.  Limitations of a pencil beam approach to photon dose calculations in lung tissue. , 1995, Physics in medicine and biology.

[53]  J. F. Briesmeister MCNP-A General Monte Carlo N-Particle Transport Code , 1993 .

[54]  J. Sempau,et al.  Monte Carlo simulation of electron beams from an accelerator head using PENELOPE , 2001, Physics in Medicine and Biology.

[55]  Angela C. Sodan,et al.  Adaptive Job Scheduling Via Predictive Job Resource Allocation , 2006, JSSPP.

[56]  John P. Morrison,et al.  An Evolution of the WebCom Metacomputer , 2003, J. Math. Model. Algorithms.

[57]  John P. Morrison,et al.  WebCom: A Web Based Volunteer Computer , 2004, The Journal of Supercomputing.