Optimizing the Scalability of Parallelized GATE Simulations

GATE is a GEANT4 application toolkit for accurate simulation of positron emission tomography (PET) and single photon emission computed tomography (SPECT) systems. As Monte Carlo simulations are CPU-intensive, simulations often take up to several days to complete with state-of-the-art single-CPU computers. However, Monte Carlo simulations are also excellently suited for parallelization, theoretically showing a linear speed-up as a function of the number of processing nodes. Previously a parallel computing platform was developed in order to reduce the overall computing time of GATE experiments. It was comprised of a job splitter, to subdivide the simulation using time-domain decomposition and a file merger to merge the data output. However, at that time three factors limited the scalability of this platform. Firstly, isotopes with a short half life led to an inefficient load balancing, as an unequal amount of events was processed on each node. Secondly, a long setup time was required for SPECT collimator geometries. Thirdly, the merge overhead of the single file merger greatly limited the scalability. This paper provides a solution for each of these problems, thereby improving the overall scalability of the aforementioned cluster platform significantly.

[1]  F. James A Review of Pseudorandom Number Generators , 1990 .

[2]  Habib Zaidi,et al.  Implementation of an Environment for Monte Carlo Simulation of Fully 3-D Positron Tomography on a High-Performance Parallel Platform , 1998, Parallel Comput..

[3]  George Marsaglia,et al.  Toward a universal random number generator , 1987 .

[4]  Yuni K. Dewaraja,et al.  A parallel Monte Carlo code for planar and SPECT imaging: implementation, verification and applications in 131I SPECT , 2002, Comput. Methods Programs Biomed..

[5]  Li Deng,et al.  Parallelization of MCNP Monte Carlo neutron and photon transport code in parallel virtual machine and message passing interface , 1999 .

[6]  Ignace Lemahieu,et al.  Monte Carlo simulations of a scintillation camera using GATE: validation and application modelling. , 2003, Physics in medicine and biology.

[7]  Suleman Surti,et al.  Imaging characteristics of a 3-dimensional GSO whole-body PET camera. , 2004, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[8]  Sean M. Robinson,et al.  Characteristics of multiprocessing MCNP5 on small personal computer clusters , 2006 .

[9]  C Lartizien,et al.  GATE: a simulation toolkit for PET and SPECT. , 2004, Physics in medicine and biology.

[10]  Jens Gregor,et al.  Simulation of emission tomography using grid middleware for distributed computing , 2004, Comput. Methods Programs Biomed..

[11]  B M Tsui,et al.  Evaluation of cardiac cone-beam single photon emission computed tomography using observer performance experiments and receiver operating characteristic analysis. , 1993, Investigative radiology.

[12]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[13]  Andrew Lumsdaine,et al.  A Component Architecture for LAM/MPI , 2003, PVM/MPI.

[14]  R. Forster,et al.  MCNP™ Version 5 , 2004 .

[15]  Yiping Shao,et al.  Acceleration of SimSET photon history generation , 2002, 2002 IEEE Nuclear Science Symposium Conference Record.

[16]  A.F. Chatziioannou,et al.  Distributed computing platform for PET and SPECT simulations with GATE , 2005, IEEE Nuclear Science Symposium Conference Record, 2005.

[17]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.