Efficient Inter-Process Synchronization for Parallel Discrete Event Simulation on Multicores

We present a new technique for controlling optimism in Parallel Discrete Event Simulation on multicores. It is designed to be suitable for simulating models, in which the time intervals between successive events between different processes are highly variable, and have no lower bounds. In our technique, called Dynamic Local Time Window Estimates (DLTWE), each processor communicates time estimates of its next inter-processor event to (some of) its neighbors, which use the estimates as bounds for advancement of their local simulation time. We have implemented our technique in a parallel simulator for simulation of spatially extended Markovian processes of interacting entities, which can model chemical reactions, processes from biology, epidemics, and many other applications. Intervals between successive events are exponentially distributed, thus having a significant variance and no lower bound. We show that the DLTWE technique can be tuned to drastically reduce the frequency of rollbacks and enable speedups which is superior to that obtained by other works. We also show that the DLTWE technique significantly improves performance over other existing techniques for optimism control that attempt to predict arrival of inter-process events by statistical techniques.

[1]  David Bernstein,et al.  Simulating mesoscopic reaction-diffusion systems using the Gillespie algorithm. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[3]  Randal E. Bryant,et al.  SIMULATION OF PACKET COMMUNICATION ARCHITECTURE COMPUTER SYSTEMS , 1977 .

[4]  R. M. Fujimoto,et al.  Parallel discrete event simulation , 1989, WSC '89.

[5]  Stefan Engblom,et al.  On the Stability of Stochastic Jump Kinetics , 2012, 1202.3892.

[6]  Petr Plechác,et al.  Hierarchical fractional-step approximations and parallel kinetic Monte Carlo algorithms , 2011, J. Comput. Phys..

[7]  Bing Wang,et al.  Abstract Next Subvolume Method: A logical process-based approach for spatial stochastic simulation of chemical reactions , 2011, Comput. Biol. Chem..

[8]  R Metzler,et al.  The future is noisy: the role of spatial fluctuations in genetic switching. , 2001, Physical review letters.

[9]  Fredrik Hellman,et al.  Multiscale and multilevel methods for porous media flow problems , 2015 .

[10]  Alois Ferscha Probabilistic adaptive direct optimism control in Time Warp , 1995, PADS.

[11]  F. Wieland,et al.  Limitation of optimism in the time warp operating system , 1989, WSC '89.

[12]  Brian Drawert,et al.  The diffusive finite state projection algorithm for efficient simulation of the stochastic reaction-diffusion master equation. , 2010, The Journal of chemical physics.

[13]  Jaap A. Kaandorp,et al.  Spatial stochastic modelling of the phosphoenolpyruvate-dependent phosphotransferase (PTS) pathway in Escherichia coli , 2006, Bioinform..

[14]  David R. Jefferson,et al.  Virtual time , 1985, ICPP.

[15]  Jeff S. Steinman,et al.  Breathing Time Warp , 1993, PADS '93.

[16]  Gabriel A. Wainer,et al.  Conservative vs. optimistic parallel simulation of DEVS and Cell-DEVS: a comparative study , 2010, SummerSim.

[17]  Richard M. Fujimoto,et al.  Parallel and Distribution Simulation Systems , 1999 .

[18]  Samir Ranjan Das Adaptive protocols for parallel discrete event simulation , 1996, Winter Simulation Conference.

[19]  K. Mani Chandy,et al.  Asynchronous distributed simulation via a sequence of parallel computations , 1981, CACM.

[20]  Concetto Spampinato,et al.  Parallel stochastic systems biology in the cloud , 2013, Briefings Bioinform..

[21]  P. Donnelly MARKOV PROCESSES Characterization and Convergence (Wiley Series in Probability and Mathematical Statistics) , 1987 .

[22]  Paul F. Reynolds,et al.  Elastic time , 1998, TOMC.

[23]  Andreas Hellander,et al.  URDME: a modular framework for stochastic simulation of reaction-transport processes in complex geometries , 2012, BMC Systems Biology.

[24]  K. Vahala Handbook of stochastic methods for physics, chemistry and the natural sciences , 1986, IEEE Journal of Quantum Electronics.

[25]  Lorenzo Dematté,et al.  On Parallel Stochastic Simulation of Diffusive Systems , 2008, CMSB.

[26]  Pavol Bauer,et al.  Sensitivity Estimation and Inverse Problems in Spatial Stochastic Models of Chemical Kinetics , 2013, ENUMATH.

[27]  David M. Nicol,et al.  Lookahead revisited in wireless network simulations , 2002, Proceedings 16th Workshop on Parallel and Distributed Simulation.

[28]  Andreas Hellander,et al.  Simulation of Stochastic Reaction-Diffusion Processes on Unstructured Meshes , 2008, SIAM J. Sci. Comput..

[29]  Boleslaw K. Szymanski,et al.  Lookback:a new way of exploiting parallelism in discrete event simulation , 2002, Proceedings 16th Workshop on Parallel and Distributed Simulation.

[30]  Adelinde M. Uhrmacher,et al.  A parallel and distributed discrete event approach for spatial cell-biological simulations , 2008, PERV.

[31]  John G. Cleary,et al.  Scheduling critical channels in conservative parallel discrete event simulation , 1999, Proceedings Thirteenth Workshop on Parallel and Distributed Simulation. PADS 99. (Cat. No.PR00155).

[32]  Jayadev Misra,et al.  Distributed discrete-event simulation , 1986, CSUR.

[33]  Paulette Clancy,et al.  Accurate implementation of leaping in space: the spatial partitioned-leaping algorithm. , 2010, The Journal of chemical physics.

[34]  Michael Mascagni SPRNG: A Scalable Library for Pseudorandom Number Generation , 1999, PPSC.

[35]  Boris D. Lubachevsky,et al.  Efficient parallel simulations of dynamic Ising spin systems , 1988 .

[36]  Giancarlo Mauri,et al.  cuTauLeaping: A GPU-Powered Tau-Leaping Stochastic Simulator for Massive Parallel Analyses of Biological Systems , 2014, PloS one.

[37]  David Fange,et al.  Noise-Induced Min Phenotypes in E. coli , 2006, PLoS Comput. Biol..

[38]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[39]  Christopher D. Carothers,et al.  ROSS: a high-performance, low memory, modular time warp system , 2000, PADS '00.

[40]  Hassan Rajaei,et al.  Parallel simulation using conservative time windows , 1992, WSC '92.

[41]  Divyakant Agrawal,et al.  Using Message Semantics to Reduce Rollback in the Time Wrap Mechanism , 1993, WDAG.

[42]  Pavol Bauer,et al.  URDME v. 1.2: User's manual , 2009 .

[43]  Asad Malik,et al.  Optimistic Synchronization of Parallel Simulations in Cloud Computing Environments , 2009, 2009 IEEE International Conference on Cloud Computing.

[44]  Gabriel A. Wainer,et al.  Synchronization methods in parallel and distributed discrete-event simulation , 2013, Simul. Model. Pract. Theory.

[45]  Shaoliang Peng,et al.  A Well-Balanced Time Warp System on Multi-Core Environments , 2011, 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation.

[46]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[47]  Gabriel A. Wainer,et al.  Conservative DEVS: a novel protocol for parallel conservative simulation of DEVS and cell-DEVS models , 2010, SpringSim.

[48]  Nael B. Abu-Ghazaleh,et al.  Parallel Discrete Event Simulation for Multi-Core Systems: Analysis and Optimization , 2014, IEEE Transactions on Parallel and Distributed Systems.

[49]  J. Elf,et al.  Spontaneous separation of bi-stable biochemical systems into spatial domains of opposite phases. , 2004, Systems biology.

[50]  Roberto Vitali,et al.  Transparent and Efficient Shared-State Management for Optimistic Simulations on Multi-core Machines , 2012, 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[51]  Adelinde M. Uhrmacher,et al.  Exploring the performance of spatial stochastic simulation algorithms , 2011, J. Comput. Phys..

[52]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[53]  W. O. Kermack,et al.  A contribution to the mathematical theory of epidemics , 1927 .

[54]  Rinaldo B. Schinazi,et al.  Predator-prey and host-parasite spatial stochastic models , 1997 .

[55]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[56]  Muruhan Rathinam,et al.  Efficient computation of parameter sensitivities of discrete stochastic chemical reaction networks. , 2010, The Journal of chemical physics.

[57]  Stefan Engblom,et al.  Parallel in Time Simulation of Multiscale Stochastic Chemical Kinetics , 2008, Multiscale Model. Simul..