Using genetic algorithms to limit the optimism in Time Warp

It is well known that controlling the optimism in Time Warp is central to its success. To date, this problem has been approached by constructing a heuristic model of Time Warp's behavior and optimizing the models' performance. The extent to which the model actually reflects reality is therefore central to its ability to control Time Warp's behavior. In contrast to those approaches, using genetic algorithms avoids the need to construct models of Time Warp's behavior. We demonstrate, in this paper, how the choice of a time window for Time Warp can be transformed into a search problem, and how a genetic algorithm can be utilized to search for the optimal value of the window. An important quality of genetic algorithms is that they can start a search with a random choice for the values of the parameter(s) which they are trying to optimize and produce high quality solutions.

[1]  Philip A. Wilsey,et al.  Adaptive bounded time windows in an optimistically synchronized simulator , 1993, [1993] Proceedings Third Great Lakes Symposium on VLSI-Design Automation of High Performance VLSI Systems.

[2]  Abhijit Gosavi,et al.  Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning , 2003 .

[3]  Alberto RibesAbstract,et al.  Multi agent systems , 2019, Proceedings of the 2005 International Conference on Active Media Technology, 2005. (AMT 2005)..

[4]  Abhijit Gosavi,et al.  Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning , 2003 .

[5]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[6]  Alois Ferscha Probabilistic adaptive direct optimism control in Time Warp , 1995, PADS.

[7]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[8]  Paul F. Reynolds A spectrum of options for parallel simulation , 1988, WSC '88.

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Richard M. Fujimoto,et al.  Adaptive Flow Control in Time Warp , 1997, Workshop on Parallel and Distributed Simulation.

[11]  David Coley,et al.  Introduction to Genetic Algorithms for Scientists and Engineers , 1999 .

[12]  Yi-Bing Lin,et al.  Selecting the checkpoint interval in time warp simulation , 1993, PADS '93.

[13]  Alan Weiss,et al.  An analysis of rollback-based simulation , 1991, TOMC.

[14]  Jun Wang,et al.  Selecting GVT interval for time-warp-based distributed simulation using reinforcement learning technique , 2009, SpringSim '09.

[15]  R.M. Fujimoto,et al.  Parallel and distributed simulation systems , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[16]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[17]  Jun Wang,et al.  Optimizing time warp simulation with reinforcement learning techniques , 2007, 2007 Winter Simulation Conference.

[18]  David R. Jefferson,et al.  Virtual time , 1985, ICPP.

[19]  Richard M. Fujimoto,et al.  Parallel and Distribution Simulation Systems , 1999 .

[20]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[21]  Samir Ranjan Das Adaptive protocols for parallel discrete event simulation , 1996, Winter Simulation Conference.