Predicting Performance Impacts due to Resolution Changes in Parallel Simulations

Multi-resolution models are often used to accelerate simulation-based analysis without significantly impacting the fidelity of the simulations. We have developed a web-enabled, component-based, multi-resolution modeling and Time Warp synchronized parallel simulation environment called WESE (Web-Enabled Simulation Environment). WESE uses a methodology called Dynamic Component Substitution (DCS) to enable abstractions or refinements to a given model. However, effectively utilizing abstractions, whether they are DCS-based or not, is a complex and time-consuming task. The complexity arises because not all abstractions improve simulation performance due to a myriad of factors related to model characteristics, synchronization protocol overheads and simulation-platform configuration. The overheads involved in identifying optimal model resolution have been exacerbating effective use of multi-resolution simulations, including our DCS-based approach. In an endeavor to minimize the time taken to identify performance impacts of resolution changes, this study proposes a DCS Performance Prediction Methodology (DCSPPM). It predicts simulation performance changes due to DCS transformations via static analysis of the model. Static analysis uses platform-specific performance characteristics of components constituting the model. DCSPPM yields quantitative estimates of performance impacts which are used by the modeler to select appropriate transformations. This article presents DCSPPM, its implementation in WESE and its empirical evaluation. The inferences drawn from the experiments prove that DCSPPM estimates have errors of less than 5% for a variety of models. Furthermore, DCSPPM executes orders of magnitude faster than corresponding shortest test simulations. Note that applicability of DCSPPM is not restricted to WESE but can be extended to other Time Warp synchronized simulators.

[1]  J. P. Trembly Discrete mathematical structures with applications to computer science / J.P. Trembly, R. Manohar , 1988 .

[2]  Peter J. Ashenden,et al.  The Designer's Guide to VHDL , 1995 .

[3]  Dhananjai M. Rao Study of Dynamic Component Substitutions , 2003 .

[4]  Philip A. Wilsey,et al.  Accelerating spatially explicit simulations of spread of Lyme disease , 2005, 38th Annual Simulation Symposium.

[5]  David A. Patterson,et al.  Computer Organization & Design: The Hardware/Software Interface , 1993 .

[6]  Philip A. Wilsey,et al.  Accelerating ATM Simulations Using Dynamic Component Substitution (DCS) , 2006, Simul..

[7]  R. M. Fujimoto,et al.  Parallel discrete event simulation , 1989, WSC '89.

[8]  Ian F. Akyildiz,et al.  Performance Analysis of Time Warp With Multiple Homogeneous Processors , 1991, IEEE Trans. Software Eng..

[9]  Sally Floyd,et al.  Why we don't know how to simulate the Internet , 1997, WSC '97.

[10]  F. Downton,et al.  Introduction to Mathematical Statistics , 1959 .

[11]  장훈,et al.  [서평]「Computer Organization and Design, The Hardware/Software Interface」 , 1997 .

[12]  Philip A. Wilsey,et al.  Applying Parallel, Dynamic-Resolution Simulations to Accelerate VLSI Power Estimation , 2006, Proceedings of the 2006 Winter Simulation Conference.

[13]  Deborah Estrin,et al.  Enabling large-scale simulations: selective abstraction approach to the study of multicast protocols , 1998, Proceedings. Sixth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (Cat. No.98TB100247).

[14]  Paul F. Reynolds,et al.  Consistency maintenance in multiresolution simulation , 1997, TOMC.

[15]  Philip A. Wilsey,et al.  Web-based simulation 2: performance prediction of dynamic component substitutions , 2002, WSC '02.

[16]  Alois Ferscha,et al.  A testbed for parallel simulation performance prediction , 1996, Winter Simulation Conference.

[17]  Philip A. Wilsey,et al.  Dynamic component substitution in Web-based simulation , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[18]  D.M. Rao,et al.  Performance prediction of dynamic component substitutions , 2002, Proceedings of the Winter Simulation Conference.

[19]  Philip A. Wilsey,et al.  Predicting Performance of Resolution Changes in Parallel Simulations , 2006, 20th Workshop on Principles of Advanced and Distributed Simulation (PADS'06).

[20]  Harry G. Perros,et al.  Connection-Oriented Networks: SONET/SDH, ATM, MPLS and Optical Networks , 2005 .

[21]  Philip A. Wilsey,et al.  Unsynchronized parallel discrete event simulation , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[22]  Philip A. Wilsey,et al.  Web-based network analysis and design , 2000, TOMC.

[23]  Erol Gelenbe,et al.  Proceedings of the 3rd International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems , 1995 .

[24]  Richard M. Fujimoto,et al.  Feature Article - Parallel Discrete Event Simulation: Will the Field Survive? , 1993, INFORMS J. Comput..

[25]  Matthew Haines,et al.  Towards a thread-based parallel direct execution simulator , 1996, Proceedings of HICSS-29: 29th Hawaii International Conference on System Sciences.

[26]  Yong Meng Teo,et al.  Performance analysis of time warp simulation with cascading rollbacks , 1998, Workshop on Parallel and Distributed Simulation.

[27]  Philip A. Wilsey,et al.  WESE: A WEB-BASED ENVIRONMENT FOR SYSTEMS ENGINEERING , 2007 .

[28]  David R. Jefferson,et al.  Virtual time , 1985, ICPP.

[29]  David Finkel,et al.  Book review: The Art of Computer Systems Performance Analysis by R. Jain (Wiley-Interscience, 1991) , 1990, PERV.

[30]  Philip A. Wilsey,et al.  An Object-Oriented Time Warp Simulation Kernel , 1998, ISCOPE.

[31]  Philip A. Wilsey,et al.  Optimizing costs of web-based modeling and simulation , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[32]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[33]  Paul A. Fishwick,et al.  Simulation model design and execution - building digital worlds , 1995 .

[34]  Nael B. Abu-Ghazaleh,et al.  A framework for performance analysis of parallel discrete event simulators , 1997, WSC '97.

[35]  Philip A. Wilsey,et al.  Process combination to increase event granularity in parallel logic simulation , 1995, Proceedings of 9th International Parallel Processing Symposium.

[36]  David M. Nicol,et al.  Performance prediction of a parallel simulator , 1999, Proceedings Thirteenth Workshop on Parallel and Distributed Simulation. PADS 99. (Cat. No.PR00155).

[37]  Santosh Pande,et al.  Performance prediction of large-scale parallel discrete event models of physical systems , 2005, Proceedings of the Winter Simulation Conference, 2005..