Result reuse in design space exploration: A study in system support for interactive parallel computing

This paper presents a system supporting reuse of simulation results in multi-experiment computational studies involving independent simulations and explores the benefits of such reuse. Using a SCIRun-based defibrillator device simulation code (DefibSim) and the SimX system for computational studies, this paper demonstrates how aggressive reuse between and within computational studies can enable interactive rates for such studies on a moderate-sized 128-node processor cluster; a brute-force approach to the problem would require two thousand nodes or more on a massively parallel machine for similar performance. Key to realizing these performance improvements is exploiting optimization opportunities that present themselves at the level of the overall workflow of the study as opposed to focusing on individual simulations. Such global optimization approaches are likely to become increasingly important with the shift towards interactive and universal parallel computing.

[1]  Yuefan Deng,et al.  New trends in high performance computing , 2001, Parallel Computing.

[2]  Achille Messac,et al.  Physical programming - Effective optimization for computational design , 1996 .

[3]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[4]  Michelle Miller,et al.  An integrated problem solving environment: the SCIRun computational steering system , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[5]  Jarke J. van Wijk,et al.  Computational steering , 1997, Future Gener. Comput. Syst..

[6]  Francine Berman,et al.  Resource Allocation for Steerable Parallel Parameter Searches , 2002, GRID.

[7]  Jack J. Dongarra,et al.  Automated empirical optimizations of software and the ATLAS project , 2001, Parallel Comput..

[8]  Henri Casanova,et al.  Netsolve: a Network-Enabled Server for Solving Computational Science Problems , 1997, Int. J. High Perform. Comput. Appl..

[9]  James Arthur Kohl,et al.  Cumulvs: Providing Fault Toler. Ance, Visualization, and Steer Ing of Parallel Applications , 1996, Int. J. High Perform. Comput. Appl..

[10]  R.S. MacLeod,et al.  Construction Of An Inhomegeneous Model Of The Human Torso For Use In Computational Electrocardiography , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[11]  Douglas Thain,et al.  Distributed computing in practice: the Condor experience , 2005, Concurr. Pract. Exp..

[12]  Christopher R. Johnson,et al.  DefibSim: an interactive defibrillation device design tool , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[13]  Karsten Schwan,et al.  Falcon: on-line monitoring and steering of large-scale parallel programs , 1995, Proceedings Frontiers '95. The Fifth Symposium on the Frontiers of Massively Parallel Computation.

[14]  D. Abramson,et al.  An Automatic Design Optimization Tool and its Application to Computational Fluid Dynamics , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[15]  John Brooke,et al.  Computational steering in realitygrid , 2003 .

[16]  T. Simpson,et al.  Efficient Pareto Frontier Exploration using Surrogate Approximations , 2000 .

[17]  Anoop Gupta,et al.  Load Balancing and Data locality in Adaptive Hierarchical N-Body Methods: Barnes-Hut, Fast Multipole, and Rasiosity , 1995, J. Parallel Distributed Comput..

[18]  Erik K. Antonsson,et al.  PRELIMINARY VEHICLE STRUCTURE DESIGN: AN INDUSTRIAL APPLICATION OF IMPRECISION IN ENGINEERING DESIGN , 1998 .

[19]  Eitan Grinspun,et al.  Sim-X: parallel system software for interactive multi-experiment computational studies , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[20]  C.R. Johnson,et al.  SCIRun: A Scientific Programming Environment for Computational Steering , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[21]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.

[22]  Vijay Mann,et al.  DISCOVER: An environment for Web‐based interaction and steering of high‐performance scientific applications , 2001, Concurr. Comput. Pract. Exp..

[23]  David Abramson,et al.  Nimrod: a tool for performing parametrised simulations using distributed workstations , 1995, Proceedings of the Fourth IEEE International Symposium on High Performance Distributed Computing.

[24]  Ken Brodlie,et al.  gViz – Visualization and Steering for the Grid , 2003 .

[25]  Lance M. Berc,et al.  Continuous profiling: where have all the cycles gone? , 1997, TOCS.

[26]  Matthias Gries,et al.  Methods for evaluating and covering the design space during early design development , 2004, Integr..

[27]  Eitan Grinspun,et al.  SimX meets SCIRun: A Component-based Implementation of a Computational Study System , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[28]  Steven G. Parker,et al.  Biomedical computing and visualization software environments , 2004, CACM.

[29]  Steven G. Parker,et al.  Uintah: a massively parallel problem solving environment , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.