A Neural Network Based Methodology for Performance Evaluation of Parallel Systems

In this study we propose a method using multi layer perceptron (MLP) neural networks to evaluate and predict the performance of parallel systems and report our findings. Artificial neural networks may provide a good alternative to conventional methods in terms of identifying the contribution of individual system and application parameters to performance. Neural network models presented here are used to predict the computational and communication performance of parallel applications running on different platforms. Two applications are considered: the first one is a 2-Dimensional Fast Fourier Transform (FFT) application that requires intensive data exchange between processors, which is valuable for communication performance tests and the second one is a Monte Carlo application which can be classified as a typical floating-point application. There are two types of data used to train, validate and test the neural network models. A large portion of the input data composed from real measurements taken on SunSparc workstations. To enhance the available data, results obtained by modeling some unavailable systems into PACE (the Performance Analysis and Characterization Environment) have been also included.

[1]  Peter S. Pacheco Parallel programming with MPI , 1996 .

[2]  Heinrich Niemann,et al.  An appearance based neural image processing algorithm for 3-D object recognition , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  Anthony Skjellum,et al.  Using MPI - portable parallel programming with the message-parsing interface , 1994 .

[4]  Donald Ervin Knuth,et al.  The Art of Computer Programming, 2nd Ed. (Addison-Wesley Series in Computer Science and Information , 1978 .

[5]  Z. Neji,et al.  Neural network and time series identification and prediction , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[6]  David J. Lilja,et al.  Measuring computer performance : A practitioner's guide , 2000 .

[7]  Marc A. Hamilton Java and the Shift to Net-Centric Computing , 1996, Computer.

[8]  Jack Dongarra,et al.  Computer benchmarking: paths and pitfalls , 1987 .

[9]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[10]  Peter Jaeckel,et al.  Monte Carlo methods in finance , 2002 .

[11]  Robert J. Marks,et al.  Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks , 1999 .

[12]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[13]  Lizy Kurian John,et al.  More on finding a single number to indicate overall performance of a benchmark suite , 2004, CARN.

[14]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[15]  Graham R. Nudd,et al.  Pace—A Toolset for the Performance Prediction of Parallel and Distributed Systems , 2000, Int. J. High Perform. Comput. Appl..

[16]  Walt Scacchi,et al.  Integrating diverse information repositories: a distributed hypertext approach , 1991, Computer.

[17]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .