Performance analysis for parallel solutions to generic search problems

A b s t r a c t The performance analysis of parallel algor i thms for search problems is discussed in this paper. Using the Traveling Salesman Problem (TSP) as the prototype of the search problems, we propose the use of a performance analysis methodolosy for such parallel computat ions b a s e d o n probabilistlc theory. Dtvideand-conquer s trategy is widely used in solving search problems in pa ra l l e l by parti t ioning and allocating a number of given tasks to available computing resources. When the tasks exhibit nondeterministic behaviors during execution and share a universal distribution function in their execution times, analysis of parallel execution time can be performed with the assistance of probabilistic and stat ist ical models given in this paper. Correlation (dependence) in execution times among tasks has posed a significant factor in influencin G the analysis accuracy which is unmanageable by any Known analysis methodologies. We establish a relation between a task's o r / and a processor's execution time and the parallel execution time, in terms of expected value as well as variance when each task's execution time can be closely modeled by a normal distribution, for either uncorrelated or correlated tasks. The method proposed has a wider application scope and gives more accurate analysis results titan previously known approaches. Experimental results in analyzing two parallel algorithms for solving TSP show very accurate analysis with the proposed method.

[1]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[2]  Alan Weiss,et al.  Allocating Independent Subtasks on Parallel Processors , 1985, IEEE Transactions on Software Engineering.

[3]  M. J. Quinn,et al.  Analytical performance prediction on multicomputers , 1993, Supercomputing '93.

[4]  Jon G. Kuhl,et al.  Stochastic Performance Models of Parallel Task Systems , 1994, SIGMETRICS.

[5]  Kin K. Leung,et al.  Task Response Time For Real-Time Distributed Systems With Resource Contentions , 1991, IEEE Trans. Software Eng..

[6]  Randolph D. Nelson,et al.  A performance evaluation of a general parallel processing model , 1990, SIGMETRICS '90.

[7]  Arjan J. C. van Gemund,et al.  Performance prediction of parallel processing systems: the PAMELA methodology , 1993, ICS '93.

[8]  Eugene L. Lawler,et al.  The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization , 1985 .

[9]  D. Farnsworth A First Course in Order Statistics , 1993 .

[10]  Dharma P. Agrawal,et al.  A Randomized Parallel Backtracking Algorithm , 1988, IEEE Trans. Computers.

[11]  Vivek Sarkar,et al.  Processor Scheduling Algorithms for Constraint-Satisfaction Search Problems , 1988, ICPP.

[12]  Benjamin W. Wah,et al.  Coping with Anomalies in Parallel Branch-and-Bound Algorithms , 1986, IEEE Transactions on Computers.

[13]  Dan C. Marinescu,et al.  Synchronization and load imbalance effects in distributed memory multi-processor systems , 1991, Concurr. Pract. Exp..

[14]  Alex Kapelnikov,et al.  A Modeling Methodology for the Analysis of Concurrent Systems and Computations , 1989, J. Parallel Distributed Comput..

[15]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  R. Jonker,et al.  A branch and bound algorithm for the symmetric traveling salesman problem based on the 1-tree relaxation , 1982 .

[17]  A. Volgenant,et al.  Nonoptimal Edges for the Symmetric Traveling Salesman Problem , 1984, Oper. Res..

[18]  N. Biggs THE TRAVELING SALESMAN PROBLEM A Guided Tour of Combinatorial Optimization , 1986 .

[19]  Vipin Kumar,et al.  On the Efficiency of Parallel Backtracking , 1993, IEEE Trans. Parallel Distributed Syst..

[20]  Roland R. Mielke,et al.  Prediction of Performance and Processor Requirements in Real-Time Data Flow Architectures , 1993, IEEE Trans. Parallel Distributed Syst..

[21]  Michel Dubois,et al.  Performance of Synchronized Iterative Processes in Multiprocessor Systems , 1982, IEEE Transactions on Software Engineering.

[22]  S. Madala,et al.  Performance of Synchronous Parallel Algorithms with Regular Structures , 1991, IEEE Trans. Parallel Distributed Syst..

[23]  J. T. Robinson,et al.  Some Analysis Techniques for Asynchronous Multiprocessor Algorithms , 1979, IEEE Transactions on Software Engineering.

[24]  Asser N. Tantawi,et al.  Performance analysis of parallel processing systems , 1987, SIGMETRICS '87.

[25]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[26]  John Gaschnig,et al.  A General Backtrack Algorithm That Eliminates Most Redundant Tests , 1977, IJCAI.

[27]  Robert M. Haralick,et al.  Increasing Tree Search Efficiency for Constraint Satisfaction Problems , 1979, Artif. Intell..

[28]  Bo Yang,et al.  Load balancing technique for parallel search with statistical model , 1995, Proceedings International Phoenix Conference on Computers and Communications.

[29]  Richard E. Korf,et al.  Optimal path-finding algorithms* , 1988 .

[30]  Stephen F. Lundstrom,et al.  Predicting Performance of Parallel Computations , 1990, IEEE Trans. Parallel Distributed Syst..

[31]  V. Nageshwara Rao,et al.  Scalable parallel formulations of depth-first search , 1990 .

[32]  Linda F. Wilson,et al.  Synchronization and communication in algorithmic structures , 1994, Proceedings of 1994 6th IEEE Symposium on Parallel and Distributed Processing.

[33]  Michael J. Quinn,et al.  Analysis and Implementation of Branch-and Bound Algorithms on a Hypercube Multicomputer , 1990, IEEE Trans. Computers.

[34]  Vishwani D. Agrawal,et al.  Performance Analysis of Synchronized Iterative Algorithms on Multiprocessor Systems , 1992, IEEE Trans. Parallel Distributed Syst..

[35]  Mary K. Vernon,et al.  The influence of random delays on parallel execution times , 1993, SIGMETRICS '93.

[36]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[37]  Giovanni Rinaldi,et al.  A Branch-and-Cut Algorithm for the Resolution of Large-Scale Symmetric Traveling Salesman Problems , 1991, SIAM Rev..

[38]  Vivek Sarkar,et al.  Determining average program execution times and their variance , 1989, PLDI '89.

[39]  Reinhard Lüling,et al.  Solving the traveling salesman problem with a distributed branch-and-bound algorithm on a 1024 processor network , 1995, Proceedings of 9th International Parallel Processing Symposium.