Reduced distance routing in single-state shuffle-exchange interconnection networks

In multiprocessor architectures, it is frequently necessary to provide parallel communication among a potentially large number of processors and memories. Among the many interconnection schemes that have been proposed and analyzed, shuffle-exchange networks have received much attention due to their ability to allow a message to pass from any node to any other node in a number of steps that grows only logarithmically with the number of interconnected nodes (in the absence of contention) while keeping the number of hardware connections per node independent of the number of nodes. Straight-forward use of shuffle-exchange networks to interconnect &Ngr; nodes involves having every packet pass through log2 &Ngr; stages enroute to its destination. By exploiting common structure in the addresses of the source and destination nodes, however, more sophisticated routing can reduce the average number of steps per message below log2 &Ngr;. In this paper, we describe and evaluate three levels of improvements to basic single-stage shuffle-exchange routing. Each one yields successively more benefit at the cost of more complexity. Using simulation, we show that the use of routing schemes that reduce the average distance can substantially reduce average message delay times and increase interconnection network capacity. We quantify the performance gains only in the case where messages from one node are destined with uniform probability over all nodes. However, it is clear that the advantage of the new schemes we propose would be still greater if there is some “locality” of communication that can be exploited by having the most frequent communication occur between pairs of nodes with shorter distances separating them.

[1]  Pen-Chung Yew On the design of interconnection networks for parallel and multiprocessor systems , 1981 .

[2]  Marshall C. Pease,et al.  The Indirect Binary n-Cube Microprocessor Array , 1977, IEEE Transactions on Computers.

[3]  Kenneth E. Batcher,et al.  The flip network in staran , 1976 .

[4]  Jean-Michel Fourneau,et al.  Equivalence of Multistage Interconnection Networks , 1987, Inf. Process. Lett..

[5]  Sartaj Sahni,et al.  An optimal routing algorithm for mesh-connected Parallel computers , 1980, JACM.

[6]  Suchai Thanawastien,et al.  Interference Analysis of Shuffle/Exchange Networks , 1981, IEEE Transactions on Computers.

[7]  Manoj Kumar,et al.  Performance of Unbuffered Shuffle-Exchange Networks , 1986, IEEE Transactions on Computers.

[8]  Dharma P. Agrawal,et al.  Evaluating the performance of multicomputer configurations , 1986 .

[9]  Tse-Yun Feng,et al.  The Reverse-Exchange Interconnection Network , 1980, IEEE Trans. Computers.

[10]  Gregory F. Pfister,et al.  “Hot spot” contention and combining in multistage interconnection networks , 1985, IEEE Transactions on Computers.

[11]  David A. Padua,et al.  Interconnection Networks Using Shuffles , 1981, Computer.

[12]  Manoj Kumar,et al.  Performance enhancement in buffered delta networks using crossbar switches and multiple links , 1984, J. Parallel Distributed Comput..

[13]  Dharma P. Agrawal,et al.  Testing and Fault Tolerance of Multistage Interconnection Networks , 1982, Computer.

[14]  Dharma P. Agrawal,et al.  Generalized Hypercube and Hyperbus Structures for a Computer Network , 1984, IEEE Transactions on Computers.

[15]  Duncan H. Lawrie,et al.  Access and Alignment of Data in an Array Processor , 1975, IEEE Transactions on Computers.

[16]  Dharma P. Agrawal,et al.  Design and Performance of Generalized Interconnection Networks , 1983, IEEE Transactions on Computers.

[17]  Manoj Kumar,et al.  Comments on "Interference Analysis of Shuffle/Exchange Networks" , 1982, IEEE Trans. Computers.

[18]  Kai Hwang,et al.  Packet Switching Networks for Multiprocessors and Data Flow Computers , 1984, IEEE Trans. Computers.

[19]  Debasis Mitra,et al.  Randomized parallel communications on an extension of the omega network , 1987, JACM.

[20]  David A. Padua,et al.  High-Speed Multiprocessors and Compilation Techniques , 1980, IEEE Transactions on Computers.

[21]  Shing-Tsaan Huang,et al.  Finite State Model and Compatibility Theory: New Analysis Tools for Permutation Networks , 1986, IEEE Transactions on Computers.

[22]  Franco P. Preparata,et al.  The cube-connected-cycles: A versatile network for parallel computation , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[23]  A. Yavuz Oruç,et al.  Equivalence relations among interconnection networks , 1985, J. Parallel Distributed Comput..

[24]  Marc Snir,et al.  The Performance of Multistage Interconnection Networks for Multiprocessors , 1983, IEEE Transactions on Computers.

[25]  Duncan H. Lawrie,et al.  A Class of Redundant Path Multistage Interconnection Networks , 1983, IEEE Transactions on Computers.

[26]  Ian Watson,et al.  The Manchester prototype dataflow computer , 1985, CACM.

[27]  Douglas Stott Parker,et al.  Notes on Shuffle/Exchange-Type Switching Networks , 1980, IEEE Transactions on Computers.

[28]  Janak H. Patel,et al.  Processor-memory interconnections for multiprocessors , 1979, ISCA '79.

[29]  Daniel M. Dias,et al.  Analysis and Simulation of Buffered Delta Networks , 1981, IEEE Transactions on Computers.

[30]  Marshall C. Pease,et al.  An Adaptation of the Fast Fourier Transform for Parallel Processing , 1968, JACM.

[31]  Janak H. Patel Performance of Processor-Memory Interconnections for Multiprocessors , 1981, IEEE Transactions on Computers.

[32]  Tse-yun Feng,et al.  A Survey of Interconnection Networks , 1981, Computer.

[33]  Pen-Chung Yew,et al.  Performance of packet switching in buffered single-stage shuffle-exchange networks , 1982, ICDCS.

[34]  Tse-Yun Feng,et al.  The Universality of the Shuffle-Exchange Network , 1981, IEEE Transactions on Computers.

[35]  Larry D. Wittie,et al.  Communication Structures for Large Networks of Microcomputers , 1981, IEEE Transactions on Computers.

[36]  Shing-Tsaan Huang,et al.  Self-Routing Technique in Perfect-Shuffle Networks Using Control Tags , 1988, IEEE Trans. Computers.

[37]  Charles L. Seitz,et al.  The cosmic cube , 1985, CACM.

[38]  Harold S. Stone,et al.  Parallel Processing with the Perfect Shuffle , 1971, IEEE Transactions on Computers.

[39]  Miroslaw Malek,et al.  On Permuting Properties of Regular Rectangular SW-Banyans , 1985, IEEE Transactions on Computers.

[40]  Laxmi N. Bhuyan An Analysis of Processor-Memory Interconnection Networks , 1985, IEEE Transactions on Computers.

[41]  Howard Jay Siegel,et al.  Many SIMD interconnection networks have been proposed . To put the different approaches into perspective , this analysis compares a number of single-and multistage networks , 2022 .

[42]  Daniel M. Dias,et al.  Packet Switching Interconnection Networks for Modular Systems , 1981, Computer.

[43]  Dharma P. Agrawal,et al.  Dynamic Accessibility Testing and Path Length Optimization of Multistage Interconnection Networks , 1985, IEEE Transactions on Computers.

[44]  Kevin P. McAuliffe,et al.  RP3 Processor-Memory Element , 1985, ICPP.

[45]  A. Mullin,et al.  Mathematical Theory of Connecting Networks and Telephone Traffic. , 1966 .