Adaptive load sharing for network processors

A novel scheme for processing packets in a router is presented, which provides for load sharing among multiple network processors distributed within the router. It is complemented by a feedback control mechanism designed to prevent processor overload. Incoming traffic is scheduled to multiple processors based on a deterministic mapping. The mapping formula is derived from the robust hash routing (also known as the highest random weight - HRW) scheme, introduced in K.W. Ross, IEEE Network, vol. 11, no. 6 (1997), and D.G. Thaler et al, IEEE Trans. Networking, vol. 6, no. 1 (1998). No state information on individual flow mapping needs to be stored, but for each packet, a mapping function is computed over an identifier vector, a predefined set of fields in the packet. An adaptive extension to the HRW scheme is provided in order to cope with biased traffic patterns. We prove that our adaptation possesses the minimal disruption property with respect to the mapping and exploit that property in order to minimize the probability of flow reordering. Simulation results indicate that the scheme achieves significant improvements in processor utilization. A higher number of router interfaces can thus be supported with the same amount of processing power.

[1]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[2]  Thomas Kunz,et al.  The Influence of Different Workload Descriptions on a Heuristic Load Balancing Scheme , 1991, IEEE Trans. Software Eng..

[3]  Martina Zitterbart,et al.  Analysis of TCP/IP for high performance parallel implementations , 1992, [1992] Proceedings 17th Conference on Local Computer Networks.

[4]  H. V. Jagadish,et al.  Towards a Gigabit IP Router , 1992, J. High Speed Networks.

[5]  Martina Zitterbart,et al.  Multiprocessing in High Performance IP Routers , 1992, Protocols for High-Speed Networks.

[6]  H. Ali,et al.  Task Scheduling in Multiprocessing Systems , 1995, Computer.

[7]  Keith W. Ross,et al.  Hash routing for collections of shared Web caches , 1997, IEEE Netw..

[8]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[9]  C. Semeria,et al.  Internet Backbone Routers and Evolving Internet Design , 1998 .

[10]  David Thaler,et al.  Using name-based mappings to increase hit rates , 1998, TNET.

[11]  T. V. Lakshman,et al.  Beyond best effort: router architectures for the differentiated services of tomorrow's Internet , 1998, IEEE Commun. Mag..

[12]  Oscar H. Ibarra,et al.  Adaptive load sharing for clustered digital library servers , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[13]  Victor C. M. Leung,et al.  A framework for optimizing the cost and performance of next-generation IP routers , 1999, IEEE J. Sel. Areas Commun..

[14]  Germán S. Goldszmidt,et al.  Scaling Internet services by dynamic allocation of connections , 1999, Integrated Network Management VI. Distributed Management for the Networked Millennium. Proceedings of the Sixth IFIP/IEEE International Symposium on Integrated Network Management. (Cat. No.99EX302).

[15]  G. Barish,et al.  World Wide Web caching: trends and techniques , 2000, IEEE Commun. Mag..

[16]  Craig Partridge,et al.  A Fifty Gigabit Per Second IP Router , 2001 .