Hybrid Key Duplication Hashing Techniques for IP Address Lookup

This In the past decade there has been an increasing need for designs to address the time and cost efficiency issues from various computer network applications such as general IP address lookup and specific network intrusion detection. Hashing techniques have been widely adopted for this purpose, among which XOR-operation-based hashing is one of most popular techniques due to its relatively small hash process delay. In most current commonly used XOR-hashing algorithms, each of the hash key bits is usually explicitly XORed only at most once in the hash process, which may limit the amount of potential randomness that can be introduced by the hashing process. In [1] a series of bit duplication techniques are proposed by systematically duplicating one row of key bits. This paper further looks into various ways in duplicating and reusing key bits to maximize randomness needed in the hashing process so as to enhance the overall performance further. Our simulation results show that, even with a slight increase in hardware requirement, a very significant reduction in the amount of hash collision can be obtained by the proposed technique.

[1]  Wei-Ming Lin,et al.  Advanced hashing techniques for non-uniformly distributed IP address lookup , 2006, Communications and Computer Networks.

[2]  Wei-Ming Lin,et al.  Advanced Hashing with Hybrid Key Duplication for IP Address Lookup , 2010, 2010 Ninth IEEE International Symposium on Network Computing and Applications.

[3]  Peter Newman,et al.  IP switching and gigabit routers , 1997, IEEE Commun. Mag..

[4]  Mehmet Toy,et al.  A trie-based algorithm for IP lookup problem , 2000, Globecom '00 - IEEE. Global Telecommunications Conference. Conference Record (Cat. No.00CH37137).

[5]  Wei-Ming Lin,et al.  Adaptive Hashing for IP Address Lookup in Computer Networks , 2006, 2006 14th IEEE International Conference on Networks.

[6]  Xiaojun Nie,et al.  IP address lookup using a dynamic hash function , 2005, Canadian Conference on Electrical and Computer Engineering, 2005..

[7]  C.J. Martinez,et al.  On Designing Fast Nonuniformly Distributed IP Address Lookup Hashing Algorithms , 2009, IEEE/ACM Transactions on Networking.

[8]  Bernhard Plattner,et al.  Scalable high speed IP routing lookups , 1997, SIGCOMM '97.

[9]  Donald E. Knuth,et al.  Ordered Hash Tables , 1974, Comput. J..

[10]  Raj Jain,et al.  A comparison of hashing schemes for address lookup in computer networks , 1992, IEEE Trans. Commun..

[11]  Daxiao Yu,et al.  Forwarding engine for fast routing lookups and updates , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[12]  Kwan Lawrence Yeung,et al.  Efficient hardware architecture for fast IP address lookup , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[13]  Wei-Ming Lin,et al.  Advanced Hash Algorithms with Key Bits Duplication for IP Address Lookup , 2009, 2009 Fifth International Conference on Networking and Services.

[14]  Walid Dabbous,et al.  Survey and taxonomy of IP address lookup algorithms , 2001, IEEE Netw..

[15]  Andrei Z. Broder,et al.  Using multiple hash functions to improve IP lookups , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[16]  George Varghese,et al.  Faster IP lookups using controlled prefix expansion , 1998, SIGMETRICS '98/PERFORMANCE '98.

[17]  Andreas Moestedt,et al.  Lookup in Hardware for High-Speed Routing , 1998 .

[18]  Gunnar Karlsson,et al.  IP-address lookup using LC-tries , 1999, IEEE J. Sel. Areas Commun..

[19]  Hyunsoo Yoon,et al.  A fast and updatable IP address lookup scheme , 2001, Proceedings 2001 International Conference on Computer Networks and Mobile Computing.