Synchronizing namespaces with invertible bloom filters

Data synchronization-long a staple in le systems-is emerging as a signicant communications primitive. In a distributed system, data synchronization resolves di erences among distributed sets of information. In named data networking (NDN), an information-centric communications architecture, data synchronization between multiple nodes is widely used to support basic services, such as public key distribution, le sharing, and route distribution. While existing NDN synchronization schemes are unctional, their implementations rely on log-based representations of information, which creates a limitation on their performance and scalability. This paper presents iSync, a high performance synchronization protocol for NDN. iSync supports efficient data reconciliation by representing the synchronized datasets using a two-level invertible Bloomfilter (IBF) structure. A set-differences can be found by subtracting a remote IBF from a local IBF. The protocol can obtain multiple differences from a single round of data exchange, and does not require prior context in most application scenarios. We evaluated iSync's performance by comparing it to the CCNx synchronization protocol. Experiments show that iSync is about eight times faster across a range of network topologies and sizes, and that it reduces the number of packets sent by about 90%.

[1]  Giovanni Bartolomeo,et al.  Named Data Networking Project , 2013 .

[2]  Giovanni Pau,et al.  Vehicular Inter-Networking via Named Data , 2013, ArXiv.

[3]  George Varghese,et al.  What's the difference?: efficient set reconciliation without prior context , 2011, SIGCOMM.

[4]  Michael T. Goodrich,et al.  Invertible bloom lookup tables , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  Cedric Westphal Synchronizing state with strong similarity between local and remote systems , 2012, MCS '12.

[6]  Paul Mackerras,et al.  The rsync algorithm , 1996 .

[7]  Jean-Sébastien Coron,et al.  Merkle-Damgård Revisited: How to Construct a Hash Function , 2005, CRYPTO.

[8]  Ralph C. Merkle,et al.  A fast software one-way hash function , 1990, Journal of Cryptology.

[9]  Alexander Afanasyev,et al.  Chronos : Serverless Multi-User Chat Over NDN , 2012 .

[10]  Witold Litwin,et al.  Linear Hashing: A new Algorithm for Files and Tables Addressing , 1980, ICOD.

[11]  Sachin Agarwal,et al.  On the scalability of data synchronization protocols for PDAs and mobile devices , 2002, IEEE Netw..

[12]  Giovanni Pau,et al.  ACM HotMobile 2013 poster: vehicular inter-networking via named data , 2013, MOCO.

[13]  Priya Mahadevan,et al.  Custodian-based information sharing , 2012, IEEE Communications Magazine.

[14]  Alexander Afanasyev,et al.  Let's ChronoSync: Decentralized dataset state synchronization in Named Data Networking , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[15]  Ralph C. Merkle,et al.  A Certified Digital Signature , 1989, CRYPTO.

[16]  Gary D. Knott,et al.  Expandable open addressing hash table storage and retrieval , 1971, SIGFIDET '71.

[17]  Fred Kuhns,et al.  A remotely accessible network processor-based router for network experimentation , 2008, ANCS '08.