A Geographically Aware Poll-Based Distributed File Consistency Maintenance Method for P2P Systems

File consistency maintenance in P2P systems is a technique for maintaining consistency between files and their replicas. Most previous consistency maintenance methods depend on either message spreading or structure-based pushing. Message spreading generates high overhead due to a large amount of messages; structure-based pushing methods reduce this overhead. However, both approaches cannot guarantee that every replica node receives an update in churn, because replica nodes passively wait for updates. As opposed to push-based methods that are not effective in high-churn and low-resource P2P systems, polling is churn resilient and generates low overhead. However, it is faced with a number of challenges: 1) ensuring a limited inconsistency; 2) realizing polling in a distributed manner; 3) considering physical proximity in polling; and 4) leveraging polling to further reduce polling overhead. To handle these challenges, this paper introduces a poll-based distributed file consistency maintenance method called geographically aware wave (GeWave). GeWave further reduces update overhead, enhances the fidelity of file consistency, and takes proximity into account. Using adaptive polling in a dynamic structure, GeWave avoids redundant file updates and ensures that every node receives an update in a limited time period even in churn. Furthermore, it propagates updates between geographically close nodes in a distributed manner. Extensive experimental results from the PlanetLab real-world testbed demonstrate the efficiency and effectiveness of GeWave in comparison with other representative consistency maintenance schemes. It dramatically reduces the overhead and yields significant improvements on effectiveness, scalability, and churn resilience of previous file consistency maintenance methods.

[1]  Gade Krishna,et al.  A scalable peer-to-peer lookup protocol for Internet applications , 2012 .

[2]  Mary Baker,et al.  CUP: Controlled Update Propagation in Peer-to-Peer Networks , 2003, USENIX Annual Technical Conference, General Track.

[3]  Zhongcheng Li,et al.  Efficient and Scalable Consistency Maintenance for Heterogeneous Peer-to-Peer Systems , 2008, IEEE Transactions on Parallel and Distributed Systems.

[4]  Rui Zhang,et al.  RBMA: Replication Based on Multilevel-Agent for P2P Systems , 2009, 2009 International Symposium on Computer Network and Multimedia Technology.

[5]  Magnus Karlsson,et al.  Turning heterogeneity into an advantage in overlay routing , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[6]  Antony I. T. Rowstron,et al.  Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility , 2001, SOSP.

[7]  Krithi Ramamritham,et al.  Consistency maintenance in peer-to-peer file sharing networks , 2003, Proceedings the Third IEEE Workshop on Internet Applications. WIAPP 2003.

[8]  Edith Cohen,et al.  Replication strategies in unstructured peer-to-peer networks , 2002, SIGCOMM.

[9]  Karl Aberer,et al.  Updates in highly unreliable, replicated peer-to-peer systems , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[10]  David R. Karger,et al.  Wide-area cooperative storage with CFS , 2001, SOSP.

[11]  Michael B. Jones,et al.  Overlook: scalable name service on an overlay network , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[12]  Jian Ni,et al.  Designing File Replication Schemes for Peer-to-Peer File Sharing Systems , 2008, 2008 IEEE International Conference on Communications.

[13]  Leonard Kleinrock,et al.  Analysis of search and replication in unstructured peer-to-peer networks , 2005, SIGMETRICS '05.

[14]  S.L. Monni Adaptive Media Replication in Unstructured P2P File Sharing Systems Based on Geographical Properties and Query Distributions , 2008, 2008 International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution.

[15]  Guohong Cao,et al.  DUP: Dynamic-Tree Based Update Propagation in Peer-to-Peer Networks , 2005, 21st International Conference on Data Engineering (ICDE'05).

[16]  Aviel D. Rubin,et al.  Publius: a robust, tamper-evident, censorship-resistant web publishing system , 2000 .

[17]  Vijay Gopalakrishnan,et al.  Adaptive replication in peer-to-peer systems , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[18]  Mary Baker,et al.  Peer-to-Peer Caching Schemes to Address Flash Crowds , 2002, IPTPS.

[19]  Susumu Shibusawa,et al.  A file replication method based on demand forecasting in P2P networks , 2009, 2009 Second International Conference on the Applications of Digital Information and Web Technologies.

[20]  Laxmi N. Bhuyan,et al.  An effective pointer replication algorithm in P2P networks , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[21]  Laxmi N. Bhuyan,et al.  A Balanced Consistency Maintenance Protocol for Structured P2P Systems , 2010, 2010 Proceedings IEEE INFOCOM.

[22]  Guiran Chang,et al.  The Improved Research of Chord Based on File-Partition Replication Strategy , 2009, 2009 Ninth International Conference on Hybrid Intelligent Systems.

[23]  Xin Chen,et al.  SCOPE: scalable consistency maintenance in structured P2P systems , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[24]  Desh Ranjan,et al.  Space Filling Curves and Their Use in the Design of Geometric Data Structures , 1995, LATIN.

[25]  Haiying Shen IRM: Integrated File Replication and Consistency Maintenance in P2P Systems , 2010, IEEE Trans. Parallel Distributed Syst..

[26]  K. Ohnishi,et al.  Thermal Diffusion-Based Access Load Balancing for P2P File Sharing Networks , 2008, 2008 The Third International Multi-Conference on Computing in the Global Information Technology (iccgi 2008).

[27]  Mark Handley,et al.  Topologically-aware overlay construction and server selection , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[28]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[29]  J. M. McGlaun,et al.  CTH: A software family for multi-dimensional shock physics analysis , 1995 .

[30]  Lin Huo,et al.  Research of Replication in Unstructured P2P Network , 2009, 2009 5th International Conference on Wireless Communications, Networking and Mobile Computing.

[31]  D. M. Chiu,et al.  Decentralized Replication Algorithms for Improving File Availability in P2P Networks , 2007, 2007 Fifteenth IEEE International Workshop on Quality of Service.

[32]  Dan Rubenstein,et al.  Can unstructured P2P protocols survive flash crowds? , 2005, IEEE/ACM Transactions on Networking.

[33]  Ben Y. Zhao,et al.  OceanStore: an architecture for global-scale persistent storage , 2000, SIGP.

[34]  Prashant J. Shenoy,et al.  Maintaining mutual consistency for cached Web objects , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[35]  Surendar Chandra,et al.  On the need for query-centric unstructured peer-to-peer overlays , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[36]  Zheng Zhang,et al.  Trading replication consistency for performance and availability: an adaptive approach , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[37]  Akbar Ghaffarpour Rahbar,et al.  PowerTrust: A Robust and Scalable Reputation System for Trusted Peer-to-Peer Computing , 2007, IEEE Transactions on Parallel and Distributed Systems.

[38]  Haiying Shen GeWave: Geographically-Aware Wave for File Consistency Maintenance in P2P Systems , 2008, 2008 37th International Conference on Parallel Processing.

[39]  David R. Karger,et al.  Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web , 1997, STOC '97.

[40]  Leonard Kleinrock,et al.  Proportional Replication in Peer-to-Peer Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.