Dynamic Replication Strategy in Data Grid Environment

Replication techniques in data grid are widely used to improve data access time, to reduce bandwidth consumption and to increase fault tolerance. A replication technique is highly dependent upon architecture of grid. Many replications strategies are employed by some major topologies used in data environment such as tree, multi-tier or peer to peer (P2P) architecture. In this paper we focus on dynamic replication strategy in peer to peer architecture. This technology has recently experienced a large development in the file sharing area and is used strongly by the large public. They are an effective method of sharing resources between people with the same expectations. These systems enjoy a growing reputation, mainly due to the many applications of distributed collaboration and their specific needs of data replication, scalability and high availability. Through this paper, we propose a policy to provide a good availability of shared data. Our solution is to replicate these data strategically, by defining the data to be replicated, their number, where they will be placed and to remove excess data in order to release space storage if necessary. Our strategy takes into account the data popularity, the volatility and the storage capacity of the different sites. The simulation shows that the proposed algorithm reduces the data access time and number of replicas created avoiding unnecessary replication

[1]  Hanoch Levy,et al.  Efficient replication in multi-regional peer-supported VoD systems , 2012, PERV.

[2]  Ian S. Burnett,et al.  Facilitating Universal Multimedia Adaptation (UMA) in a Heterogeneous Peer-to-Peer Network , 2006, 2006 Second International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'06).

[3]  Zahir Tari,et al.  Load Sharing in Peer-to-Peer Networks using Dynamic Replication , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[4]  Mohan Kumar,et al.  Efficient Simulation Architecture for Routing and Replication in Mobile Peer to Peer Network of UAVs , 2010, 2010 Eleventh International Conference on Mobile Data Management.

[5]  Idrissa Sarr,et al.  Lifetime-Based Dynamic Data Replication in P2P systems , 2011, Globe.

[6]  Sabu M. Thampi,et al.  Autonomous Data Replication Using Q-Learning for Unstructured P2P Networks , 2007, Sixth IEEE International Symposium on Network Computing and Applications (NCA 2007).

[7]  Ralf Steinmetz,et al.  The effectiveness of realistic replication strategies on quality of availability for peer-to-peer systems , 2003, Proceedings Third International Conference on Peer-to-Peer Computing (P2P2003).

[8]  Edith Cohen,et al.  Replication strategies in unstructured peer-to-peer networks , 2002, SIGCOMM.

[9]  Naixue Xiong,et al.  RFH: A Resilient, Fault-Tolerant and High-Efficient Replication Algorithm for Distributed Cloud Storage , 2012, 2012 41st International Conference on Parallel Processing.

[10]  Jianzhong Li,et al.  A Comparative Study of Replica Placement Strategies in Data Grids , 2007, APWeb/WAIM Workshops.

[11]  Pierre-François Marteau,et al.  Information Replication Strategy in Unstructured Peer-to-Peer Networks Using Thematic Agents , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[12]  Adam Wierzbicki,et al.  Cache replacement policies revisited: the case of P2P traffic , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..

[13]  Jon Crowcroft,et al.  A survey and comparison of peer-to-peer overlay network schemes , 2005, IEEE Communications Surveys & Tutorials.

[14]  Roie Melamed,et al.  Adaptive and dynamic funnel replication in clouds , 2012, OPSR.

[15]  Takahiro Hara,et al.  A Dynamic Cluster Construction Method Based on Query Characteristics in Peer-to-Peer Networks , 2009, 2009 First International Conference on Advances in P2P Systems.

[16]  Takahiro Hara,et al.  A Replica Relocation Method for Improving Search Efficiency in P2P Networks , 2009, 2009 First International Conference on Advances in P2P Systems.

[17]  Leonard Kleinrock,et al.  Proportional Replication in Peer-to-Peer Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[18]  Hector Garcia-Molina,et al.  Designing a super-peer network , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[19]  Letian Rong.  Multimedia Resource Replication Strategy for a Pervasive Peer-to-Peer Environment , 2008, J. Comput..

[20]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[21]  Gerhard Weikum,et al.  Near-optimal dynamic replication in unstructured peer-to-peer networks , 2008, PODS.

[22]  Ben Y. Zhao,et al.  Searching for Rare Objects Using Index Replication , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[23]  Sabu M. Thampi,et al.  Survey of Search and Replication Schemes in Unstructured P2p Networks , 2010, Netw. Protoc. Algorithms.

[24]  D. M. Chiu,et al.  Decentralized Replication Algorithms for Improving File Availability in P2P Networks , 2007, 2007 Fifteenth IEEE International Workshop on Quality of Service.

[26]  Takahiro Hara,et al.  A Dynamic Cluster Construction Method Based on Characteristics of Query Generation in Peer-to-Peer Networks , 2011, 2011 IEEE Workshops of International Conference on Advanced Information Networking and Applications.

[27]  Detlef Schoder,et al.  Peer-to-peer prospects , 2003, CACM.

[28]  James L. Schwing,et al.  An Adaptive Replication Algorithm in P2P File Systems with Unreliable Nodes , 2009, PDPTA.

[29]  S. N. Sivanandam,et al.  A Cluster Based Replication Architecture for Load Balancing in Peer-to-Peer Content Distribution , 2010, ArXiv.

[30]  Ruixuan Li,et al.  Proactive Replication and Search for Rare Objects in Unstructured Peer-to-Peer Networks , 2010, WAIM.

[31]  Atsuhiro Takasu,et al.  Adaptive Replication Method Based on Peer Behavior Pattern in Unstructured Peer-to-Peer Systems , 2005, 21st International Conference on Data Engineering Workshops (ICDEW'05).

[32]  Edith Cohen,et al.  Search and replication in unstructured peer-to-peer networks , 2002, ICS '02.