Storage and Bandwidth Optimized Reliable Distributed Data Allocation Algorithm

Distributedstorageallocationproblemsareanimportantoptimizationprobleminreliabledistributed storage,whichaimstominimizestoragecostwhilemaximizingerrorrecoveryprobabilitybyoptimal storageofdataindistributedstoragenodes.Akeycharacteristicofdistributedstorageisthatdatais storedinremoteserversacrossanetwork.Thus,networkresourcesespeciallycommunicationlinksare anexpensiveandnon-trivialresourcewhichshouldbeoptimizedaswell.Inthisarticle,theauthors presentasimulation-basedstudyofthenetworkcharacteristicsofadistributedstoragenetworkinthe lightofseveralallocationpatterns.Byvaryingtheallocationpatterns,theauthorshavedemonstrated theinterdependencebetweennetworkbandwidth,definedintermsoflinkcapacityandallocation patternusingnetworkthroughputasametric.Motivatedbyobservingtheimportanceofnetwork resourceasanimportantcostmetric,theauthorshaveformalizedanoptimizationproblemthatjointly minimizesboththestoragecostandthecostofnetworkresources.Ahybridmetaheuristicalgorithm isemployedthatsolvesthisoptimizationproblembyallocatingdatainadistributedstoragesystem. Experimentalresultsvalidatetheefficacyofthealgorithm. KeywORDS Data Placement Algorithm, Distributed Storage Allocation, Genetic Algorithm, Multi-Objective Optimization, Network and Storage Optimized Storage System, Particle Swarm Optimization

[1]  Hugues Mercier,et al.  Reliability-bandwidth tradeoffs for distributed storage allocations , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[2]  Chuan Heng Foh,et al.  Towards reproducible performance studies of datacenter network architectures using an open-source simulation approach , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[3]  Albert Y. Zomaya,et al.  Quantitative comparisons of the state‐of‐the‐art data center architectures , 2013, Concurr. Comput. Pract. Exp..

[4]  Alexandros G. Dimakis,et al.  Distributed Storage Allocations , 2010, IEEE Transactions on Information Theory.

[5]  Samiran Chattopadhyay,et al.  An efficient GA-PSO approach for solving mixed-integer nonlinear programming problem in reliability optimization , 2014, Swarm Evol. Comput..

[6]  Wei Chen,et al.  MORM: A Multi-objective Optimized Replication Management strategy for cloud storage cluster , 2014, J. Syst. Archit..

[7]  Alexandros G. Dimakis,et al.  Allocations for heterogenous distributed storage , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[8]  Alexandros G. Dimakis,et al.  Distributed storage allocation problems , 2009, 2009 Workshop on Network Coding, Theory, and Applications.

[9]  Samiran Chattopadhyay,et al.  Minimization of reliability indices and cost of power distribution systems in urban areas using an efficient hybrid meta-heuristic algorithm , 2017, Soft Comput..

[10]  Zhao Li,et al.  Distributed storage allocation for heterogeneous systems , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Pablo M. Olmos,et al.  On Distributed Storage Allocations for Memory-Limited Systems , 2014, GLOBECOM 2014.