The Design and Implementation of Random Linear Network Coding Based Distributed Storage System in Dynamic Networks

Nowadays, different end devices with different computation and bandwidth capabilities acquire data from Internet. To improve efficiency of data storage and retrieve, in this paper, we study how to use random linear network coding to construct an efficient distributed storage system to reduce the traffic cost in a dynamic network. In order to balance the success ratio of recovery traffic cost and traffic speed, we firstly introduce a random network coding scheme and implement a practically available distributed storage system in the actual environment. We then adjust different parameters, e.g., finite fields, link bandwidth, node computing capabilities, etc., to evaluate the proposed system. Finally, experiment results show the efficiency of the proposed designs.

[1]  Jin Wang,et al.  Optimal Linear Network Coding Design for Secure Unicast with Multiple Streams , 2010, 2010 Proceedings IEEE INFOCOM.

[2]  Muriel Médard,et al.  Implementation and performance evaluation of distributed cloud storage solutions using random linear network coding , 2014, 2014 IEEE International Conference on Communications Workshops (ICC).

[3]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[4]  Andrea C. Arpaci-Dusseau,et al.  ViewBox: integrating local file systems with cloud storage services , 2014, FAST.

[5]  Jin Wang,et al.  An Efficient Reliable Communication Scheme in Wireless Sensor Networks Using Linear Network Coding , 2012, Int. J. Distributed Sens. Networks.

[6]  Jin Wang,et al.  Modeling and Optimal Design of Linear Network Coding for Secure Unicast with Multiple Streams , 2013, IEEE Transactions on Parallel and Distributed Systems.

[7]  Yang Tang,et al.  NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds , 2014, IEEE Transactions on Computers.

[8]  Yunnan Wu,et al.  Network coding for distributed storage systems , 2010, IEEE Trans. Inf. Theory.

[9]  Hai Jin,et al.  A Case for Redundant Arrays of Inexpensive Disks (RAID) , 2002 .

[10]  Alexandros G. Dimakis,et al.  Network Coding for Distributed Storage Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[11]  Ari Juels,et al.  HAIL: a high-availability and integrity layer for cloud storage , 2009, CCS.

[12]  Jeanna Neefe Matthews,et al.  The good, the bad and the ugly of consumer cloud storage , 2010, OPSR.

[13]  Bo Li,et al.  Cinematic-Quality VoD in a P2P Storage Cloud: Design, Implementation and Measurements , 2013, IEEE Journal on Selected Areas in Communications.

[14]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[15]  Yunnan Wu,et al.  A Survey on Network Codes for Distributed Storage , 2010, Proceedings of the IEEE.

[16]  Carlos Maltzahn,et al.  Ceph: a scalable, high-performance distributed file system , 2006, OSDI '06.

[17]  Peter Han Joo Chong,et al.  Scalable Distributed Cloud Data Storage Service for Internet of Things , 2016, 2016 Intl IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld).

[18]  David Mazières,et al.  A low-bandwidth network file system , 2001, SOSP.

[19]  Márton Sipos,et al.  Distributed cloud storage using network coding , 2014, 2014 IEEE 11th Consumer Communications and Networking Conference (CCNC).