When Blockchain Meets Distributed File Systems: An Overview, Challenges, and Open Issues

Constructing globally distributed file systems (DFS) has received great attention. Traditional Peer-to-Peer (P2P) distributed file systems have inevitable drawbacks such as instability, lacking auditing and incentive mechanisms. Thus, Inter-Planetary File System (IPFS) and Swarm, as the representative DFSs which integrate with blockchain technologies, are proposed and becoming a new generation of distributed file systems. Although the blockchain-based DFSs successfully provide adequate incentives and security guarantees by exploiting the advantages of blockchain, a series of challenges, such as scalability and privacy issues, are also constraining the development of the new generation of DFSs. Mainly focusing on IPFS and Swarm, this paper conducts an overview of the rationale, layered structure and cutting-edge studies of the blockchain-based DFSs. Furthermore, we also identify their challenges, open issues and future directions. We anticipate that this survey can shed new light on the subsequent studies related to blockchain-based distributed file systems.

[1]  Iddo Bentov,et al.  Proof of Activity: Extending Bitcoin's Proof of Work via Proof of Stake [Extended Abstract]y , 2014, PERV.

[2]  Radu State,et al.  IPFS for Reduction of Chain Size in Ethereum , 2018, 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[3]  Michael Szydlo,et al.  Merkle Tree Traversal in Log Space and Time , 2004, EUROCRYPT.

[4]  Matei Ripeanu,et al.  Peer-to-peer architecture case study: Gnutella network , 2001, Proceedings First International Conference on Peer-to-Peer Computing.

[5]  Nathaniel Good,et al.  Usability and privacy: a study of Kazaa P2P file-sharing , 2003, CHI '03.

[6]  Yueming Lu,et al.  Reportcoin: A Novel Blockchain-Based Incentive Anonymous Reporting System , 2019, IEEE Access.

[7]  Juan Benet,et al.  IPFS - Content Addressed, Versioned, P2P File System , 2014, ArXiv.

[8]  Yoichi Hirai,et al.  Defining the Ethereum Virtual Machine for Interactive Theorem Provers , 2017, Financial Cryptography Workshops.

[9]  Tom Fawcett,et al.  Fraud detection , 2002 .

[10]  David Mazières,et al.  Democratizing Content Publication with Coral , 2004, NSDI.

[11]  Hui Li,et al.  An improved P2P file system scheme based on IPFS and Blockchain , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[12]  Joseph Poon,et al.  Plasma : Scalable Autonomous Smart Contracts , 2017 .

[13]  Antonio A. Sánchez-Ruiz-Granados,et al.  Towards a Decentralized Process for Scientific Publication and Peer Review using Blockchain and IPFS , 2019, HICSS.

[14]  Oscar Wennergren,et al.  Transparency analysis of Distributed file systems : With a focus on InterPlanetary File System , 2018 .

[15]  Zibin Zheng,et al.  An Overview of Blockchain Technology: Architecture, Consensus, and Future Trends , 2017, 2017 IEEE International Congress on Big Data (BigData Congress).

[16]  Theodore H. Poister,et al.  Performance monitoring , 1996 .

[17]  Zibin Zheng,et al.  Market Manipulation of Bitcoin: Evidence from Mining the Mt. Gox Transaction Network , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[18]  Shawn Wilkinson,et al.  Storj A Peer-to-Peer Cloud Storage Network , 2014 .

[19]  Song Guo,et al.  Bridge the Trustworthiness Gap amongst Multiple Domains: A Practical Blockchain-based Approach , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[20]  Matthew Green,et al.  Zerocoin: Anonymous Distributed E-Cash from Bitcoin , 2013, 2013 IEEE Symposium on Security and Privacy.

[21]  Hovav Shacham,et al.  Compact Proofs of Retrievability , 2008, Journal of Cryptology.

[22]  Andrew Miller,et al.  Measuring Ethereum Network Peers , 2018, Internet Measurement Conference.

[23]  Eli Ben-Sasson,et al.  Zerocash: Decentralized Anonymous Payments from Bitcoin , 2014, 2014 IEEE Symposium on Security and Privacy.

[24]  Jeremy Clark,et al.  Mixcoin: Anonymity for Bitcoin with Accountable Mixes , 2014, Financial Cryptography.

[25]  Weifa Liang,et al.  Coflow-Like Online Data Acquisition from Low-Earth-Orbit Datacenters , 2020, IEEE Transactions on Mobile Computing.

[26]  David Mazières,et al.  Sloppy Hashing and Self-Organizing Clusters , 2003, IPTPS.

[27]  Yaling Zhang,et al.  A Blockchain-Based Framework for Data Sharing With Fine-Grained Access Control in Decentralized Storage Systems , 2018, IEEE Access.

[28]  Radu State,et al.  Blockchain-Based, Decentralized Access Control for IPFS , 2018, 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[29]  Ingmar Baumgart,et al.  S/Kademlia: A practicable approach towards secure key-based routing , 2007, 2007 International Conference on Parallel and Distributed Systems.

[30]  James S. Plank,et al.  A tutorial on Reed–Solomon coding for fault‐tolerance in RAID‐like systems , 1997, Softw. Pract. Exp..

[31]  Zibin Zheng,et al.  Exploiting Blockchain Data to Detect Smart Ponzi Schemes on Ethereum , 2019, IEEE Access.

[32]  M. Giesler,et al.  The Anthropology of File Sharing: Consuming Napster As a Gift , 2003 .

[33]  Zibin Zheng,et al.  A Detailed and Real-Time Performance Monitoring Framework for Blockchain Systems , 2017, 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP).

[34]  Xin Wang,et al.  Understanding I/O Performance of IPFS Storage: A Client's Perspective , 2019, 2019 IEEE/ACM 27th International Symposium on Quality of Service (IWQoS).

[35]  Siniša Husnjak,et al.  5G, Blockchain and IPFS: A General Survey with Possible Innovative Applications in Industry 4.0 , 2018 .

[36]  Rodney Van Meter,et al.  Network attached storage architecture , 2000, CACM.

[37]  Gang Bao,et al.  Performance of TCP/RLP protocol stack on correlated fading DS-CDMA wireless links , 2000, IEEE Trans. Veh. Technol..

[38]  Satoshi Nakamoto.  Bitcoin : A Peer-to-Peer Electronic Cash System , 2009 .

[39]  Paul Mackerras,et al.  The rsync algorithm , 1996 .

[40]  Zibin Zheng,et al.  Detecting Ponzi Schemes on Ethereum: Towards Healthier Blockchain Technology , 2018, WWW.

[41]  Khaled Salah,et al.  IPFS-Blockchain-Based Authenticity of Online Publications , 2018, ICBC.

[42]  Steven Swanson,et al.  Morpheus: Creating Application Objects Efficiently for Heterogeneous Computing , 2016, 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA).

[43]  Adrien Lebre,et al.  An object store for Fog infrastructures based on IPFS and a Scale-Out NAS , 2017 .

[44]  Shawn Wilkinson.  MetaDisk A Blockchain-Based Decentralized File Storage Application , 2014 .

[45]  Hubert Ritzdorf,et al.  On the Security and Performance of Proof of Work Blockchains , 2016, IACR Cryptol. ePrint Arch..

[46]  Daniel Davis Wood,et al.  ETHEREUM: A SECURE DECENTRALISED GENERALISED TRANSACTION LEDGER , 2014 .

[47]  Fabio Antonelli,et al.  IoT data privacy via blockchains and IPFS , 2017, IOT.

[48]  Jehoshua Bruck,et al.  Zigzag Codes: MDS Array Codes With Optimal Rebuilding , 2011, IEEE Transactions on Information Theory.

[49]  Helger Lipmaa,et al.  Prover-Efficient Commit-and-Prove Zero-Knowledge SNARKs , 2016, AFRICACRYPT.

[50]  Pramod Viswanath,et al.  Deanonymization in the Bitcoin P2P Network , 2017, NIPS.

[51]  Guido Bertoni,et al.  Keccak , 2013, EUROCRYPT.

[52]  Qiaobing Xie,et al.  Stream control transmission protocol (SCTP): a reference guide , 2001 .

[53]  Yasuo Okabe,et al.  An Anonymous Distributed Electronic Voting System Using Zerocoin , 2016, 2021 International Conference on Information Networking (ICOIN).

[54]  Kim-Kwang Raymond Choo,et al.  BlockIPFS - Blockchain-Enabled Interplanetary File System for Forensic and Trusted Data Traceability , 2019, 2019 IEEE International Conference on Blockchain (Blockchain).

[55]  Nadeem Javaid,et al.  A Secure Data Sharing Platform Using Blockchain and Interplanetary File System , 2019, Sustainability.

[56]  John Cater,et al.  The evolution of round zero-net-mass-flux jets , 2002, Journal of Fluid Mechanics.

[57]  A. Broder.  Some applications of Rabin’s fingerprinting method , 1993 .