A survey of blockchain consensus algorithms performance evaluation criteria

Abstract How to reach an agreement in a blockchain network is a complex and important task that is defined as a consensus problem and has wide applications in reality including distributed computing, load balancing, and transaction validation in blockchains. Over recent years, many studies have been done to cope with this problem. In this paper, a comparative and analytical review on the state-of-the-art blockchain consensus algorithms is presented to enlighten the strengths and constraints of each algorithm. Based on their inherent specifications, each algorithm has a different domain of applicability that yields to propose several performance criteria for the evaluation of these algorithms. To overview and provide a basis of comparison for further work in the field, a set of incommensurable and conflicting performance evaluation criteria is identified and weighted by the pairwise comparison method. These criteria are classified into four categories including algorithms’ throughput, the profitability of mining, degree of decentralization and consensus algorithms vulnerabilities and security issues. Based on the proposed framework, the pros and cons of consensus algorithms are systematically analyzed and compared in order to provide a deep understanding of the existing research challenges and clarify the future study directions.

[1]  Zhengxin Chen,et al.  Introduction to Data Mining Techniques via Multiple Criteria Optimization Approaches and Applications , 2007 .

[2]  Erik Poll,et al.  Assessing interoperability solutions for distributed ledgers , 2019, Pervasive Mob. Comput..

[3]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[4]  John R. Douceur,et al.  The Sybil Attack , 2002, IPTPS.

[5]  Tomi Dahlberg,et al.  Digital Supply Chain Transformation toward Blockchain Integration , 2017, HICSS.

[6]  Zibin Zheng,et al.  An Overview of Blockchain Technology: Architecture, Consensus, and Future Trends , 2017, 2017 IEEE International Congress on Big Data (BigData Congress).

[7]  I. A. Ivanova,et al.  Implementation of directed acyclic graph in blockchain network to improve security and speed of transactions , 2018 .

[8]  Myung-Sup Kim,et al.  A survey on blockchain cybersecurity vulnerabilities and possible countermeasures , 2019, Int. J. Netw. Manag..

[9]  Somdip Dey,et al.  Securing Majority-Attack in Blockchain Using Machine Learning and Algorithmic Game Theory: A Proof of Work , 2018, 2018 10th Computer Science and Electronic Engineering (CEEC).

[10]  George Danezis,et al.  The Road to Scalable Blockchain Designs , 2017, Login: The Usenix Magazine.

[11]  Sherali Zeadally,et al.  A survey on privacy protection in blockchain system , 2019, J. Netw. Comput. Appl..

[12]  Miguel Oom Temudo de Castro,et al.  Practical Byzantine fault tolerance , 1999, OSDI '99.

[13]  John K. Ousterhout,et al.  In Search of an Understandable Consensus Algorithm , 2014, USENIX ATC.

[14]  Jung Yeon Hwang,et al.  Efficient Privacy-Preserving Machine Learning for Blockchain Network , 2019, IEEE Access.

[15]  Khaled Salah,et al.  Blockchain for explainable and trustworthy artificial intelligence , 2019, WIREs Data Mining Knowl. Discov..

[16]  Yuemin Ding,et al.  Blockchain-based decentralized and secure keyless signature scheme for smart grid , 2019, Energy.

[17]  John D. Garofalakis,et al.  NCDawareRank: a novel ranking method that exploits the decomposable structure of the web , 2013, WSDM.

[18]  Mohamed Amine Ferrag,et al.  Blockchain Technologies for the Internet of Things: Research Issues and Challenges , 2018, IEEE Internet of Things Journal.

[19]  George Danezis,et al.  SoK: Consensus in the Age of Blockchains , 2017, AFT.

[20]  Dragan Pamucar,et al.  A New Model for Determining Weight Coefficients of Criteria in MCDM Models: Full Consistency Method (FUCOM) , 2018, Symmetry.

[21]  Nir Kshetri,et al.  1 Blockchain's roles in meeting key supply chain management objectives , 2018, Int. J. Inf. Manag..

[22]  Changyong Liang,et al.  Visualizing the knowledge structure and evolution of big data research in healthcare informatics , 2017, Int. J. Medical Informatics.

[23]  Silvio Micali,et al.  Algorand: Scaling Byzantine Agreements for Cryptocurrencies , 2017, IACR Cryptol. ePrint Arch..

[24]  Emin Gün Sirer,et al.  Majority is not enough , 2013, Financial Cryptography.

[25]  Mauro Conti,et al.  A Survey on Security and Privacy Issues of Bitcoin , 2017, IEEE Communications Surveys & Tutorials.

[26]  Michael Burrows,et al.  The Chubby Lock Service for Loosely-Coupled Distributed Systems , 2006, OSDI.

[27]  Iddo Bentov,et al.  Proof of Activity: Extending Bitcoin's Proof of Work via Proof of Stake [Extended Abstract]y , 2014, PERV.

[28]  Jules Pagna Disso,et al.  An Analysis into the Scalability of Bitcoin and Ethereum , 2018, Advances in Intelligent Systems and Computing.

[29]  Ivana Podnar Žarko,et al.  Distributed Ledger Technology: Blockchain Compared to Directed Acyclic Graph , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[30]  C. Mora,et al.  Bitcoin emissions alone could push global warming above 2°C , 2018, Nature Climate Change.

[31]  Wei Jiang,et al.  Healthcare Data Gateways: Found Healthcare Intelligence on Blockchain with Novel Privacy Risk Control , 2016, Journal of Medical Systems.

[32]  Nadeem Javaid,et al.  Data Sharing System Integrating Access Control Mechanism using Blockchain-Based Smart Contracts for IoT Devices , 2020, Applied Sciences.

[33]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[34]  A.W.G. de Vries,et al.  Renewable Energy Will Not Solve Bitcoin’s Sustainability Problem , 2019, Joule.

[35]  Leslie Lamport,et al.  Reaching Agreement in the Presence of Faults , 1980, JACM.

[36]  Yue Wang,et al.  Evolutionary features of academic articles co-keyword network and keywords co-occurrence network: Based on two-mode affiliation network , 2016 .

[37]  Nancy A. Lynch,et al.  Impossibility of distributed consensus with one faulty process , 1985, JACM.

[38]  Sinan Küfeoğlu,et al.  Energy Consumption of Bitcoin Mining , 2019 .

[39]  Wei Ni,et al.  Blockchain's adoption in IoT: The challenges, and a way forward , 2019, J. Netw. Comput. Appl..

[40]  Kun Wang,et al.  Intelligent Resource Management in Blockchain-Based Cloud Datacenters , 2018, IEEE Cloud Computing.

[41]  Hector Marco-Gisbert,et al.  Assessing Blockchain Consensus and Security Mechanisms against the 51% Attack , 2019, Applied Sciences.

[42]  Alicja Winnicka,et al.  Idea of Using Blockchain Technique for Choosing the Best Configuration of Weights in Neural Networks , 2019, Algorithms.

[43]  Albert Y. Zomaya,et al.  Blockchain for smart communities: Applications, challenges and opportunities , 2019, J. Netw. Comput. Appl..

[44]  Xiaofeng Chen,et al.  Blockchain-based publicly verifiable data deletion scheme for cloud storage , 2018, J. Netw. Comput. Appl..

[45]  Dipankar Dasgupta,et al.  A survey of blockchain from security perspective , 2019, J. Bank. Financial Technol..

[46]  Fred B. Schneider,et al.  Implementing fault-tolerant services using the state machine approach: a tutorial , 1990, CSUR.

[47]  Jong-Hyouk Lee,et al.  Double-Spending With a Sybil Attack in the Bitcoin Decentralized Network , 2019, IEEE Transactions on Industrial Informatics.

[48]  Barbara Liskov,et al.  Viewstamped Replication: A New Primary Copy Method to Support Highly-Available Distributed Systems , 1999, PODC '88.

[49]  Syed Tahir Hussain Rizvi,et al.  Multi-Agent Cooperative Control Consensus: A Comparative Review , 2018 .

[50]  Pubudu N. Pathirana,et al.  Blockchain for Secure EHRs Sharing of Mobile Cloud Based E-Health Systems , 2019, IEEE Access.

[51]  Stuart Haber,et al.  How to Time-Stamp a Digital Document , 1990, CRYPTO.

[52]  Sherali Zeadally,et al.  Privacy aware IOTA ledger: Decentralized mixing and unlinkable IOTA transactions , 2019, Comput. Networks.

[53]  Purnima Khurana,et al.  Study and Comparative Analysis of Different Hash Algorithm , 2014 .

[54]  Yong Shi,et al.  Public blockchain evaluation using entropy and TOPSIS , 2019, Expert Syst. Appl..

[55]  Primavera De Filippi,et al.  The Invisible Politics of Bitcoin: Governance Crisis of a Decentralized Infrastructure , 2016 .

[56]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[57]  Arshdeep Bahga,et al.  Blockchain Platform for Industrial Internet of Things , 2016 .

[58]  Luca Schenato,et al.  A distributed consensus protocol for clock synchronization in wireless sensor network , 2007, 2007 46th IEEE Conference on Decision and Control.

[59]  Yury Yanovich,et al.  Converging blockchain and next-generation artificial intelligence technologies to decentralize and accelerate biomedical research and healthcare , 2015, Oncotarget.

[60]  Jing Li,et al.  Cryptographic primitives in blockchains , 2019, J. Netw. Comput. Appl..

[61]  J'erome Lacan,et al.  BlockHouse: Blockchain-Based Distributed Storehouse System , 2019, 2019 9th Latin-American Symposium on Dependable Computing (LADC).

[62]  Fran Casino,et al.  A systematic literature review of blockchain-based applications: Current status, classification and open issues , 2019, Telematics Informatics.

[63]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[64]  My T. Thai,et al.  AI and Blockchain: A Disruptive Integration , 2018, Computer.

[65]  Warren He,et al.  Proof of Luck: an Efficient Blockchain Consensus Protocol , 2016, SysTEX@Middleware.

[66]  Gautam Srivastava,et al.  A Decentralized Privacy-Preserving Healthcare Blockchain for IoT , 2019, Sensors.

[67]  Tao Wang.  A Unified Analytical Framework for Trustable Machine Learning and Automation Running with Blockchain , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[68]  A.W.G. de Vries.  Bitcoin's Growing Energy Problem , 2018 .

[69]  G. O. Odu,et al.  Weighting methods for multi-criteria decision making technique , 2019, Journal of Applied Sciences and Environmental Management.

[70]  Jinqing Peng,et al.  Energy consumption of cryptocurrency mining: A study of electricity consumption in mining cryptocurrencies , 2019, Energy.

[71]  M. Sethumadhavan,et al.  Survey of consensus protocols on blockchain applications , 2017, 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS).

[72]  Xiaodong Lin,et al.  Efficient and Privacy-Preserving Carpooling Using Blockchain-Assisted Vehicular Fog Computing , 2019, IEEE Internet of Things Journal.

[73]  Jong Hyuk Park,et al.  BlockSecIoTNet: Blockchain-based decentralized security architecture for IoT network , 2019, J. Netw. Comput. Appl..

[74]  Vytautas Štuikys,et al.  Energy Consumption of Hash Functions , 2012 .

[75]  Rajkumar Buyya,et al.  FogBus: A Blockchain-based Lightweight Framework for Edge and Fog Computing , 2018, J. Syst. Softw..

[76]  Nancy A. Lynch,et al.  Consensus in the presence of partial synchrony , 1988, JACM.

[77]  Simon Holmbacka,et al.  Energy-efficient Execution of Cryptographic Hash Functions on big.LITTLE Architecture , 2018, 2018 13th International Symposium on Reconfigurable Communication-centric Systems-on-Chip (ReCoSoC).

[78]  Arun Rai,et al.  Explainable AI: from black box to glass box , 2019, Journal of the Academy of Marketing Science.

[79]  Roman Beck,et al.  Governance in the Blockchain Economy: A Framework and Research Agenda , 2018, J. Assoc. Inf. Syst..

[80]  Zhu Han,et al.  Cloud/Fog Computing Resource Management and Pricing for Blockchain Networks , 2017, IEEE Internet of Things Journal.

[81]  Amit P. Sheth,et al.  Changing Focus on Interoperability in Information Systems:From System, Syntax, Structure to Semantics , 1999 .

[82]  Mario Zagar,et al.  Comparative analysis of blockchain consensus algorithms , 2018, 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[83]  Joshua A. Kroll,et al.  The Economics of Bitcoin Mining, or Bitcoin in the Presence of Adversaries , 2013 .

[84]  Antonio Puliafito,et al.  Blockchain and IoT Integration: A Systematic Survey , 2018, Sensors.

[85]  M. Atzori.  Blockchain Technology and Decentralized Governance: Is the State Still Necessary? , 2017 .

[86]  Gulshan Kumar,et al.  Proof-of-Work Consensus Approach in Blockchain Technology for Cloud and Fog Computing Using Maximization-Factorization Statistics , 2019, IEEE Internet of Things Journal.

[87]  Khaled Salah,et al.  IoT security: Review, blockchain solutions, and open challenges , 2017, Future Gener. Comput. Syst..

[88]  Leslie Lamport,et al.  The Byzantine Generals Problem , 1982, TOPL.

[89]  Yong Shi,et al.  A class of classification and regression methods by multiobjective programming , 2009, Frontiers of Computer Science in China.

[90]  Monika Arora,et al.  An Approach to Secure Collaborative Recommender System Using Artificial Intelligence, Deep Learning, and Blockchain , 2019, Advances in Intelligent Systems and Computing.

[91]  Kyungbaek Kim,et al.  A Survey about Consensus Algorithms Used in Blockchain , 2018, J. Inf. Process. Syst..

[92]  Seyed Mojtaba Hosseini Bamakan,et al.  Opinion leader detection: A methodological review , 2019, Expert Syst. Appl..

[93]  Khaled Salah,et al.  Blockchain for AI: Review and Open Research Challenges , 2019, IEEE Access.

[94]  Hokey Min,et al.  Blockchain technology for enhancing supply chain resilience , 2019, Business Horizons.

[95]  Wassim Derguech,et al.  Building Internet of Things-Enabled Digital Twins and Intelligent Applications Using a Real-time Linked Dataspace , 2020, Real-time Linked Dataspaces.

[96]  Zhang Zhe,et al.  A review on consensus algorithm of blockchain , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[97]  Kim-Kwang Raymond Choo,et al.  Blockchain in healthcare applications: Research challenges and opportunities , 2019, J. Netw. Comput. Appl..

[98]  Stefan Dziembowski,et al.  Proofs of Space , 2015, CRYPTO.

[99]  T. Moore,et al.  Bitcoin: Economics, Technology, and Governance , 2014 .

[100]  Olivier Boireau,et al.  Securing the blockchain against hackers , 2018, Netw. Secur..

[101]  Shang Gao,et al.  Smart contract applications within blockchain technology: A systematic mapping study , 2018, Telematics Informatics.

[102]  Elaine Shi,et al.  On Scaling Decentralized Blockchains - (A Position Paper) , 2016, Financial Cryptography Workshops.

[103]  Ariel Gabizon,et al.  Cryptocurrencies Without Proof of Work , 2014, Financial Cryptography Workshops.

[104]  George Drosatos,et al.  Blockchain Applications in the Biomedical Domain: A Scoping Review , 2019, Computational and structural biotechnology journal.