A Comparison Method of Massive Power Consumption Information Collection Test Data Based on Improved Merkle Tree

It is necessary to conduct comparison test of massive electricity data on the unified interface platform for ensuring that the power consumption information collection system can provide data for kinds of business systems stably and accurately. In this paper, a method of data comparison for mass data of power energy data acquire system based on improved Merkle Tree is proposed to solve the problem that the traditional one to one comparison method cannot adapt to massive data test. Merkle Tree is improved by forming all the subtrees into complete binary tree. Based on the improved algorithm mentioned above, the improved Merkle Tree is constructed for the source data from power consumption information collection system and the publish data from unified interface platform. Through the comparison of Merkle Root and its sub nodes, a fast consistency check is achieved, and the optimal data blocking strategy and multithreading optimization method are put forward. This method greatly improves the efficiency of the unified interface platform for the consistency of mass data.