论文信息 - The Distributed Storage System Based on MPP for Mass Data

The Distributed Storage System Based on MPP for Mass Data

The traditional database technology can't meet the rapidly growing information and the demands of extreme scalability, high availability and reliability for the mass data. In this paper, we have designed a distributed storage system based MPP(massively parallel processing) architecture on RDBMS to solve these problems. First, we present the main framework and the function architecture of the design. Then we do some experiments and performance tests. At last, we conclude that with the good scalability and massively parallel processing advantage, the system can solve the mass data storage problem. The idea of distributed storage system based MPP architecture in relational databases speeds up reading and writing, improving the shortcomings of traditional database.

Jun Yang | E Haihong | Jing Han | Cunchen Li

[1] Chih-Wei Huang,et al. Distributed Computing Platform for Solving Massive Computing and Data Problems in Bioinformatics , 2006 .

[2] Jingren Zhou,et al. SCOPE: easy and efficient parallel processing of massive data sets , 2008, Proc. VLDB Endow..

[3] Danyang Cao,et al. Design and implementation for SQL parser based on ANTLR , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[4] Du Nan. Research of parallel technology in massive commerce data management system , 2009 .

[5] Moe Key,et al. Big Data Analysis—Competition and Symbiosis of RDBMS and MapReduce , 2012 .

[6] Shan Wang,et al. Big Data Analysis—Competition and Symbiosis of RDBMS and MapReduce: Big Data Analysis—Competition and Symbiosis of RDBMS and MapReduce , 2012 .

[7] T. Yorozu,et al. Electron Spectroscopy Studies on Magneto-Optical Media and Plastic Substrate Interface , 1987, IEEE Translation Journal on Magnetics in Japan.