Structural Engineering Cloud Platform (SECP) is a resource sharing platform oriented to structural engineering domain, and the share of structural engineering experimental data is one of its main functions. In SECP, there are two kinds of experimental data, which are Experimental Description Data (EDD) and Experimental Result Data (ERD). The model of EDD was built based on OWL ontology for shielding the heterogeneity of experimental data from different experimental sites. With the increasing of data scale, the query of EDD has been a bottleneck of the whole management system in SECP. Based on MapReduce, this paper designed and implemented a EDD query system (EDDQS). EDDQS supports query based on SPARQL and there are four core modules named Data Splitter, Query Generator, Job Generator as well as Job Executor. Furthermore, the algorithm of job generation from SPARQL query and job execution algorithms are presented. Finally, the results of our experiments reveal that our MapReduce based query system can handle large amount of EDD efficiently.
[1]
Jane Hunter,et al.
A scale-out RDF molecule store for distributed processing of biomedical data
,
2008,
WWW 2008.
[2]
Bhavani M. Thuraisingham,et al.
Storage and Retrieval of Large RDF Graph Using Hadoop and MapReduce
,
2009,
CloudCom.
[3]
Peter Mika,et al.
Web Semantics in the Clouds
,
2008,
IEEE Intelligent Systems.
[4]
Francesco Piazza,et al.
Signing individual fragments of an RDF graph
,
2005,
WWW '05.
[5]
Eyal Oren,et al.
MaRVIN: A platform for large-scale analysis of Semantic Web data
,
2009
.
[6]
Yimin Wang,et al.
A decentralized infrastructure for query answering over distributed ontologies
,
2007,
SAC '07.
[7]
Sanjay Ghemawat,et al.
MapReduce: Simplified Data Processing on Large Clusters
,
2004,
OSDI.