RSPLab: RDF Stream Processing Benchmarking Made Easy

In Stream Reasoning (SR), empirical research on RDF Stream Processing (RSP) is attracting a growing attention. The SR community proposed methodologies and benchmarks to investigate the RSP solution space and improve existing approaches. In this paper, we present RSPLab, an infrastructure that reduces the effort required to design and execute reproducible experiments as well as share their results. RSPLab integrates two existing RSP benchmarks (LSBench and CityBench) and two RSP engines (C-SPARQL engine and CQELS). It provides a programmatic environment to: deploy in the cloud RDF Streams and RSP engines, interact with them using TripleWave and RSP Services, and continuously monitor their performances and collect statistics. RSPLab is released as open-source under an Apache 2.0 license.

[1]  Emanuele Della Valle,et al.  A Restful Interface for RDF Stream Processors , 2013, SEMWEB.

[2]  Carl Boettiger,et al.  An introduction to Docker for reproducible research , 2014, OPSR.

[3]  Óscar Corcho,et al.  RSP-QL Semantics: A Unifying Query Model to Explain Heterogeneity of RDF Stream Processing Systems , 2014, Int. J. Semantic Web Inf. Syst..

[4]  Óscar Corcho,et al.  On Correctness in RDF Stream Processor Benchmarking , 2013, International Semantic Web Conference.

[5]  Stefan Schlobach,et al.  LOD Lab: Experiments at LOD Scale , 2015, International Semantic Web Conference.

[6]  Carlo Curino,et al.  OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases , 2013, Proc. VLDB Endow..

[7]  Karl Aberer,et al.  TripleWave: Spreading RDF Streams on the Web , 2016, SEMWEB.

[8]  Feng Gao,et al.  CityBench: A Configurable Benchmark to Evaluate RSP Engines Using Smart City Datasets , 2015, SEMWEB.

[9]  Thomas Eiter,et al.  Linked Stream Data Processing Engines: Facts and Figures , 2012, SEMWEB.

[10]  Olivier Curé,et al.  On Measuring Performances of C-SPARQL and CQELS , 2016, SR+SWIT@ISWC.

[11]  Danh Le Phuoc,et al.  A Native and Adaptive Approach for Unified Processing of Linked Streams and Linked Data , 2011, SEMWEB.

[12]  A Min Tjoa,et al.  YABench: A Comprehensive Framework for RDF Stream Processor Correctness and Performance Assessment , 2016, ICWE.

[13]  Emanuele Della Valle,et al.  Heaven: A Framework for Systematic Comparative Research Approach for RSP Engines , 2016, ESWC.

[14]  Daniele Braga,et al.  C-SPARQL: a Continuous Query Language for RDF Data Streams , 2010, Int. J. Semantic Comput..

[15]  Sebastian Michel,et al.  SRbench--a benchmark for soundtrack recommendation systems , 2013, CIKM.

[16]  Jacopo Urbani,et al.  Seven Commandments for Benchmarking Semantic Flow Processing Systems , 2013, ESWC.