Towards a framework for orchestrated distributed database evaluation in the cloud

The selection and operation of a distributed database management system (DDBMS) in the cloud is a challenging task as supportive evaluation frameworks miss orchestrated evaluation scenarios, hindering comparable and reproducible evaluations for heterogeneous cloud resources. We propose a novel evaluation approach that supports orchestrated evaluation scenarios for scalability, elasticity and availability by exploiting cloud resources. We highlight the challenges in evaluating DDBMSs in the cloud and introduce a cloud-centric framework for orchestrated DDBMS evaluation, enabling reproducible evaluations and significant rating indices.

[1]  Carlo Curino,et al.  OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases , 2013, Proc. VLDB Endow..

[2]  Yves Le Traon,et al.  Under Pressure Benchmark for DDBMS Availability , 2013, J. Inf. Data Manag..

[3]  Jörn Kuhlenkamp,et al.  Benchmarking Scalability and Elasticity of Distributed Database Systems , 2014, Proc. VLDB Endow..

[4]  Alan Fekete,et al.  YCSB+T: Benchmarking web-scale transactional databases , 2014, 2014 IEEE 30th International Conference on Data Engineering Workshops.

[5]  Shahram Ghandeharizadeh,et al.  BG: A Benchmark to Evaluate Interactive Social Networking Actions , 2013, CIDR.

[6]  Christopher B. Hauser,et al.  Cloud Orchestration Features: Are Tools Fit for Purpose? , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[7]  Timothy G. Armstrong,et al.  LinkBench: a database benchmark based on the Facebook social graph , 2013, SIGMOD '13.

[8]  Sherif Sakr,et al.  Towards an Extensible Middleware for Database Benchmarking , 2014, TPCTC.

[9]  Lin Xiao,et al.  YCSB++: benchmarking and performance debugging advanced features in scalable table stores , 2011, SoCC.

[10]  Jörg Domaschka,et al.  Is Distributed Database Evaluation Cloud-Ready? , 2017, ADBIS.

[11]  Adam Silberstein,et al.  Benchmarking cloud serving systems with YCSB , 2010, SoCC '10.

[12]  Jörg Domaschka,et al.  Is elasticity of scalable databases a Myth? , 2016, 2016 IEEE International Conference on Big Data (Big Data).