HetStore: A Platform for IO Workload Assignment in a Heterogeneous Storage Environment

The problem of providing optimal assignment for backend storage is a central problem in the design of cloud systems. It has taken a further central role as a result of growing heterogeneity from emerging Software Defined Storage systems. In this paper, we propose a solution to optimal IO Workload assignment using statistical modelling to estimate measures of performance such as Throughput, IOPS, et al. The proposed system uses support vector regression to estimate the performance of individual IO Workloads on each available SDS system for optimal assignment. As a proof of concept, we demonstrate our solution in a heterogeneous environment comprising of HDFS, GlusterFS, and Ceph. We first show the accuracy of estimation of throughput and IOPS with values of coefficient of determination over 0.65 in all cases. We further show the analysis of using this regression model to classify workloads to respective SDS backend that will maximize throughput.