Generating polystore ingestion plans — A demonstration with the AWESOME system

AWESOME is a polystore system that enables a data analyst to create a data ingestion script that specifies how it should collect, organize, run a data-derivation pipeline and reports results of the analysis. The collected data can be stored in different component stores under AWESOME for subsequent secondary analysis. This paper demonstrates the process by which AWESOME analyzes the script to construct an efficient ingestion plan, an executable database-centric dataflow specification which populates the raw and all derived data into the polystore. The demonstration will show how changing the script will alter the ingestion plan using a combination of rules and ingestion cost estimation.