In this demo, we present PostCENN, an enhanced PostgreSQL database system with an end-to-end integration of machine learning (ML) models for cardinality estimation. In general, cardinality estimation is a topic with a long history in the database community. While traditional models like histograms are extensively used, recent works mainly focus on developing new approaches using ML models. However, traditional as well as ML models have their own advantages and disadvantages. With PostCENN, we aim to combine both to maximize their potentials for cardinality estimation by introducing ML models as a novel means to increase the accuracy of the cardinality estimation for certain parts of the database schema. To achieve this, we integrate ML models as first class citizen in PostgreSQL with a well-defined end-to-end life cycle. This life cycle consists of creating ML models for different sub-parts of the database schema, triggering the training, using ML models within the query optimizer in a transparent way, and deleting ML models. PVLDB Reference Format: Lucas Woltmann, Dominik Olwig, Claudio Hartmann, Dirk Habich, and Wolfgang Lehner. PostCENN : PostgreSQL with Machine Learning Models for Cardinality Estimation. PVLDB, 14(12): 2715 2718, 2021. doi:10.14778/3476311.3476327
[1]
Calisto Zuzarte,et al.
Cardinality estimation using neural networks
,
2015,
CASCON.
[2]
Andreas Kipf,et al.
Estimating Cardinalities with Deep Sketches
,
2019,
SIGMOD Conference.
[3]
Viktor Leis,et al.
How Good Are Query Optimizers, Really?
,
2015,
Proc. VLDB Endow..
[4]
Wolfgang Lehner,et al.
Aggregate-based Training Phase for ML-based Cardinality Estimation
,
2021,
BTW.
[5]
Dan Suciu,et al.
Pessimistic Cardinality Estimation: Tighter Upper Bounds for Intermediate Join Cardinalities
,
2019,
SIGMOD Conference.
[6]
Wolfgang Lehner,et al.
Best of both worlds: combining traditional and machine learning models for cardinality estimation
,
2020,
aiDM@SIGMOD.
[7]
Wolfgang Lehner,et al.
Cardinality estimation with local deep learning models
,
2019,
aiDM@SIGMOD.
[8]
Magdalena Balazinska,et al.
An Empirical Analysis of Deep Learning for Cardinality Estimation
,
2019,
ArXiv.