Efficient Transaction Processing for Hyrise in Mixed Workload Environments

Hyrise is an in-memory storage engine designed for mixed enterprise workloads that originally started as a research prototype for hybrid table layouts and basic transaction processing capabilities. This paper presents our incremental improvements and learnings to better support transactional consistency in mixed workloads.

[1]  Martin Grund,et al.  Vertical Bit-Packing: Optimizing Operations on Bit-Packed Vectors Leveraging SIMD Instructions , 2014, DASFAA Workshops.

[2]  Michael Stonebraker,et al.  C-Store: A Column-oriented DBMS , 2005, VLDB.

[3]  Michael Stonebraker,et al.  H-store: a high-performance, distributed main memory transaction processing system , 2008, Proc. VLDB Endow..

[4]  Sam Lightstone,et al.  DB2 with BLU Acceleration: So Much More than Just a Column Store , 2013, Proc. VLDB Endow..

[5]  Alfons Kemper,et al.  HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots , 2011, 2011 IEEE 27th International Conference on Data Engineering.

[6]  Alexander Zeier,et al.  HYRISE - A Main Memory Hybrid Storage Engine , 2010, Proc. VLDB Endow..

[7]  Hamid Pirahesh,et al.  ARIES: a transaction recovery method supporting fine-granularity locking and partial rollbacks using write-ahead logging , 1998 .

[8]  Ippokratis Pandis,et al.  Aether: A Scalable Approach to Logging , 2010, Proc. VLDB Endow..

[9]  Martin Grund,et al.  TAMEX: a Task-Based Query Execution Framework for Mixed Enterprise Workloads on In-Memory Databases , 2013, GI-Jahrestagung.

[10]  Joos-Hendrik Böse,et al.  Efficient logging for enterprise workloads on column-oriented in-memory databases , 2012, CIKM '12.

[11]  Craig Freedman,et al.  Hekaton: SQL server's memory-optimized OLTP engine , 2013, SIGMOD '13.

[12]  Hasso Plattner,et al.  Fast Lookups for In-Memory Column Stores: Group-Key Indices, Lookup and Maintenance , 2012, ADMS@VLDB.

[13]  Michael Stonebraker,et al.  The VoltDB Main Memory DBMS , 2013, IEEE Data Eng. Bull..

[14]  Pradeep Dubey,et al.  Fast Updates on Read-Optimized Databases Using Multi-Core CPUs , 2011, Proc. VLDB Endow..

[15]  Wolfgang Lehner,et al.  Efficient transaction processing in SAP HANA database: the end of a column store myth , 2012, SIGMOD Conference.

[16]  Alfons Kemper,et al.  ScyPer: A Hybrid OLTP&OLAP Distributed Main Memory Database System for Scalable Real-Time Analytics , 2013, BTW.

[17]  Alfons Kemper,et al.  ScyPer: elastic OLAP throughput on transactional data , 2013, DanaC '13.

[18]  Martin Grund,et al.  Concurrent Execution of Mixed Enterprise Workloads on In-Memory Databases , 2014, DASFAA.

[19]  Eddie Kohler,et al.  Speedy transactions in multicore in-memory databases , 2013, SOSP.

[20]  Viktor Leis,et al.  The adaptive radix tree: ARTful indexing for main-memory databases , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[21]  Per-Åke Larson,et al.  SQL server column store indexes , 2011, SIGMOD '11.

[22]  Hasso Plattner,et al.  A common database approach for OLTP and OLAP using an in-memory column database , 2009, SIGMOD Conference.

[23]  Michael Stonebraker,et al.  SciDB DBMS Research at M.I.T , 2013, IEEE Data Eng. Bull..

[24]  Martin Grund,et al.  Dynamic Query Prioritization for In-Memory Databases , 2013, IMDM@VLDB.

[25]  Donald Kossmann,et al.  Comprehensive and Interactive Temporal Query Processing with SAP HANA , 2013, Proc. VLDB Endow..

[26]  Alfons Kemper,et al.  Executing Long-Running Transactions in Synchronization-Free Main Memory Database Systems , 2013, CIDR.

[27]  Ippokratis Pandis,et al.  A data-oriented transaction execution engine and supporting tools , 2011, SIGMOD '11.

[28]  Jignesh M. Patel,et al.  High-Performance Concurrency Control Mechanisms for Main-Memory Databases , 2011, Proc. VLDB Endow..

[29]  Ippokratis Pandis,et al.  Data-oriented transaction execution , 2010, Proc. VLDB Endow..

[30]  Alexander Zeier,et al.  SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units , 2009, Proc. VLDB Endow..

[31]  Hasso Plattner,et al.  Physical Column Organization in In-Memory Column Stores , 2013, DASFAA.