In Search of the Ideal Storage Configuration for Docker Containers

Containers are a widely successful technology today popularized by Docker. Containers improve system utilization by increasing workload density. Docker containers enable seamless deployment of workloads across development, test, and production environments. Docker's unique approach to data management, which involves frequent snapshot creation and removal, presents a new set of exciting challenges for storage systems. At the same time, storage management for Docker containers has remained largely unexplored with a dizzying array of solution choices and configuration options. In this paper we unravel the multi-faceted nature of Docker storage and demonstrate its impact on system and workload performance. As we uncover new properties of the popular Docker storage drivers, this is a sobering reminder that widespread use of new technologies can often precede their careful evaluation.

[1]  Michael A. Bender,et al.  BetrFS: Write-Optimization in a Kernel File System , 2015, ACM Trans. Storage.

[2]  Vasily Tarasov,et al.  A Fast and Slippery Slope for File Systems , 2015, ACM SIGOPS Oper. Syst. Rev..

[3]  Eric A. Brewer,et al.  Borg, Omega, and Kubernetes , 2016, ACM Queue.

[4]  Mark Lamourine Storage Options for Software Containers , 2015, login Usenix Mag..

[5]  Lisa Gerhardt,et al.  Shifter: Containers for HPC , 2017 .

[6]  Raju Rangaswami,et al.  Non-blocking Writes to Files , 2015, FAST.

[7]  P. Menage Adding Generic Process Containers to the Linux Kernel , 2010 .

[8]  Lucas Chaufournier,et al.  Containers and Virtual Machines at Scale: A Comparative Study , 2016, Middleware.

[9]  OHAD RODEH,et al.  B-trees, shadowing, and clones , 2008, TOS.

[10]  Eric W. Biederman,et al.  Multiple Instances of the Global Linux Namespaces , 2010 .

[11]  Andrea C. Arpaci-Dusseau,et al.  Slacker: Fast Distribution with Lazy Docker Containers , 2016, FAST.

[12]  Michael A. Bender,et al.  BetrFS: A Right-Optimized Write-Optimized File System , 2015, FAST.

[13]  Richard P. Spillane,et al.  Exo-clones: Better Container Runtime Image Management across the Clouds , 2016, HotStorage.

[14]  Tridib Mukherjee,et al.  SCoPe: A Decision System for Large Scale Container Provisioning Management , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[15]  Song Jiang,et al.  TotalCOW: Unleash the Power of Copy-On-Write for Thin-provisioned Containers , 2015, APSys.

[16]  Josef Bacik,et al.  BTRFS: The Linux B-Tree Filesystem , 2013, TOS.

[17]  Erez Zadok,et al.  Filebench: A Flexible Framework for File System Benchmarking , 2016, login Usenix Mag..

[18]  Tridib Mukherjee,et al.  CoMICon: A Co-Operative Management System for Docker Container Images , 2017, 2017 IEEE International Conference on Cloud Engineering (IC2E).