Managing Shared L2 Caches on Multicore Systems in Software

Most of today’s multi-core processors feature shared L2 caches. A major problem faced by such architectures is cac he contention, where multiple cores compete for usage of the si ngle shared L2 cache. Uncontrolled sharing leads to scenarios wh ere one core evicts useful L2 cache content belonging to another core. To address this problem, we have implemented a softwar e mechanism in the operating system that allows for partitioning of the shared L2 cache by guiding the allocation of physical pages. This mechanism, which can also be applied to virtual machine monitors, provides isolation capabilities that lead to reduced contention. We show that this mechanism is effectiv e in reducing cache contention in multiprogrammed SPECcpu2000 and SPECjbb2000 workloads. Performance improvements of up to 17% were achieved without adversely affecting co-schedu led applications. In order to effectively size L2 cache partitions, a quantifiable metric is needed to properly predict performance as a functi on of L2 cache size. For page management, Miss Rate Curves (MRCs) have proven to be useful for this purpose. However, for L2 cac he sizing, we have found L2 MRCs to be inadequate and have found instruction retirement Stall Rate Curves (SRCs) to bemore effective, where the stalls are caused by memory latencies.