Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
NUcache: An Efficient Multicore Cache Organization Based on Next-Use Distance

R. Manikantan, Kaushik Rajan, and R. Govindarajan

Abstract

The effectiveness of the last-level shared cache is crucial to the performance of a multi-core system. In this paper, we observe and make use of the DelinquentPC—Next-Use characteristic to improve shared cache performance. We propose a new PC-centric cache organization, NUcache, for the shared last level cache of multi-cores. NUcache logically partitions the associative ways of a cache set into MainWays and DeliWays. While all lines have access to the MainWays, only lines brought in by a subset of delinquent PCs, selected by a PC selection mechanism, are allowed to enter the DeliWays. The PC selection mechanism is an intelligent cost-benefit analysis based algorithm that utilizes Next-Use information to select the set of PCs that can maximize the hits experienced in DeliWays. Performance evaluation reveals that NUcache improves the performance over a baseline design by 9.6%, 30% and 33% respectively for dual, quad and eight core workloads comprised of SPEC benchmarks. We also show that NUcache is more effective than other well-known cachepartitioning algorithms.

Details

Publication typeInproceedings
Published inProceedings of the International Conference on High Performance Computer Architecture (HPCA), 2011
PublisherIEEE
> Publications > NUcache: An Efficient Multicore Cache Organization Based on Next-Use Distance