UncoRq: Unconstrained Snoop Request Delivery in Embedded-Ring Multiprocessors

Snoopy cache coherence can be implemented in any physical network topology by embedding a logical unidirectional ring in the network. Control messages are forwarded using the ring, while other messages can use any path. While the resulting coherence protocols are inexpensive to implement, they enable many ways of overlapping multiple transactions that access the same line—making it hard to reason about correctness. Moreover, snoop requests are required to traverse the ring, therefore lengthening coherence transaction latencies.

In this paper, we address these problems and make two main contributions. First, we introduce the Ordering invariant, which ensures the correct serialization of colliding transactions in embedded-ring protocols. Second, based on this invariant, we remove the requirement that snoop requests traverse the ring. Instead, they are delivered using any network path, as long as snoop responses—which are typically off the critical path—use the logical ring. This approach substantially reduces coherence transaction latency. We call the resulting protocol Uncorq.

We show that, on a 64-node Chip Multiprocessor (CMP), Uncorq improves the performance, on average, by 23% for SPLASH-2 applications and by 10% for commercial applications. With an additional simple prefetching optimization, the performance improvement

is, on average, 26% for SPLASH-2 applications and 18% for commercial applications.

strauss-Uncorq.pdf
PDF file

In  MICRO-40 (International Symposium on Microarchitecture)

Publisher  IEEE
© 2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. http://www.ieee.org/

Details

TypeProceedings
> Publications > UncoRq: Unconstrained Snoop Request Delivery in Embedded-Ring Multiprocessors