Cache Coherency · All levels

Staff-Level Design Reviews: Step-by-Step Walkthrough

Step-by-Step Walkthrough for Staff-Level Design Reviews.

Step-by-step walkthrough

Step-by-Step Walkthrough for Staff-Level Design Reviews explains how to reason from coherency invariant to measurable engineering decision.

  1. Define invariant and observable symptom.

  2. Annotate request/snoop/data ownership timeline.

  3. Map evidence to candidate mechanisms.

  4. Validate chosen fix and guard against regressions.

Reference flow

diagram
COHERENCY DECISION FLOW — Staff-Level Design Reviews

request intent (read/shared/unique/writeback/evict)
      |
      v
ownership check + sharer metadata evaluation
      |
      v
snoop / directory action + ordering gate
      |
      v
data source selection (owner forward vs memory)
      |
      v
state transition + acknowledgment closure
      |
      v
metric validation + regression guardrails

Cache coherency deep dive

Cache coherence is a correctness contract across caches, interconnect, and software ordering.

Concept diagram

diagram
requester -> coherence fabric -> owner or memory -> state update

Metric graph

diagram
traffic mix across request, snoop, response, data

Metrics and artifacts to collect

  • coherence latency

  • invalidation rate

  • retry rate

  • stale-read incidents

Mini case study

Anchor debug to first stale read and the exact line state transition.

Debug branches

  • Track ownership

  • Track ordering

  • Track evidence

Senior review question

Ask: what is the first line state transition that deviates, and which ordering rule does it break?

Key takeaways

  • Tie every coherency claim to one cache line, one transaction identity, and one measurable counter.

  • Keep proof artifacts from simulation and silicon replay aligned by address, state, and ordering event.

Common pitfalls

  • Chasing bandwidth regressions without checking false sharing and line bouncing first.

  • Assuming coherence correctness implies memory consistency correctness.

  • Declaring closure without litmus, stress, and post-silicon replay evidence.