GARNET: A detailed on-chip network model inside a full-system simulator

Abstract

Until very recently, microprocessor designs were computation-centric. On-chip communication was frequently ignored. This was because of fast, single-cycle on-chip communication. The interconnect power was also insignificant compared to the transistor power. With uniprocessor designs providing diminishing returns and the advent of chip multiprocessors (CMPs) in mainstream systems, the on-chip network that connects different processing cores has become a critical part of the design. Transistor miniaturization has led to high global wire delay, and interconnect power comparable to transistor power. CMP design proposals can no longer ignore the interaction between the memory hierarchy and the interconnection network that connects various elements. This necessitates a detailed and accurate interconnection network model within a full-system evaluation framework. Ignoring the interconnect details might lead to inaccurate results when simulating a CMP architecture. It also becomes important to analyze the impact of interconnection network optimization techniques on full system behavior. In this light, we developed a detailed cycle-accurate interconnection network model (GARNET), inside the GEMS full-system simulation framework. GARNET models a classic five-stage pipelined router with virtual channel (VC) flow control. Microarchitectural details, such as flit-level input buffers, routing logic, allocators and the crossbar switch, are modeled. GARNET, along with GEMS, provides a detailed and accurate memory system timing model. To demonstrate the importance and potential impact of GARNET, we evaluate a shared and private L2 CMP with a realistic state-of-the-art interconnection network against the original GEMS simple network. The objective of the evaluation was to figure out which configuration is better for a particular workload. We show that not modeling the interconnect in detail might lead to an incorrect outcome. We also evaluate Express Virtual Channels (EVCs), an on-chip network flow control proposal, in a full-system fashion. We show that in improving on-chip network latency-throughput, EVCs do lead to better overall system runtime, however, the impact varies widely across applications.

BlackOut: Enabling fine-grained power gating of buffers in Network-on-Chip routers

“…Moreover (1) captures the number of VCs usable in OP j for VNET i at time t, which are the VC buffers in idle or used channels that can be allocated in NAVCA mode. The policy developed has two stages.…”

Clustered Networks-on-Chip: Simulation and Performance Evaluation

“…They focus on simulating the NoC interconnect behavior, producing results about evaluating throughput and latency of the interconnect. Agarwal et al implemented GARNET as a full-system NoC simulator, which enables the evaluation of components, like caches and memory controller, along with NoC topology, router microarchitecture, and routing algorithms [6].…”

A Dual-Consistency Cache Coherence Protocol

“…The interconnection network has been modeled with GARNET [27]. We have modified GEMS in order to model SPEL in detail accounting for the cost of the new inserted instructions.…”