SPEC HPG benchmarks for high-performance systems

Müller, Matthias S.; Kalyanasundaram, Kumaran; Gaertner, Greg; Jones, Wesley B.; Eigenmann, Rudolf; Lieberman, Ron; Waveren, Matthijs van; Whitney, Brian

doi:10.1504/ijhpcn.2004.008345

Cited by 8 publications

(2 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Both uniform random traffic and traces from the SPECMPI benchmark suite [19] are used as input stimuli. On one hand, random traffic ensures uniform link utilization so that packet latency and fault impacts are not biased by traffic patterns imposed by a benchmark's characteristics.…”

Section: A Experimental Setupmentioning

confidence: 99%

Cardio: Adaptive CMPs for reliability through dynamic introspective operation

Pellegrini

Bertacco

2011

2011 IEEE International High Level Design Validation and Test Workshop

View full text Add to dashboard Cite

Abstract-Current technology scaling enables the integration of tens of processing elements into a single chip, and future technology nodes will soon allow the integration of hundreds of cores per device. While very powerful, many experts agree that these systems will be prone to a significant number of permanent and transient faults during their lifetime. If not properly handled, effects of runtime failures can be dramatic.In this work, we propose Cardio, a distributed architecture for reliable chip multiprocessors. Cardio, a novel approach for onchip reliability is based on hardware detectors that spot failures and on software routines that reorganize the system to work around faulty components. Compared to previous online reliability solutions, Cardio provides failure reactivity comparable to hardware-only reliable solutions while requiring a much lower area overhead. Cardio operates a distributed resource manager to collect health information about components and leverages a robust distributed control mechanism to manage system-level recovery. Our architecture operational as long as at least one general purpose processor is still functional in the chip. We evaluated our design using a custom simulator and estimate its runtime impact on the SPECMPI benchmarks to be lower than 3%. We estimate its dynamic reconfiguration time to be comprised between 20 and 50 thousand cycles per failure.

show abstract

Section: A Experimental Setupmentioning

confidence: 99%

Cardio: Adaptive CMPs for reliability through dynamic introspective operation

Pellegrini

Bertacco

2011

2011 IEEE International High Level Design Validation and Test Workshop

View full text Add to dashboard Cite

show abstract

“…The intent of this test is either to evaluate the overall performance when executing an application that belongs to a given class (NAS NPB [7], LINPACK [9], HPCC [10]) or to evaluate the performance of a specific part of the executing platform (HBench:OS [3], SPEC MPI [14]). In benchmarking, the goal is to produce a focused intensive activity on an unloaded system to evaluate its performance.…”

Section: (Un)related Workmentioning

confidence: 99%

KRASH: Reproducible CPU load generation on many-core machines

Perarnau

Huard

2010

2010 IEEE International Symposium on Parallel &Amp; Distributed Processing (IPDPS)

View full text Add to dashboard Cite

Abstract-In this article we present KRASH, a tool for reproducible generation of system-level CPU load. This tool is intended for use in shared memory machines equipped with multiple CPU cores which are usually exploited concurrently by several users. The objective of KRASH is to enable parallel application developers to validate their resources use strategies on a partially loaded machine by replaying an observed load in concurrence with their application. To reach this objective, we present a method for CPU load generation which behaves as realistically as possible: the resulting load is similar to the load that would be produced by concurrent processes run by other users. Nevertheless, contrary to a simple run of a CPU-intensive application, KRASH is not sensitive to system scheduling decisions. The main benefit brought by KRASH is this reproducibility: no matter how many processes are present in the system the load generated by our tool strictly respects a given load profile. This last characteristic proves to be hard to achieve using simple methods because the system scheduler is supposed to share the resources fairly among running processes.Our first contribution is a method that cooperates with the system scheduler to produce a CPU load that conforms to a desired load profile. We argue that this cooperation with the system scheduler is mandatory in the generator to reach a good reproducibility, a high precision and a low intrusiveness. Taking advantage of Linux kernel capabilities, we implemented this method in KRASH (Kernel for Reproduction and Analysis of System Heterogeneity). We have run experiments that show that KRASH provides a precise reproduction of the desired load and that it induces a very low overhead on the system. Our second contribution is a qualitative and quantitative study that compares KRASH to other tools dealing with system-level CPU load generation. To our knowledge, KRASH is the only tool that implements the generation of a dynamic load profile (a load varying with time). When used to generate a constant load, KRASH result is among the most realistic ones. Furthermore, KRASH provides more flexibility than other tools.

show abstract

SPEC MPI2007—an application benchmark suite for parallel systems using MPI

MÃ1⁄4ller

Waveren²,

Lieberman

et al. 2009

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

SUMMARYThe SPEC High-Performance Group has developed the benchmark suite SPEC MPI2007 and its run rules over the last few years. The purpose of the SPEC MPI2007 benchmark and its run rules is to further the cause of fair and objective benchmarking of high-performance computing systems. The rules help to ensure that the published results are meaningful, comparable to other results, and reproducible. MPI2007 includes 13 technical computing applications from the fields of computational fluid dynamics, molecular dynamics, electromagnetism, geophysics, ray tracing, and hydrodynamics. We describe the benchmark suite, and compare it with other benchmark suites.

show abstract

SPEC HPG benchmarks for high-performance systems

Cited by 8 publications

References 8 publications

Cardio: Adaptive CMPs for reliability through dynamic introspective operation

Cardio: Adaptive CMPs for reliability through dynamic introspective operation

KRASH: Reproducible CPU load generation on many-core machines

SPEC MPI2007—an application benchmark suite for parallel systems using MPI

Contact Info

Product

Resources

About