An open-source family of tools to reproduce MPI-based workloads in interconnection network simulators

Andújar, Francisco J.; Villar, Juan A.; Alfaro, Francisco J.; Sánchez, José L.; Escudero-Sahuquillo, Jesús

doi:10.1007/s11227-016-1757-0

Cited by 11 publications

(7 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The simulator main goal is to perform comparative studies tuning a large range of parameters such as queue sizes, topology, routing, packet sizes, scheduling algorithms, etc. The simulator is capable of running simulations using a wide variety of synthetic traffic types such as random, uniform, bitreversal, bit-complement, etc., and MPI applications using the VEF trace framework [29]. Performance and scalability of the interconnection network are evaluated using several metrics: throughput, end-to-end latency, network latency, etc.…”

Section: Opa Simulation Modelmentioning

confidence: 99%

“…These flows represent the network load generated by applications commonly found in cluster and data centers. In the second scenario, the synthetic HPC flow is replaced by the traffic of real MPI applications using the VEF trace framework [29].…”

Section: Performance Evaluationmentioning

confidence: 99%

“…As stated in Sect. 2.2, Hiperion includes support for MPI application trace files using the VEF trace framework [29]. The traces are a very representative way to know how a real HPC application will behave in any interconnection network simulator without requiring a complex system to run the applications.…”

Section: Scenario Using Application Trace Filesmentioning

confidence: 99%

See 2 more Smart Citations

Providing quality of service in omni-path networks

et al. 2022

Self Cite

View full text Add to dashboard Cite

New hierarchical crossbar switch architectures, such as Omni-Path (OPA) and Cray X2, have appeared to improve packet latency, reduce overall cost and increase fault tolerance of the high-performance interconnection networks in supercomputing and data center systems. These and other interconnect technologies (Infiniband or 40/100 Gigabit Ethernet) include support to provide quality of service (QoS) to the applications. In this paper, we show how this QoS support can be enabled to achieve bandwidth and/or latency differentiation in Omni-Path interconnection networks, as a representative case of hierarchical switches. To do that, three different table-based schedulers are used. We include the description of these schedulers and a comparative study by using the results obtained when we evaluate them with Hiperion, a simulation tool that implements an OPA model.

show abstract

Section: Opa Simulation Modelmentioning

confidence: 99%

Section: Performance Evaluationmentioning

confidence: 99%

See 1 more Smart Citation

Providing quality of service in omni-path networks

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…The main goal is to obtain a simulation tool as flexible as possible, following the basic behavior of OPA, aimed at performing comparative studies. The tool is already capable of running simulations using a wide variety of synthetic traffic types such as uniform, bit‐reversal, bit‐complement, and so on, and MPI file‐traced applications using the VEF framework 13 . Performance and scalability of the network will be evaluated using several metrics: throughput, end‐to‐end latency, network latency, and so on.…”

Section: Opa Simulator Detailsmentioning

confidence: 99%

Enabling Quality of Service Provision in Omni‐Path Switches

Cano-Cano

Andújar

Alfaro-Cortés

et al. 2021

Comp and Math Methods

Self Cite

View full text Add to dashboard Cite

The increasing demand of high‐performance services has motivated the need of the 1 exaflop supercomputing performance. In systems providing such computing capacity, the interconnection network is likely the cornerstone due to the fact that it may become the bottleneck of the system degrading the performance of the entire system. In order to increase the network performance, several improvements have been introduced such as new architectures. Intel © Omni‐Path architecture (OPA) is an example of the constant development of high‐performance interconnection networks, which has not been largely studied because it is a recent technology and the lack of public available information. Another important aspect of all interconnect network technologies is the Quality of Service (QoS) support to applications. In this article, we present an OPA simulation model and some implementation details as well as our simulation tool OPASim. We also review the QoS mechanisms provided by the OPA architecture and present the table‐based output scheduling algorithm simple bandwidth table.

show abstract

“…Finally, we have used real-application traces from the HPCC (High-performance Computing Challenge) benchmark [1], obtained with the VEF framework [5]. HPCC is a suite of MPI-based tests widely used to measure the performance of processor, memory subsystem and the interconnection network of HPC clusters We have chosen the PTRANS test from HPCC, which generates a moderate load in the network.…”

Section: Traffic Modelingmentioning

confidence: 99%

Combining Source-adaptive and Oblivious Routing with Congestion Control in High-performance Interconnects using Hybrid and Direct Topologies

Yébenes

Rocher-González

Escudero-Sahuquillo

et al. 2019

ACM Trans. Archit. Code Optim.

Self Cite

View full text Add to dashboard Cite

Hybrid and direct topologies are cost-efficient and scalable options to interconnect thousands of end nodes in high-performance computing (HPC) systems. They offer a rich path diversity, high bisection bandwidth, and a reduced diameter guaranteeing low latency. In these topologies, efficient deterministic routing algorithms can be used to balance smartly the traffic flows among the available routes. Unfortunately, congestion leads these networks to saturation, where the HoL blocking effect degrades their performance dramatically. Among the proposed solutions to deal with HoL blocking, the routing algorithms selecting alternative routes, such as adaptive and oblivious, can mitigate the congestion effects. Other techniques use queues to separate congested flows from non-congested ones, thus reducing the HoL blocking. In this article, we propose a new approach that reduces HoL blocking in hybrid and direct topologies using source-adaptive and oblivious routing. This approach also guarantees deadlock-freedom as it uses virtual networks to break potential cycles generated by the routing policy in the topology. Specifically, we propose two techniques, called Source-Adaptive Solution for Head-of-Line Blocking Avoidance (SASHA) and Oblivious Solution for Head-of-Line Blocking Avoidance (OSHA). Experiment results, carried out through simulations under different traffic scenarios, show that SASHA and OSHA can significantly reduce the HoL blocking.

show abstract

An open-source family of tools to reproduce MPI-based workloads in interconnection network simulators

Cited by 11 publications

References 15 publications

Providing quality of service in omni-path networks

Providing quality of service in omni-path networks

Enabling Quality of Service Provision in Omni‐Path Switches

Combining Source-adaptive and Oblivious Routing with Congestion Control in High-performance Interconnects using Hybrid and Direct Topologies

Contact Info

Product

Resources

About