Single Node On-Line Simulation of MPI Applications with SMPI

Clauss, Philippe; Stillwell, Mark; Genaud, Stéphane; Suter, Frédéric; Casanova, Henri; Quinson, Martin

doi:10.1109/ipdps.2011.69

Cited by 32 publications

(37 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…es/computer-sciences/performance-tools/paraver) and Vampir [28] (http://www.vampir.eu). Also, SimGrid [29] and OMNeT++ [30] are multi-purpose simulation toolkits that have been used to investigate the runtime capabilities of future system architectures.…”

Section: Related Workmentioning

confidence: 99%

Toward a Performance/Resilience Tool for Hardware/Software Co-design of High-Performance Computing Systems

Engelmann

Naughton

2013

2013 42nd International Conference on Parallel Processing

View full text Add to dashboard Cite

Abstract-xSim is a simulation-based performance investigation toolkit that permits running high-performance computing (HPC) applications in a controlled environment with millions of concurrent execution threads, while observing application performance in a simulated extreme-scale system for hardware/software co-design. The presented work details newly developed features for xSim that permit the injection of MPI process failures, the propagation/detection/notification of such failures within the simulation, and their handling using application-level checkpoint/restart. These new capabilities enable the observation of application behavior and performance under failure within a simulated future-generation HPC system using the most common fault handling technique.

show abstract

Section: Related Workmentioning

confidence: 99%

Toward a Performance/Resilience Tool for Hardware/Software Co-design of High-Performance Computing Systems

Engelmann

Naughton

2013

2013 42nd International Conference on Parallel Processing

View full text Add to dashboard Cite

show abstract

“…A clever instantiation leads to a very good approximation for large enough messages [10]. For small messages, very good results can be obtained with a piecewise linear model [11].…”

Section: Network Communication Modelingmentioning

confidence: 99%

“…As explained in [8], the LogGPS model "ignores congestion in the network and assumes full effective bisection bandwidth", which is a valid hypothesis for several high-end computing platforms but not for cheaper Ethernet clusters or even torus-based networks as used in BlueGene or Cray machines. The model used in SIMGRID is an extension of the one proposed in [11] and accounts for such phenomenon as well as for network contention occurring in the core of the network. The importance of accounting for such phenomenon was demonstrated in [11] for MPI collective operations involving large amounts of data.…”

Section: High Performance Computingmentioning

confidence: 99%

“…The model used in SIMGRID is an extension of the one proposed in [11] and accounts for such phenomenon as well as for network contention occurring in the core of the network. The importance of accounting for such phenomenon was demonstrated in [11] for MPI collective operations involving large amounts of data. LOGGOPSIM represents MPI executions as GOAL traces, i.e., DAGs of computations and communications.…”

Section: High Performance Computingmentioning

confidence: 99%

See 1 more Smart Citation

Scalable Multi-purpose Network Representation for Large Scale Distributed System Simulation

Bobelin

Legrand

Márquez³

et al. 2012

2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (Ccgrid 2012)

Self Cite

View full text Add to dashboard Cite

Abstract-Conducting experiments in large-scale distributed systems is usually time-consuming and labor-intensive. Uncontrolled external load variation prevents to reproduce experiments and such systems are often not available to the purpose of research experiments, e.g., production or yet to deploy systems. Hence, many researchers in the area of distributed computing rely on simulation to perform their studies. However, the simulation of large-scale computing systems raises several scalability issues, in terms of speed and memory. Indeed, such systems now comprise millions of hosts interconnected through a complex network and run billions of processes. Most simulators thus trade accuracy for speed and rely on very simple and easy to implement models. However, the assumptions underlying these models are often questionable, especially when it comes to network modeling.In this paper, we show that, despite a widespread belief in the community, achieving high scalability does not necessarily require to resort to overly simple models and ignore important phenomena. We show that relying on a modular and hierarchical platform representation, while taking advantage of regularity when possible, allows us to model systems such as data and computing centers, peer-to-peer networks, grids, or clouds in a scalable way. This approach has been integrated into the opensource SIMGRID simulation toolkit. We show that our solution allows us to model such systems much more accurately than other state-of-the-art simulators without trading for simulation speed. SIMGRID is even sometimes orders of magnitude faster.

show abstract

“…Our model is implemented within SMPI [12], an opensource MPI implementation that connects real-world applications to the SimGrid [10] simulation framework. With SMPI, standard MPI applications written in C or FORTRAN can be compiled and run in a simulated network environment, and traces documenting computation and communication events can be captured without incurring errors from tracing overheads or improper synchronization of clocks as in physical experiments.…”

Section: Introductionmentioning

confidence: 99%

Toward Better Simulation of MPI Applications on Ethernet/TCP Networks

Bedaride

Degomme

Genaud

et al. 2014

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Abstract-Simulation and modeling for performance prediction and profiling is essential for developing and maintaining HPC code that is expected to scale for next-generation exascale systems, and correctly modeling network behavior is essential for creating realistic simulations. In this article we describe an implementation of a flow-based hybrid network model that accounts for factors such as network topology and contention, which are commonly ignored by other approaches. We focus on large-scale, Ethernet-connected systems, as these currently compose 37.8% of the TOP500 index, and this share is expected to increase as higher-speed 10 and 100GbE become more available. The European Mont-Blanc project to study exascale computing by developing prototype systems with low-power embedded devices will also use Ethernet-based interconnect. Our model is implemented within SMPI, an open-source MPI implementation that connects real applications to the SimGrid simulation framework. SMPI provides implementations of collective communications based on current versions of both OpenMPI and MPICH. SMPI and SimGrid also provide methods for easing the simulation of largescale systems, including shadow execution, memory folding, and support for both online and offline (i.e., post-mortem) simulation. We validate our proposed model by comparing traces produced by SMPI with those from real world experiments, as well as with those obtained using other established network models. Our study shows that SMPI has a consistently better predictive power than classical LogP-based models for a wide range of scenarios including both established HPC benchmarks and real applications.

show abstract

Single Node On-Line Simulation of MPI Applications with SMPI

Cited by 32 publications

References 27 publications

Toward a Performance/Resilience Tool for Hardware/Software Co-design of High-Performance Computing Systems

Toward a Performance/Resilience Tool for Hardware/Software Co-design of High-Performance Computing Systems

Scalable Multi-purpose Network Representation for Large Scale Distributed System Simulation

Toward Better Simulation of MPI Applications on Ethernet/TCP Networks

Contact Info

Product

Resources

About