Automatic Low-Overhead Load-Imbalance Detection in MPI Applications

Arzt, Peter; Fischler, Yannic; Lehr, Jan-Patrick; Bischof, Christian

doi:10.1007/978-3-030-85665-6_2

Cited by 2 publications

(3 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Different authors use various analytic formulas to compute the imbalance based on the max and average CPU times, number of processors used, distribution of CPU time across processors, communication time in point-to-point and collective operations, relation of communication and computing times, etc. [37][38][39][40][41].…”

Section: Analyticmentioning

confidence: 99%

See 1 more Smart Citation

Finding Bottlenecks in Message Passing Interface Programs by Scalable Critical Path Analysis

Korkhov,

Gankevich,

Gavrikov

et al. 2023

Algorithms

View full text Add to dashboard Cite

Bottlenecks and imbalance in parallel programs can significantly affect performance of parallel execution. Finding these bottlenecks is a key issue in performance analysis of MPI programs especially on a large scale. One of the ways to discover bottlenecks is to analyze the critical path of the parallel program: the longest execution path in the program activity graph. There are a number of methods of finding the critical path; however, most of them suffer a performance drop when scaled. In this paper, we analyze several methods of critical path finding based on classical Dijkstra and Delta-stepping algorithms along with the proposed algorithm based on topological sorting. Corresponding algorithms for each approach are presented including additional enhancements for increasing performance. The implementation of the algorithms and resulting performance for several benchmark applications (NAS Parallel Benchmarks, CP2K, OpenFOAM, LAMMPS, and MiniFE) are analyzed and discussed.

show abstract

Section: Analyticmentioning

confidence: 99%

“…In [38,39,[42][43][44][45], the authors analyzed the performance of MPI applications using the following patterns.…”

Section: Pattern-basedmentioning

confidence: 99%

Finding Bottlenecks in Message Passing Interface Programs by Scalable Critical Path Analysis

Korkhov,

Gankevich,

Gavrikov

et al. 2023

Algorithms

View full text Add to dashboard Cite

show abstract

“…the modules and call paths where most of the computing time is spent. We mention that this process of finding the hot paths of a code has since been (partially) automated with the Performance Instrumentation Refinement Automation framework (PIRA) tool (Arzt et al, 2021). When we started this work, PIRA was not yet able to deal with a code base such as ISSM.…”

Section: Sustainable Performance Measurementmentioning

confidence: 99%

A scalability study of the Ice-sheet and Sea-level System Model (ISSM, version 4.18)

et al. 2022

Self Cite

View full text Add to dashboard Cite

Abstract. Accurately modelling the contribution of Greenland and Antarctica to sea level rise requires solving partial differential equations at a high spatial resolution. In this paper, we discuss the scaling of the Ice-sheet and Sea-level System Model (ISSM) applied to the Greenland Ice Sheet with horizontal grid resolutions varying between 10 and 0.25 km. The model setup used as benchmark problem comprises a variety of modules with different levels of complexity and computational demands. The core builds the so-called stress balance module, which uses the higher-order approximation (or Blatter–Pattyn) of the Stokes equations, including free surface and ice-front evolution as well as thermodynamics in form of an enthalpy balance, and a mesh of linear prismatic finite elements, to compute the ice flow. We develop a detailed user-oriented, yet low-overhead, performance instrumentation tailored to the requirements of Earth system models and run scaling tests up to 6144 Message Passing Interface (MPI) processes. The results show that the computation of the Greenland model scales overall well up to 3072 MPI processes but is eventually slowed down by matrix assembly, the output handling and lower-dimensional problems that employ lower numbers of unknowns per MPI process. We also discuss improvements of the scaling and identify further improvements needed for climate research. The instrumented version of ISSM thus not only identifies potential performance bottlenecks that were not present at lower core counts but also provides the capability to continually monitor the performance of ISSM code basis. This is of long-term significance as the overall performance of ISSM model depends on the subtle interplay between algorithms, their implementation, underlying libraries, compilers, runtime systems and hardware characteristics, all of which are in a constant state of flux. We believe that future large-scale high-performance computing (HPC) systems will continue to employ the MPI-based programming paradigm on the road to exascale. Our scaling study pertains to a particular modelling setup available within ISSM and does not address accelerator techniques such as the use of vector units or GPUs. However, with 6144 MPI processes, we identified issues that need to be addressed in order to improve the ability of the ISSM code base to take advantage of upcoming systems that will require scaling to even higher numbers of MPI processes.

show abstract

Automatic Low-Overhead Load-Imbalance Detection in MPI Applications

Cited by 2 publications

References 14 publications

Finding Bottlenecks in Message Passing Interface Programs by Scalable Critical Path Analysis

Finding Bottlenecks in Message Passing Interface Programs by Scalable Critical Path Analysis

A scalability study of the Ice-sheet and Sea-level System Model (ISSM, version 4.18)

Contact Info

Product

Resources

About