An Emulation Layer for Dynamic Resources with MPI Sessions

Abstract

The current static job scheduling on supercomputers for MPIbased applications is well known to be a limiting factor for the exploitation of a system's top performance in terms of application throughput. Hence, allowing fully flexible and dynamically varying job sizes would provide multiple advantages compared to the current approach, e.g., by prioritizing jobs dynamically and optimizing resource usage by transferring resources economically. A critical step in achieving dynamic resource management with MPI on supercomputers is the development of sound and robust interfaces between MPI applications and the runtime system. Our approach extends the concept of MPI Sessions, a new concept introduced with MPI 4.0, by adding new features to support varying computing resources via the MPI process set abstraction. We then show how these features can be used, as a proof of concept, to request (active) and cope with (passive) varying resources from an application's perspective. To validate of our approach, we develop libmpidynres, a C library providing an emulated MPI Sessions environment on top of existing MPI implementations without MPI Sessions support, which we then use to integrate our proposed extensions to the interface specification. Using this proof-of-concept environment, we show how an MPI Sessions enabled application can use process sets to handle dynamically varying resources.

Malleability in Modern HPC Systems: Current Experiences, Challenges, and Future Opportunities

“…3) Dynamic Processes with Process Sets (DPP): A recent approach [24], [59], [60] introduced dynamic MPI Process interface extensions and an implementation based on Open MPI [61]. This approach follows the principles further described in [60] allowing, e.g., adding/removing processes to/from the application at runtime.…”

“…E.g., the DMRLib [13] development already goes in this direction. 3) To still support all other cases and corner cases, direct access to the dynamic resource MPI layer is still provided [24], [59]; however, likely to be more complex to program. We see programmability as one of the crucial points that is, however, currently investigated insufficiently.…”

Proteo: A Framework for the Generation and Evaluation of Malleable MPI Applications

“…All these solutions require an RMS to support the scheduling of malleable jobs. Some works explore the new concept of MPI Sessions, extending it to implement on-the-fly malleability [22,23].…”