A Dedicated Message Matching Mechanism for Collective Communications

Ghazimirsaeed, S. Mahdieh; Grant, Ryan E.; Afsahi, Ahmad

doi:10.1145/3229710.3229712

Cited by 4 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Optimizing software-based MPI tag matching has been the interest of many researchers. Some of these proposals [8,9,11] consider static designs to improve tag matching operations, while others [4,10,12,13] propose adaptive and dynamic approaches. Offloading the communication progress to NICs for MPI point-to-point and collective operations has been explored in the past.…”

Section: Related Workmentioning

confidence: 99%

Communication-Aware Hardware-Assisted MPI Overlap Engine

Bayatpour

Maqbool

Chakraborty

et al. 2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Overlap of computation and communication is critical for good application-level performance. Modern high-performance networks offer Hardware-assisted tag matching and rendezvous offload to enable communication progress without involving the host CPU. However, hardware based offload cannot be used in many situations due to various hardware limitations and performance issues. Furthermore, hardware-based designs cannot provide good overlap for common communication patterns involving unexpected messages or non-contiguous datatypes. In this paper, we address these limitations by designing a communication-aware overlap engine for MPI that uses novel hardware-assisted and softwarebased solutions to extract overlap for both expected and unexpected messages. The proposed design adapts to the application's communication requirements including message size, datatype, and relative timing of processes using heuristics and history-driven predictions. We evaluate the proposed designs against state-of-the-art MPI libraries and show up to 41% and 22% reduction in latency for collective operations and stencil-based application kernels on 1024 and 128 nodes, respectively, as well as 23% improvement in communication performance of the P3DFFT application.

show abstract

Section: Related Workmentioning

confidence: 99%

Communication-Aware Hardware-Assisted MPI Overlap Engine

Bayatpour

Maqbool

Chakraborty

et al. 2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

Hardware MPI message matching: Insights into MPI matching behavior to inform design

Ferreira

Grant

Levenhagen

et al. 2019

Concurrency and Computation

View full text Add to dashboard Cite

SummaryThis paper explores key differences of MPI match lists for several important United States Department of Energy (DOE) applications and proxy applications. This understanding is critical in determining the most promising hardware matching design for any given high‐speed network. The results of MPI match list studies for the major open‐source MPI implementations, MPICH and Open MPI, are presented, and we modify an MPI simulator, LogGOPSim, to provide match list statistics. These results are discussed in the context of several different potential design approaches to MPI matching–capable hardware. The data illustrate the requirements for different hardware designs in terms of performance and memory capacity. This paper's contributions are the collection and analysis of data to help inform hardware designers of common MPI requirements and highlight the difficulties in determining these requirements by only examining a single MPI implementation.

show abstract

Design and Characterization of InfiniBand Hardware Tag Matching in MPI

Bayatpour

Ghazimirsaeed

et al. 2020

2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID)

View full text Add to dashboard Cite

A Dedicated Message Matching Mechanism for Collective Communications

Cited by 4 publications

References 17 publications

Communication-Aware Hardware-Assisted MPI Overlap Engine

Communication-Aware Hardware-Assisted MPI Overlap Engine

Hardware MPI message matching: Insights into MPI matching behavior to inform design

Design and Characterization of InfiniBand Hardware Tag Matching in MPI

Contact Info

Product

Resources

About