Adaptive MPI collective operations based on evaluations in LogP model

Paznikov, Alexey A.; Kupriyanov, M. S.

doi:10.1016/j.procs.2021.04.208

Cited by 2 publications

(2 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Data synchronization is a particular challenge, requiring processes to harmonize interactions and data access in remote memory during RMA-based collective operations. Simultaneous access and modification of shared data by multiple processes make efficient, conflict-free data synchronization essential [9].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Enhancing MPI remote memory access model for distributed-memory systems through one-sided broadcast implementation

Abuelsoud,

Kogutenko,

Naveen

2024

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Efficiently processing vast and expanding data volumes is a pressing challenge. Traditional high-performance computers, utilizing distributed-memory architecture and a message-passing model, grapple with synchronization issues, hampering their ability to keep up with the growing demands. Remote Memory Access (RMA), often referred to as one-sided MPI communications, offers a solution by allowing a process to directly access another process’s memory, eliminating the need for message exchange and significantly boosting performance. Unfortunately, the existing MPI RMA standard lacks a collective operation interface, limiting efficiency. To overcome this constraint, we introduce an algorithm design that enables efficient parallelizable collective operations within the RMA framework. Our study focuses primarily on the advantages of collective operations, using the broadcast algorithm as a case study. Our implementations surpass traditional methods, highlighting the promising potential of this technique, as indicated by initial performance tests.

show abstract

Section: Introductionmentioning

confidence: 99%

“…To our knowledge, no prior collective algorithms have been proposed for the MPI one-sided interface (RMA model) [9,14]. However, in RMA-based programs, particularly those using passive target synchronization, certain processes need to access specific data in the memories of all other processes.…”

Section: Introductionmentioning

confidence: 99%