Mercury: Enabling remote procedure call for high-performance computing

Soumagne, Jérôme; Kimpe, Dries; Zounmevo, Judicael A.; Chaarawi, Mohamad; Koziol, Quincey; Afsahi, Ahmad; Ross, Robert

doi:10.1109/cluster.2013.6702617

Cited by 64 publications

(23 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With the evolving of communication technology, the algorithm simulation and test verification of TD-LTE become more and more needful in the most close to the practical application of scene. Previous algorithms can be verified in the system simulation platform [1] [2]. If the link-level is abstracted for the ideal performance map, the mapping complex scene is increasingly unable to reflect the real environment.…”

Section: Introductionmentioning

confidence: 99%

Design for the Parameters' Transfer of A Hybrid Real-Time Communication Network in TD-LTE

Cai¹,

Hu²,

Wang³

2015

2015 8th International Symposium on Computational Intelligence and Design (ISCID)

View full text Add to dashboard Cite

In TD-LTE test verification system, a proper method is needed for the parameters' transfer, which is based on software and hardware co-simulation platform. In this paper, the hybrid Real-Time communication network, which is composed of TCP/IP protocol, UDP protocol and reflective memory technology on account of hardware board, was built and a loopback test system between system simulation and link system for parameters' interface has been formed. The entire system has realized the sending and receiving of the parameters, which is fast, scalable and flexible link by either the optical fibers or LAN cable. Results show that the latency of the data could prove the key microsecond-level delay. That not only ensures the complex Real-Time of communication system, but also does not lose the parameters' information of the whole system.

show abstract

Section: Introductionmentioning

confidence: 99%

Design for the Parameters' Transfer of A Hybrid Real-Time Communication Network in TD-LTE

Cai¹,

Hu²,

Wang³

2015

2015 8th International Symposium on Computational Intelligence and Design (ISCID)

View full text Add to dashboard Cite

show abstract

“…For load-balancing, all data and metadata are distributed across all nodes using the HPC RPC framework Mercury [34]. The file system runs in user-space and can be easily deployed in under 20 seconds on a 512 node cluster by any user.…”

Section: Introductionmentioning

confidence: 99%

GekkoFS - A Temporary Distributed File System for HPC Applications

Vef

Moti

SuB³

et al. 2018

2018 IEEE International Conference on Cluster Computing (CLUSTER)

View full text Add to dashboard Cite

We present GekkoFS, a temporary, highly-scalable burst buffer file system which has been specifically optimized for new access patterns of data-intensive High-Performance Computing (HPC) applications. The file system provides relaxed POSIX semantics, only offering features which are actually required by most (not all) applications. It is able to provide scalable I/O performance and reaches millions of metadata operations already for a small number of nodes, significantly outperforming the capabilities of general-purpose parallel file systems.

show abstract

“…As a result, we had previous implementations based on MPI-2.2 RMA and on two-sided emulation of the one-sided communications [7]. The performance results of this RPC-based I/O protocol over two-sided emulation of MPI one-sided routines are available for Cray interconnect and InfiniBand in [7].…”

Section: Bulk Data Transfer and Mpi One-sided Communicationsmentioning

confidence: 99%

“…It also defers flow-control to the I/O server and eases the burden of high ratio of compute nodes over I/O nodes in current and future HPC systems. The work on Mercury [7], which is centered around RPC over the same protocol, provides in-depth comparisons with other existing RPC frameworks and protocols.…”

Section: Register Memorymentioning

confidence: 99%

Extreme-scale computing services over MPI: Experiences, observations and features proposal for next-generation message passing interface

Zounmevo

Kimpe

Ross

et al. 2014

The International Journal of High Performance Computing Applica

Self Cite

View full text Add to dashboard Cite

The Message Passing Interface (MPI) is one of the most portable high-performance computing (HPC) programming models, with platform-optimized implementations typically delivered with new HPC systems. Therefore, for distributed services requiring portable, high-performance, user-level network access, MPI promises to be an attractive alternative to custom network portability layers, platform-specific methods, or portable but less performant interfaces such as BSD sockets. In this paper, we present our experiences in using MPI as a network transport for a large-scale distributed storage system. We discuss the features of MPI that facilitate adoption as well as aspects which require various workarounds. Based on use cases, we derive a wish-list for both MPI implementations and the MPI forum to facilitate the adoption of MPI large-scale persistent services. The proposals in the wish-list go beyond the sole needs of distributed services; we contend that they will benefit mainstream HPC applications at extreme scales as well.

show abstract

Mercury: Enabling remote procedure call for high-performance computing

Cited by 64 publications

References 13 publications

Design for the Parameters' Transfer of A Hybrid Real-Time Communication Network in TD-LTE

Design for the Parameters' Transfer of A Hybrid Real-Time Communication Network in TD-LTE

GekkoFS - A Temporary Distributed File System for HPC Applications

Extreme-scale computing services over MPI: Experiences, observations and features proposal for next-generation message passing interface

Contact Info

Product

Resources

About