Implementation and design analysis of a network messaging module using virtual interface architecture

Amerson, Greg M.; Apon, Amy

doi:10.1109/clustr.2004.1392623

Cited by 8 publications

(8 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…2 (a). The third case has configuration (10,20,20,1,40,9), which emulates the case when RS < SS as shown in Fig. 3 (b).…”

Section: Processmentioning

confidence: 86%

“…The performance issues with rendezvous protocols including unnecessary synchronizations, problems with communication progress, and limited opportunities for overlapping communication and computation, have been observed in many studies [1], [7], [15]. Various techniques have been developed to overcome these problems.…”

Section: Related Workmentioning

confidence: 99%

“…Various techniques have been developed to overcome these problems. The techniques can be broadly classified into three types: using interrupts to improve communication progress [1], [17], [19], using asynchronous communication progress to improve communication-computation overlaps [8], [9], [10], [12], [20], and improving the protocol design [3], [15], [16], [18], [19]. The interrupt driven message detection approach [1], [17], [19] allows each party (sender or receiver) to react to a message whenever the message arrives.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Near-Optimal Rendezvous Protocols for RDMA-Enabled Clusters

Small

Yuan

2010

2010 39th International Conference on Parallel Processing

View full text Add to dashboard Cite

Abstract-Optimizing Message Passing Interface (MPI) pointto-point communication for large messages is of paramount importance since most communications in MPI applications are performed by such operations. Remote Direct Memory Access (RDMA) allows one-sided data transfer and provides great flexibility in the design of efficient communication protocols for large messages. However, achieving high performance on RDMAenabled clusters is still challenging due to the complexity both in communication protocols and in protocol invocation scenarios. In this work, we investigate a profile-driven compiled-assisted protocol customization approach for efficient communication on RDMA-enabled clusters. We analyze existing protocols and show that they are not ideal in many situations. By leveraging the RDMA capability, we develop a set of protocols that can provide near-optimal performance for all protocol invocation scenarios, which allows protocol customization to achieve near-optimal performance when the appropriate protocol is used for each communication. Finally, we evaluate the potential benefits of protocol customization using micro-benchmarks and application benchmarks. The results demonstrate that the proposed protocols can out-perform traditional rendezvous protocols to a large degree in many situations and that protocol customization can significantly improve MPI communication performance.

show abstract

“…2 (a). The third case has configuration (10,20,20,1,40,9), which emulates the case when RS < SS as shown in Fig. 3 (b).…”

Section: Processmentioning

confidence: 86%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Near-Optimal Rendezvous Protocols for RDMA-Enabled Clusters

Small

Yuan

2010

2010 39th International Conference on Parallel Processing

View full text Add to dashboard Cite

show abstract

“…Sancho et al further quantified this for large-scale applications in [24]. Amerson et al improved asynchronous progress with an interrupt based approach [13] and an eventdriven MPI library was also designed to improve the communication responsiveness in [21]. In [28] and [20], the authors improved communication progress for zero-copy communication using interrupts and helper threads.…”

Section: Related Workmentioning

confidence: 99%

ProOnE: a general-purpose protocol onload engine for multi- and many-core architectures

Lai

Balaji

Thakur

et al. 2009

Comp. Sci. Res. Dev.

View full text Add to dashboard Cite

Modern high-end computing systems utilize specialized offload engines to enhance various aspects of their processing. For example, high-speed networks such as InfiniBand, Quadrics and Myrinet utilize specialized hardware to offload network processing to help improve performance. However, such hardware units are expensive, and their manufacturing complexity increases exponentially depending on the number and complexity of tasks they offload. On the other hand, the proliferation of multi-and many-core processors into the general desktop and laptop markets is increasingly driving their cost down due to the economies of scale. To take advantage of the obvious benefits of multi/many-core architectures, we propose, design and evaluate ProOnE, a general purpose Protocol Onload Engine. ProOnE utilizes a small subset of the available cores on a multi-core CPU to "onload" various tasks in a dedicated manner instead of "offloading" them to specialized hardware. The general purpose processing capabilities of multi-core architectures allow ProOnE to be designed in a flexible, extensible and scalable manner, while benefiting from the reducing costs of general-purpose CPUs. In this paper, we onload onto ProOnE, several tasks relevant to communication sub-systems such as MPI that are too complex for current hardware offload engines to support, and demonstrate significant benefits in terms of overlap of computation and communication and improved application performance.

show abstract

“…Existing techniques can in general be classified into three types: using interrupts to improve communication progress [1,17,18], using asynchronous communication progress to improve communication-computation overlaps [6,7,8,10,19], and improving the protocol design [2,15,16,18]. The interrupt driven message detection approach [1,17,18] allows each party (sender or receiver) to react to a message whenever the message arrives. The drawback is the non-negligible interrupt overhead, which is usually significant in synchronous communications.…”

Section: Related Workmentioning

confidence: 99%

Maximizing MPI point-to-point communication performance on RDMA-enabled clusters with customized protocols

Small

Yuan

2009

Proceedings of the 23rd International Conference on Supercomputing

View full text Add to dashboard Cite

Message Passing Interface (MPI) point-to-point communications are usually realized with two protocols, the eager protocol for small messages and the rendezvous protocol for medium and large sized messages. Traditional senderinitiated rendezvous protocols are sub-optimal in many situations. In this work, we propose to refine the rendezvous protocol for medium and large messages on RDMA-enabled clusters with three protocols that are customized for different situations, a hybrid protocol for medium sized messages when the sender arrives early, a sender-initiated protocol for large messages when the sender arrives early, and a receiver-initiated protocol when the receiver arrives early. In comparison to traditional sender-initiated rendezvous protocols, the proposed scheme reduces unnecessary synchronizations, decreases the number of control messages that are in the critical path of communications, and improves the communication progress, which results in a significantly better communication-computation overlap capability. We present and analyze these protocols, and describe how these protocols and the eager protocol can be seamlessly integrated in one system without introducing an excessive number of control messages. We have implemented the proposed scheme for InfiniBand clusters. The experimental results demonstrate the effectiveness of the proposed technique.

show abstract

Implementation and design analysis of a network messaging module using virtual interface architecture

Cited by 8 publications

References 7 publications

Near-Optimal Rendezvous Protocols for RDMA-Enabled Clusters

Near-Optimal Rendezvous Protocols for RDMA-Enabled Clusters

ProOnE: a general-purpose protocol onload engine for multi- and many-core architectures

Maximizing MPI point-to-point communication performance on RDMA-enabled clusters with customized protocols

Contact Info

Product

Resources

About