Optimizing 10-Gigabit Ethernet for Networks of Workstations, Clusters, and Grids: A Case Study

Feng, Wu-chun

doi:10.2172/826464

Cited by 24 publications

(26 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Commodity network interfaces operate at 10 Gb/s, allowing intra-cluster communication at this speed. Even end-to-end links between Grid clusters that are separated by large distances now approach the 10 Gb/s throughput level [14], [30]. A processor can access as many as 5 bits per cycle on average from a remote node, the same speed that local access to memory was a decade ago.…”

Section: B Near Real-time Correlationmentioning

confidence: 99%

Fine-grained tracking of Grid infections

Gehani

Baig

Mahmood

et al. 2010

2010 11th IEEE/ACM International Conference on Grid Computing

View full text Add to dashboard Cite

Abstract-Previous distributed anomaly detection efforts have operated on summary statistics gathered from each node. This has the advantage that the audit trail is limited in size since event sets can be succinctly represented. While this minimizes the bandwidth consumed and helps scale the detection to a large number of nodes, it limits the infrastructure's ability to identify the source of anomalies. We describe three optimizations that together allow fine-grained tracking of the sources of anomalous activity in a Grid, thereby facilitating precise responses. We demonstrate the scheme's scalability in terms of storage and network bandwidth overhead with an implementation on nodes running BOINC. The results generalize to other types of Grids as well.

show abstract

Section: B Near Real-time Correlationmentioning

confidence: 99%

Fine-grained tracking of Grid infections

Gehani

Baig

Mahmood

et al. 2010

2010 11th IEEE/ACM International Conference on Grid Computing

View full text Add to dashboard Cite

show abstract

“…TCP improvement Given the existing software infrastructure based on file transfer applications such as bbftp, bbcp and GridFTP that are based on TCP, and TCP's success in scaling up to the Gbps range [6], we restricted our evaluations to implementations of the TCP protocol. Rate based protocols like SABUL [9] and Tsunami [21] or storage based protocols such as iSCSI or Fiber Channel over IP are currently out of scope.…”

Section: The Advanced Stacksmentioning

confidence: 99%

“…The MHz/Mbps utilization averaged over all stacks, for all distances and all windows was 0.93+-0.08 MHz/Mbps. The MHz/Mbps averaged over all distances and window sizes varied from 0.8+-0.35 for S-TCP to 1.0+-0.2 6 http://www-iepm.slac.stanford.edu/bw/tcp-eval/ for Fast. We observed no significant difference in sender side CPU load between the various protocols.…”

Section: Cpu Loadmentioning

confidence: 99%

Evaluation of Advanced TCP Stacks on Fast Long-Distance Production Networks

Bullot¹

2004

View full text Add to dashboard Cite

1With the growing needs of data intensive science, such as High Energy Physics, and the need to share data between multiple remote computer and data centers worldwide, the necessity for high network performance to replicate large volumes (TBytes) of data between remote sites in Europe, Japan and the U.S. is imperative. Currently, most production bulkdata replication on the network utilizes multiple parallel standard (Reno based) TCP streams. Optimizing the window sizes and number of parallel stream is time consuming, complex, and varies (in some cases hour by hour) depending on network configurations and loads. We therefore evaluated new advanced TCP stacks that do not require multiple parallel streams while giving good performances on high speed long-distance network paths. In this paper, we report measurements made on real production networks with various TCP implementations on paths with different Round Trip Times (RTT) using both optimal and sub-optimal window sizes.We compared the New Reno TCP with the following stacks: HS-TCP, Fast TCP, S-TCP, HSTCP-LP, H-TCP and Bic-TCP. The analysis will compare and report on the stacks in terms of achievable throughput, impact on RTT, intra-and inter-protocol fairness, stability, as well as the impact of reverse traffic.

show abstract

“…SAN interconnects such as InfiniBand (IBA) [3] and 10-Gigabit Ethernet (10GigE) [18,16,7,15] have been introduced and are currently gaining momentum for designing high-end computing systems and data-centers. Besides high performance, these modern interconnects are providing a range of novel features and their support in hardware, e.g., Remote Direct Memory Access (RDMA), Remote Atomic Operations, Offloaded Protocol support, Quality of Service support and several others.…”

Section: Introductionmentioning

confidence: 99%

Designing next generation data-centers with advanced communication protocols and systems services

Balaji¹,

Vaidyanathan²,

Narravula³

et al. 2006

Proceedings 20th IEEE International Parallel &Amp; Distributed Processing Symposium

View full text Add to dashboard Cite

Current data-centers rely on TCP/IP over Fast-and Gigabit-Ethernet for data communication even within the cluster environment for costeffective designs, thus limiting their maximum capacity. Together with raw performance, such data-centers also lack in efficient support for intelligent services, such as requirements for caching documents, managing limited physical resources, load-balancing, controlling overload scenarios, and prioritization and QoS mechanisms, that are becoming a common requirement today. On the other hand, the System Area Network (SAN) technology is making rapid advances during the recent years. Besides high performance, these modern interconnects are providing a range of novel features and their support in hardware (e.g., RDMA, atomic operations, QoS support). In this paper, we address the capabilities of these current generation SAN technologies in addressing the limitations of existing data-centers. Specifically, we present a novel framework comprising of three layers (communication protocol support, data-center service primitives and advanced data-center services) that work together to tackle the issues associated with existing data-centers. We also present preliminary results in the various aspects of the framework, which demonstrate close to an order of magnitude performance benefits achievable by our framework as compared to existing data-centers in several cases.

show abstract

Optimizing 10-Gigabit Ethernet for Networks of Workstations, Clusters, and Grids: A Case Study

Abstract: This paper presents a case study of the Sunnyvale, California and Geneva, Switzerland (i.e.,10,037 kilometers) to move over a terabyte of data in less than an hour. Thus, the above results indicate that 10GbE may be a cost-effective solution across a multitude of computing environments.

Cited by 24 publications

References 9 publications

Fine-grained tracking of Grid infections

Fine-grained tracking of Grid infections

Evaluation of Advanced TCP Stacks on Fast Long-Distance Production Networks

Designing next generation data-centers with advanced communication protocols and systems services

Contact Info

Product

Resources

About