A guided tour of data-center networking

Abts, Dennis; Felderman, Bob

doi:10.1145/2184319.2184335

Cited by 59 publications

(42 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Typical datacenter networks (DCNs) are built with a hierarchical structure with so-called top-of-rack (ToR) switches, aggregation switches, cluster routers, and border routers [10]. Since Ethernet has a good economy especially for 1Gbps and 10Gbps links and switches, it commonly used in DCNs.…”

Section: Existing Datacenter and Supercomputer Networkmentioning

confidence: 99%

Extreme Big Data (EBD): Next Generation Big Data Infrastructure Technologies Towards Yottabyte/Year

Matsuoka

Sato

Tatebe

et al. 2014

JSFI

View full text Add to dashboard Cite

Miyoshi 5Our claim is that so-called "Big Data" will evolve into a new era with proliferation of data from multiple sources such as massive numbers of sensors whose resolution is increasing exponentially, high-resolution simulations generating huge data results, as well as evolution of social infrastructures that allow for "opening up of data silos", i.e., data sources being abundant across the world instead of being confined within an institution, much as how scientific data are being handled in the modern era as a common asset openly accessible within and across disciplines. Such a situation would create the need for not only petabytes to zetabytes of capacity and beyond, but also for extreme scale computing power. Our new project, sponsored under the Japanese JST-CREST program is called "Extreme Big Data", and aims to achieve the convergence of extreme supercomputing and big data in order to cope with such explosion of data. The project consists of six teams, three of which deals with defining future EBD convergent SW/HW architecture and system, and the other three the EBD co-design applications that represent different facets of big data, in metagenomics, social simulation, and climate simulation with real-time data assimilation. Although the project is still early in its lifetime, started in Oct. 2013, we have already achieved several notable results, including becoming world #1 on the Green Graph 500, a benchmark to measure the power efficiency of graph processing that appear in typical big data scenarios.

show abstract

Section: Existing Datacenter and Supercomputer Networkmentioning

confidence: 99%

Extreme Big Data (EBD): Next Generation Big Data Infrastructure Technologies Towards Yottabyte/Year

Matsuoka

Sato

Tatebe

et al. 2014

JSFI

View full text Add to dashboard Cite

show abstract

“…The management of cabling in data centers (DCs) is a complex task [1]. Large scale data centers can have hundreds of kilometers of cables deployed, among which long optical fibers can span more than hundred meters.…”

Section: Introductionmentioning

confidence: 99%

Towards 48-fold cabling complexity reduction in large flattened butterfly networks

Csernai¹,

Ciucu

Braun

et al. 2015

2015 IEEE Conference on Computer Communications (INFOCOM)

View full text Add to dashboard Cite

“…These networks must provide predictable aggregate performance for diverse and unpredictable load conditions [5] [6]. Managing this unpredictability generally translates into inefficiency in the use of transport resources such that associated transport costs become appreciable, particularly for widearea inter-DC networks.…”

Section: Introductionmentioning

confidence: 99%

“…Managing this unpredictability generally translates into inefficiency in the use of transport resources such that associated transport costs become appreciable, particularly for widearea inter-DC networks. In this context, a network that is able to provide predictable network performance for random traffic patterns would be a desirable feature [5] [6].…”

Section: Introductionmentioning

confidence: 99%

Big file protocol (BFP): A traffic shaping approach for efficient transport of large files

Albanese

Yazir

Neville

et al. 2014

2014 IEEE 15th International Conference on High Performance Switching and Routing (HPSR)

View full text Add to dashboard Cite

Telecommunication networks are under stress due to rapid traffic increase. Since most of this traffic increase is due to large file transfers, this paper proposes a crosslayer transport protocol specifically designed to efficiently handle large transactions. Traffic generated from large transactions is shaped into a periodic succession of fixed-size data frames. Each transaction is then scheduled for transmission using a two-way reservation protocol. Simulation results show that the proposed approach is capable of significantly improving goodput and endto-end delay relative to TCP, improving efficiency of bandwidth utilization by over 40%.

show abstract

A guided tour of data-center networking

Abstract: A good user experience depends on predictable performance within the data-center network.

Cited by 59 publications

References 20 publications

Extreme Big Data (EBD): Next Generation Big Data Infrastructure Technologies Towards Yottabyte/Year

Extreme Big Data (EBD): Next Generation Big Data Infrastructure Technologies Towards Yottabyte/Year

Towards 48-fold cabling complexity reduction in large flattened butterfly networks

Big file protocol (BFP): A traffic shaping approach for efficient transport of large files

Contact Info

Product

Resources

About