Spotlight: Scalable Transport Layer Load Balancing for Data Center Networks

Aghdai, Ashkan; Chu, Cing-Yu; Xu, Yang; Dai, David; Xu, Jun; Chao, H. Jonathan

doi:10.1109/tcc.2020.3024834

Cited by 16 publications

(27 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Yet, both solutions cannot guarantee insertions in constant-time: Flow-Blaze relies on a stash that may be easily filled by an adversary while SilkRoad is limited by both the size of the bloom filter (which is quickly filled under SYN-flood attacks) and the complexity of the implementation. Other stateful LBs such as LBAS [59], Spotlight [60] Concury [61], and the work of Hunt et al [62] replace the hash server selection mechanism with a more advanced scheme yet insertions into the connection table cannot be performed in constant time. CRAB [63] is an LB that only participates in the connection establishment and then migrates a TCP connection to the selected server.…”

Section: Related Workmentioning

confidence: 99%

Cheetah: A High-Speed Programmable Load-Balancer Framework With Guaranteed Per-Connection-Consistency

Barbette

Wu²,

Kostić³

et al. 2022

IEEE/ACM Trans. Networking

View full text Add to dashboard Cite

Large service providers use load balancers to dispatch millions of incoming connections per second towards thousands of servers. There are two basic yet critical requirements for a load balancer: uniform load distribution of the incoming connections across the servers, which requires to support advanced load balancing mechanisms, and per-connection-consistency (PCC), i.e, the ability to map packets belonging to the same connection to the same server even in the presence of changes in the number of active servers and load balancers. Yet, simultaneously meeting these requirements has been an elusive goal. Today's load balancers minimize PCC violations at the price of non-uniform load distribution. This paper presents CHEETAH, a load balancer that supports advanced load balancing mechanisms and PCC while being scalable, memory efficient, fast at processing packets, and offers comparable resilience to clogging attacks as with today's load balancers. The CHEETAH LB design guarantees PCC for any realizable server selection load balancing mechanism and can be deployed in both stateless and stateful manners, depending on operational needs. We implemented CHEETAH on both a software and a Tofino-based hardware switch. Our evaluation shows that a stateless version of CHEETAH guarantees PCC, has negligible packet processing overheads, and can support load balancing mechanisms that reduce the flow completion time by a factor of 2 − 3×.

show abstract

Section: Related Workmentioning

confidence: 99%

Cheetah: A High-Speed Programmable Load-Balancer Framework With Guaranteed Per-Connection-Consistency

Barbette

Wu²,

Kostić³

et al. 2022

IEEE/ACM Trans. Networking

View full text Add to dashboard Cite

show abstract

“…The main purpose of a load balancer is to efficiently distribute the load to multiple parts of the network infrastructure to increase throughput, reduce response time, and prevent the overloading of a single resource. There are two main balancers: the layer 3 (L3) load balancer (s) selects one of the many routes that can direct the packet, while the layer 4 (L4) load balancer (s) chooses the one of serving instances (servers) for the incoming service request [29]. The data centre network has many redundant resources, so load balancers play an important role.…”

Section: Load Balancing Applicationsmentioning

confidence: 99%

Untitled

2022

IJDPS

View full text Add to dashboard Cite

By programming both the data plane and the control plane, network operators can adapt their networks to their needs. Thanks to research over the past decade, this concept has more formulized and more technologically feasible. However, since control plane programmability came first, it has already been successfully implemented in the real network and is beginning to pay off. Today, the data plane programmability is evolving very rapidly to reach this level, attracting the attention of researchers and developers: Designing data plane languages, application development on it, formulizing software switches and architecture that can run data plane codes and the applications, increasing performance of software switch, and so on. As the control plane and data plane become more open, many new innovations and technologies are emerging, but some experts warn that consumers may be confused as to which of the many technologies to choose. This is a testament to how much innovation is emerging in the network. This paper outlines some emerging applications on the data plane and offers opportunities for further improvement and optimization. Our observations show that most of the implementations are done in a test environment and have not been tested well enough in terms of performance, but there are many interesting works, for example, previous control plane solutions are being implemented in the data plane.

show abstract

“…To guarantee PCC, stateful LBs keep tracking the state of the connections [1], [6]- [8]. Using advanced hashing mechanism (e.g.…”

Section: A Related Workmentioning

confidence: 99%

“…Segment Routing (SR) [14] and powerof-2-choice [15] are used in [7], [9] to daisy chaine 2 servers and let them decide, based on their actual load states, whether or not the new flow should be accepted. Another approach is to periodically poll servers' instant "available capacities" [8]. Ridge Regression is used in [16] to predict server load states and compute the relative "weight" of each server for Weighted Costed Multi-Path (WCMP).…”

Section: A Related Workmentioning

confidence: 99%

Charon: Load-Aware Load-Balancing in P4

Rizzi

Yao

Desmouceaux

et al. 2021

2021 17th International Conference on Network and Service Management (CNSM)

View full text Add to dashboard Cite

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

show abstract

Spotlight: Scalable Transport Layer Load Balancing for Data Center Networks

Cited by 16 publications

References 29 publications

Cheetah: A High-Speed Programmable Load-Balancer Framework With Guaranteed Per-Connection-Consistency

Cheetah: A High-Speed Programmable Load-Balancer Framework With Guaranteed Per-Connection-Consistency

Untitled

Charon: Load-Aware Load-Balancing in P4

Contact Info

Product

Resources

About