Reducing Internet Latency: A Survey of Techniques and Their Merits

Abstract

Latency is increasingly becoming a performance bottleneck for Internet Protocol (IP) networks, but historically networks have been designed with aims of maximizing throughput and utilization. This article offers a broad survey of techniques aimed at tackling latency in the literature up to August 2014, and their merits. A goal of this work is to be able to quantify and compare the merits of the different Internet latency reducing techniques, contrasting their gains in delay reduction versus the pain required to implement and deploy them. We found that classifying techniques according to the sources of delay they alleviate provided the best insight into the following issues: 1) the structural arrangement of a network, such as placement of servers and suboptimal routes, can contribute significantly to latency; 2) each interaction between communicating endpoints adds a Round Trip Time (RTT) to latency, especially significant for short flows; 3) in addition to base propagation delay, several sources of delay accumulate along transmission paths, today intermittently dominated by queuing delays; 4) it takes time to sense and use available capacity, with overuse inflicting latency on other flows sharing the capacity; and 5) within end systems delay sources include operating system buffering, head-of-line blocking, and hardware interaction. No single source of delay dominates in all cases, and many of these sources are spasmodic and highly variable. Solutions addressing these sources often both reduce the overall latency and make it more predictable.

Measuring Latency Variation in the Internet

“…Naturally, the observed latency variation can have several causes [6]. These include queueing delay along the path, delayed acknowledgements, transmission delay, media access delays, error recovery, paths changing during the test and processing delays at end-hosts and intermediate nodes.…”

An Optimized AOMDV based Upon RERMR and AMDMM

“…Before presenting protocols that belong to each of the three approaches, energy-related metrics that have been used to determine energy efficient routing path instead of the shortest one are discussed. They are [4] 1. Energy consumed/packet; 2.…”

Smart partitioning of geo-distributed resources to improve cloud network performance

“…We consider bandwidth of the links as the edge weight. There are different sources of latency in a wireless network [20], e.g., delays related to transmission path, link capacity and over subscribed nodes and links. Therefore, as we will see in the results, specifying the bandwidth as the edge weight, not only improves the connectivity inside the partitions regarding the available bandwidth, it also reduces the latency.…”