On the performance of commodity hardware for low latency and low jitter packet processing

Abstract

With the introduction of Virtual Network Functions (VNF), network processing is no longer done solely on special purpose hardware. Instead, deploying network functions on commodity servers increases flexibility and has been proven effective for many network applications. However, new industrial applications and the Internet of Things (IoT) call for event-based systems and midleware that can deliver ultra-low and predictable latency, which present a challenge for the packet processing infrastructure they are deployed on.In this industry experience paper, we take a hands-on look on the performance of network functions on commodity servers to determine the feasibility of using them in existing and future latencycritical event-based applications. We identify sources of significant latency (delays in packet processing and forwarding) and jitter (variation in latency) and we propose application-and systemlevel improvements for removing or keeping them within required limits. Our results show that network functions that are highly optimized for throughput perform sub-optimally under the very different requirements set by latency-critical applications, compared to latency-optimized versions that have up to 9.8X lower latency. We also show that hardware-aware, system-level configurations, such as disabling frequency scaling technologies, greatly reduce jitter by up 2.4X and lead to more predictable latency. CCS CONCEPTS• Networks → Network measurement.

Review of State-of-the-Art FPGA Applications in IoT Networks

“… Reducing Latency and Jitter: Latency refers to the delays in packet processing, and jitter refers to the variation in latency over some sample of time. Predictable latency and reduced jitter allow for more efficient networking algorithms, thereby increasing performance [ 5 ]. Latency and jitter are often a severe bottleneck in mobile and wireless applications.…”

I4.0 Pilot Project on a Semiconductor Industry: Implementation and Lessons Learned

“…In this context, Industry 4.0 (I4.0) appears as a combination of the Internet of Things (IoT) and Artificial Intelligence (AI), contemplating an ecosystem ranging from acquisition of data to the extraction of knowledge. Sensors, actuators, data acquisition boards, gateways, and back-end servers (cloud-based or on-premises solutions) work together to save raw data continuously in appropriate databases [1][2][3][4]. Thus, they allow the application of AI techniques to provide data prediction, pattern recognition, and event correlation in favor of predictive maintenance and insights that can be useful to obtain a competitive advantage.…”