High-Performance Network Traffic Processing Systems Using Commodity Hardware

García‐Dorado, José Luis; Mata, Felipe; Ramos, Javier; Río, Pedro M. Santiago del; Moreno, Víctor; Aracil, Javier

doi:10.1007/978-3-642-36784-7_1

Cited by 28 publications

(30 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another recent work by García-Dorado et al [11] provides overview of different commodity based packet capture solutions. The paper describes techniques used by various researches to achieve 10 G packet rates in detail.…”

Section: Related Workmentioning

confidence: 99%

High-density network flow monitoring

Velan

Pus

2015

2015 IFIP/IEEE International Symposium on Integrated Network Management (IM)

View full text Add to dashboard Cite

Abstract-Monitoring of high-speed networks is becoming a resource intensive task. There are dedicated flow monitoring probes built with commodity hardware support up to 10 G links, but multiple 10 G or even 100 G optical networks are being used for transport networks and a data center connectivity. Running and maintaining many separate probes is uneconomical and timeconsuming. Therefore, we explore the possibility to facilitate network interface cards (NICs) with multiple 10 G interfaces to build probes which can replace many existing boxes, leading to reduced management and operational costs. The monitoring performance is critical for such a high-density solution. We use two custom-built, FPGA-based NICs, each with eight 10 G interfaces to test current CPU limits and to propose improvements for the near future commodity NICs.

show abstract

Section: Related Workmentioning

confidence: 99%

High-density network flow monitoring

Velan

Pus

2015

2015 IFIP/IEEE International Symposium on Integrated Network Management (IM)

View full text Add to dashboard Cite

show abstract

“…When a packet has been transferred to the user-space, its corresponding packet descriptor will not be released to the system, but be reused to store new packets. This technology removed the bottleneck from data and skbuff allocation/deallocation [2] and can effectively reduce buffer management overhead.…”

Section: Optimization Via Softwarementioning

confidence: 99%

“…As we know, commodity multi-core CPU has many merits [1,2]: (1) It entails a high flexibility and programmability because it runs on a general-purpose operating system and uses a high-level programming language. (2) It is easy to develop for common users, because it observes a Standard API.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Towards high-performance packet processing on commodity multi-cores: current issues and future directions

Tang

Yan

Sun

et al. 2015

Sci. China Inf. Sci.

View full text Add to dashboard Cite

The demands of programmability have become more and more exigent as novel network services appear, such as E-commerce, social softwares, and online videos. Commodity multi-core CPUs have been widely applied in network packet processing to get high programmability and reduce the time-to-market. However, there is a great gap between the packet processing performance of commodity multi-core and that of the traditional packet processing hardware, e.g., NP (Network Process). Recently, optimization of the packet processing performance of commodity multi-cores has become a hot topic in industry and academia. In this paper, based on a detailed analysis of the packet processing procedure, firstly we identify two dominating overheads, namely the virtual-to-physical address translation and the packet buffer management. Secondly, we make a comprehensive survey on the current optimization methods. Thirdly, based on the survey, the heterogeneous architecture of the commodity multi-core + FPGA is proposed as a promising way to improve the packet processing performance. Fourthly, a novel Self-Described Buffer (SDB) management technology is introduced to eliminate the overheads of the allocation and deallocation of the packet buffers offloaded to FPGA. Then, an evaluation testbed, named PIOT (Packet I/O Testbed), is designed and implemented to evaluate the packet forwarding performance. I/O capacity of different commodity multi-core CPUs and the performance of optimization methods are assessed and compared based on PIOT. At last, the future work of packet processing optimization on multi-core CPUs is discussed.

show abstract

“…Let us refer to such a combination of open-source software and commodity hardware as off-the-shelf systems. Off-the-shelf systems offer numerous advantages that overcome some of the limitations of ad-hoc hardware solutions, namely: flexibility, affordability, ease of maintenance, availability and scalability [2].…”

Section: Introductionmentioning

confidence: 99%

Packet Storage at Multi-gigabit Rates Using Off-the-Shelf Systems

Moreno

Río

Ramos

et al. 2014

2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security

Self Cite

View full text Add to dashboard Cite

Esta es la versión de autor de la comunicación de congreso publicada en: This is an author produced version of a paper published in: Abstract-The use of closed solutions from most known vendors to carry out network-monitoring tasks has turned out to be a questionable option given their lack of flexibility and extensibility, which has typically been translated into higher costs. Consequently, we study whether high-performance monitoring tasks can be carried out using off-the-shelf systems, the alternative to these pitfalls from the research community, consisting in the combination of open-source software and commodity hardware. We focus on sniffing and storing network traffic as one of the major tasks in any monitoring architecture. Specifically, we first review the keys to sniff traffic at multi-gigabit rates, and then present an experimental evaluation of commodity hard drives. Finally, the lessons learned from such studies and the performed experiments have conducted us to the development of an open solution, namely HPCAP, which sniffs and stores multi-gigabit traffic using commodity hardware without packet losses in very demanding scenarios.

show abstract

High-Performance Network Traffic Processing Systems Using Commodity Hardware

Cited by 28 publications

References 12 publications

High-density network flow monitoring

High-density network flow monitoring

Towards high-performance packet processing on commodity multi-cores: current issues and future directions

Packet Storage at Multi-gigabit Rates Using Off-the-Shelf Systems

Contact Info

Product

Resources

About