An In-Network Cooperative Storage Schema Based on Neighbor Offloading in a Programmable Data Plane

Abstract

In scientific domains such as high-energy particle physics and genomics, the quantity of high-speed data traffic generated may far exceed the storage throughput and be unable to be in time stored in the current node. Cooperating and utilizing multiple storage nodes on the forwarding path provides an opportunity for high-speed data storage. This paper proposes the use of flow entries to dynamically split traffic among selected neighbor nodes to sequentially amortize excess traffic. We propose a neighbor selection mechanism based on the Local Name Mapping and Resolution System, in which the node weights are computed by combing the link bandwidth and node storage capability, and determining whether to split traffic by comparing normalized weight values with thresholds. To dynamically offload traffic among multiple targets, the cooperative storage strategy implemented in a programmable data plane is presented using the relative weights and ID suffix matching. Evaluation shows that our proposed schema is more efficient compared with end-to-end transmission and ECMP in terms of bandwidth usage and transfer time, and is beneficial in big science.

Utilizing User Bandwidth Resources in Information-Centric Networking through Blockchain-Based Incentive Mechanism

“…One of the methods for achieving smooth evolution of future network architectures is to incrementally deploy ICN routers on top of existing network infrastructure [26]. In the context of IP-compatible ICN protocol stack design, one approach is to incrementally deploy an identifier protocol (IDP) on top of the IP layer [27], thereby empowering the implementation of network functions. The identifier protocol defines a set of rules that govern how packets should act on addresses based on ID, including actions such as addition, deletion, and modification.…”

“…In ICN, all elements in the network are considered entities, including devices, services, and content. Network services are assigned identifiers, such as in-network caching service [27] and multicast service [35]. Drawing on the experience of this, we consider using user bandwidth for ICN transmission as a service and allocate corresponding UBSID.…”

ICN-Based Enhanced Content Delivery for CDN

“…Figure 3 shows the whole picture of this ICN protocol stack. The identifier protocol (IDP) [41] is extended over the IP protocol, and it regulates ID-based NA operations, such as ID-to-NA register and resolution. Above IDP, an ID-to-ID ICN transmission protocol [42] is running, and it provides a pull-based, chunk-oriented transmission service with efficiency and reliability mechanisms, such as retransmission and congestion control.…”

Modeling 3D NAND Flash with Nonparametric Inference on Regression Coefficients for Reliable Solid-State Storage

“…By 2025, data storage analysts forecast a global data sphere of 160 zettabytes to be stored per year [2]. The same challenge exists in collecting and storing data by large scientific facilities connected across the world [3]. The ever-increasing data generation speed requires dense yet performant storage platforms to collect and filter the data, save the data through high-speed networks, and prevent the loss of valuable data.…”