Peta-Flow Computing: Vision and Challenges

Ohsaki, Hiroyuki; Nozaki, Kazunori; K, Baba; Sakane, Eisaku; Sakamoto, Naohisa; Koyamada, K.; Shimojo, Shinsuke

doi:10.1109/saint.2011.48

Cited by 2 publications

(1 citation statement)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Grid applications are required to exchange large blocks of data among distributed multiple sites because the amount of data on those applications is growing to the petascale [11] [23]. Although the sites have sufficient computational resources, such as CPU, memory, and so on, the total processing performance might be decreased when the network path between communicating nodes is congested.…”

Section: Introductionmentioning

confidence: 99%

Predicting network throughput for grid applications on network virtualization areas

Lee

Abe

Hirotsu

et al. 2011

Proceedings of the First International Workshop on Network-Aware Data Management

View full text Add to dashboard Cite

Grid applications are increasingly becoming dependent on network resources. Predicted network throughput is a useful parameter for network-aware scheduling for such applications. Although throughput prediction methods have been proposed, many of these methods are suffering from the fact that the probability distribution of traffic is unclear and the scale and bandwidth of networks are constantly changing. Furthermore, a virtual machine has been used as a platform for grid computing, and it can affect network measurement. A prediction method that uses pairs of differently sized connections has been proposed. This method, which we call connection pair, features a small probe transfer that predicts the throughput of a large data transfer. We propose a throughput prediction method based on the connection pair that uses ν-support vector regression (SVR) and polynomial kernel to deal with prediction models represented as a non-linear and continuous monotonic function. The prediction accuracy of our method compared to that of a previous prediction method is higher. Moreover, the drop in the accuracy is also smaller than that of the previous method under an unstable network state. We clarify the prediction accuracy with other probe sizes for the connection pair. The accuracy is decreased by a small-sized probe, and there are no changes with a large-sized probe. These results show that our method is accurate, robust, and suitable for its purpose.

show abstract

Section: Introductionmentioning

confidence: 99%