The Globus eXtensible Input/Output System (XIO): A Protocol Independent IO System for the Grid

Allcock, William; Bresnahan, John; Kettimuthu, K.; Link, Joseph M.

doi:10.1109/ipdps.2005.429

Cited by 42 publications

(34 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In order to adapt GridFTP to our proposed system, we implemented the required functionality to support our proposed system as one of the Globus XIO communication drivers [1] that GridFTP uses as a communication library. Globus XIO is a plugin framework of I/O libraries that is implemented in the Globus Toolkit [7].…”

Section: Methodsmentioning

confidence: 99%

A Multipath OpenFlow Controller for Multiple TCP Stream Applications

Che

Nakasan

Ichikawa

et al. 2017

Journal of Information Processing

View full text Add to dashboard Cite

A large amount of data needs to be transferred from one site to another as fast as possible in the computational science fields. To achieve high-speed data transfer, many applications utilize multiple TCP streams. However, since multiple TCP streams of applications are usually routed according to the default IP routing protocol, only a single shortest path among the multiple paths can be utilized for the data transfer. This research proposes a multipath controller that increases the performance of data transfer by leveraging multiple paths simultaneously for parallel TCP streams. For this purpose, we utilize the Software-Defined Networking (SDN) technology and its implementation, OpenFlow. Furthermore, we proposed a method to determine optimal numbers of parallel TCP streams to be assigned for each path according to its own network condition. This paper presents the design and implementation of the proposed system. As a case study, we applied our proposed system on GridFTP and evaluated the performance improvement. The results demonstrate that our proposed system accelerates the data transfer of GridFTP in both a virtual and a real global-scale environment.

show abstract

Section: Methodsmentioning

confidence: 99%

A Multipath OpenFlow Controller for Multiple TCP Stream Applications

Che

Nakasan

Ichikawa

et al. 2017

Journal of Information Processing

View full text Add to dashboard Cite

show abstract

“…The pluggable architecture allows for easy substitution of alternative authentication, authorization, transport, and file system access methods. In particular, the eXtensible I/O (XIO) interface [5] permits the substitution of alternative transport protocols and alternative file system interfaces.…”

Section: A Wide-area Data Movement: Gridftp and Globus Transfermentioning

confidence: 99%

Exploiting Network Parallelism for Improving Data Transfer Performance

Gunter

Kettimuthu

Kissel

et al. 2012

2012 SC Companion: High Performance Computing, Networking Storage and Analysis

Self Cite

View full text Add to dashboard Cite

Abstract-Many scientific applications, including bulk data transfer, can achieve significantly higher performance from virtually loss-free dedicated resources provisioned on shared links, than from opportunistic network use. Research and Education (R&E) backbones, including the Energy Sciences Network and Internet2, provide general-purpose services to allocate dedicated bandwidth. However, in order to fully take advantage of this technology, applications need to move from coarse-grained "reservation" strategies, to more sophisticated control based on software defined networking (SDN) with technologies such as OpenFlow. We propose here, as one practical step in this direction, using multiple paths for the same application transfer session. This can add bandwidth from "best effort" and dedicated networks, and can also facilitate performance with applications using multiple 10G NICs over 100G capable paths.

show abstract

“…Once these are installed on a system, socket based programs work transparently to the end-user. The Globus GridFTP server can with minor (already available) patches support the Phoebus stack through Globus XIO [34].…”

Section: Cost and Usabilitymentioning

confidence: 99%

On-demand Overlay Networks for Large Scientific Data Transfers

Ramakrishnan

Guok

Jackson

et al. 2010

2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing

View full text Add to dashboard Cite

Abstract. Large scale scientific data transfers are central to scientific processes. Data from large experimental facilities have to be moved to local institutions for analysis or often data needs to be moved between local clusters and large supercomputing centers. In this paper, we propose and evaluate a network overlay architecture to enable highthroughput, on-demand, coordinated data transfers over wide-area networks. Our work leverages Phoebus and On-demand Secure Circuits and Advance Reservation System (OSCARS) to provide high performance wide-area network connections. OSCARS enables dynamic provisioning of network paths with guaranteed bandwidth and Phoebus enables the coordination and effective utilization of the OSCARS network paths. Our evaluation shows that this approach leads to improved end-to-end data transfer throughput with minimal overheads. The achieved throughput using our overlay was limited only by the ability of the end hosts to sink the data.

show abstract

The Globus eXtensible Input/Output System (XIO): A Protocol Independent IO System for the Grid

Cited by 42 publications

References 10 publications

A Multipath OpenFlow Controller for Multiple TCP Stream Applications

A Multipath OpenFlow Controller for Multiple TCP Stream Applications

Exploiting Network Parallelism for Improving Data Transfer Performance

On-demand Overlay Networks for Large Scientific Data Transfers

Contact Info

Product

Resources

About