The Globus Galaxies platform: delivering science gateways as a service

Madduri, Ravi; Chard, Kyle; Chard, Ryan; Łaciński, Łukasz; Rodríguez, Álex; Sulakhe, Dinanath; Kelly, David; Dave, Utpal J.; Foster, Ian

doi:10.1002/cpe.3486

Cited by 45 publications

(27 citation statements)

References 21 publications

(19 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…If combined with repository information, the integrative researches could make an important step forward. The work reminds the popularity and reach of cloud computers on scientific experiments, despite the limitations. Their solution offers a gateway to overcome the gap between the technology and the specific requirements of scientists.…”

Section: Related Workmentioning

confidence: 85%

See 1 more Smart Citation

Optimizing computational resource management for the scientific gateways ecosystems based on the service‐oriented paradigm

et al. 2020

View full text Add to dashboard Cite

Science Gateways provide portals for experiments execution, regardless of the users' computational background. Nowadays its construction and performance need enhancement in terms of resource provision and task scheduling. We present the Modular Distributed Architecture to support the Protein Structure Prediction (MDAPSP), a Service-Oriented Architecture for management and construction of Science Gateways, with resource provisioning on a heterogeneous environment. The Decision Maker, central module of MDAPSP, defines the best computational environment according to experiment parameters. The proof of concept for MDAPSP is presented in WorkflowSim, with two novel schedulers. Our results demonstrate good Quality of Service (QoS), capable of correctly distributing the workload, fair response times, providing load balance, and overall system improvement. The study case relies on PSP algorithms and the Galaxy framework, with monitoring experiments to show the bottlenecks and critical aspects. K E Y W O R D Soptimization, protein structure prediction, science gateways, scientific workflow, service-oriented architecture, WorkflowSim 1 Softw: Pract Exper. 2020;50:899-924. wileyonlinelibrary.com/journal/spe © 2020 John Wiley & Sons, Ltd. 899 900 MARTINS DE OLIVEIRA et al.Another limitation of scientific gateways is the resource provision for its machines, that affect usability and performance. The problem with resource provisioning is a quest for the best configuration, requiring the smallest investment and minimal overheads. In general, inexperienced users cannot make good decisions on what machines to contract. Limited economic resources complicate the scenario.Cloud computing paradigm is among the principal resources available, as it has many advantages: scalability, pay-as-you-go features, on-demand provisioning, and management by third parties. Multiple providers infrastructure and decentralization of resources are expanding and are expected to create impact on diverse areas. 4 Resource providing and management are one of the challenging aspects of this expansion. 5 Despite its success, cloud is not the only option for provisioning. 6 Computer clusters are reliable infrastructures for conducting experiments, mainly High-Performance Computing (HPC) and concurrent algorithms. The advantages of cluster machines are local management, freedom of configuration, reliable storage, and fast network transfers. 3 For those reasons, we investigate the scientific gateway Galaxy, because it is an adaptable system, capable to operate over different infrastructures, including local workstations.Galaxy is a well-known framework for scientific experiments, with workflow management and reproducibility support. Its tools offer practical solutions and addition of new algorithms according to the evolution of the system. The focus is Biomedical science, protein prediction, gene sequencing, and other bioinformatics-related areas. Its advantages are simple interface, reliability, powerful tools, and an active community. 7 However, as any other...

show abstract

Section: Related Workmentioning

confidence: 85%

“…The growing necessity for computer resources goes in the opposite direction of the economic concerns. The pay‐as‐you‐go solutions offer many variations, considering investment capacities . The gap in interoperability creates many problems and delays progress.…”

Section: Decision Maker Modulementioning

confidence: 99%

Optimizing computational resource management for the scientific gateways ecosystems based on the service‐oriented paradigm

et al. 2020

View full text Add to dashboard Cite

show abstract

“…The Globus Galaxies platform [14] is an integrated suite of services that provide scalable analysis pipeline creation and execution on the cloud. Across its 28 active deployments, including climate change, cosmology, materials science, and genomics, the platform serves more than 300 researchers across 30 institutions.…”

Section: Scenariosmentioning

confidence: 99%

Globus Nexus: A Platform-as-a-Service provider of research identity, profile, and group management

Chard

Lidman

McCollam

et al. 2016

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

Globus Nexus is a professionally hosted Platform-as-a-Service that provides identity, profile and group management functionality for the research community. Many collaborative e-Science applications need to manage large numbers of user identities, profiles, and groups. However, developing and maintaining such capabilities is often challenging given the complexity of modern security protocols and requirements for scalable, robust, and highly available implementations. By outsourcing this functionality to Globus Nexus, developers can leverage best-practice implementations without incurring development and operations overhead. Users benefit from enhanced capabilities such as identity federation, flexible profile management, and user-oriented group management. In this paper we present Globus Nexus, describe its capabilities and architecture, summarize how several e-Science applications leverage these capabilities, and present results that characterize its scalability, reliability, and availability.

show abstract

“…Systems like these and others, are primarily designed to aid in the creation of clusters for semi-permanent usage. Other systems, such as the Globus Galaxies platform [21] and Makeflow [22], enable on-demand and elastic cluster provisioning in response to user submitted workload. CLOUD KOTTA is unique, however, in its use of commodity AWS services and its broad focus on providing a framework for secure data storage and analysis.…”

Section: Related Workmentioning

confidence: 99%

Cloud Kotta: Enabling secure and scalable data analytics in the cloud

Babuji

Chard

Gerow

et al. 2016

2016 IEEE International Conference on Big Data (Big Data)

Self Cite

View full text Add to dashboard Cite

Abstract-Distributed communities of researchers rely increasingly on valuable, proprietary, or sensitive datasets. Given the growth of such data, especially in fields new to data-driven, computationally intensive research like the social sciences and humanities, coupled with what are often strict and complex data-use agreements, many research communities now require methods that allow secure, scalable and cost-effective storage and analysis. Here we present CLOUD KOTTA: a cloud-based data management and analytics framework. CLOUD KOTTA delivers an end-to-end solution for coordinating secure access to large datasets, and an execution model that provides both automated infrastructure scaling and support for executing analytics near to the data. CLOUD KOTTA implements a fine-grained security model ensuring that only authorized users may access, analyze, and download protected data. It also implements automated methods for acquiring and configuring low-cost storage and compute resources as they are needed. We present the architecture and implementation of CLOUD KOTTA and demonstrate the advantages it provides in terms of increased performance and flexibility. We show that CLOUD KOTTA's elastic provisioning model can reduce costs by up to 16x when compared with statically provisioned models.

show abstract

The Globus Galaxies platform: delivering science gateways as a service

Cited by 45 publications

References 21 publications

Optimizing computational resource management for the scientific gateways ecosystems based on the service‐oriented paradigm

Optimizing computational resource management for the scientific gateways ecosystems based on the service‐oriented paradigm

Globus Nexus: A Platform-as-a-Service provider of research identity, profile, and group management

Cloud Kotta: Enabling secure and scalable data analytics in the cloud

Contact Info

Product

Resources

About