SAGA BigJob: An Extensible and Interoperable Pilot-Job Abstraction for Distributed Applications and Systems

Luckow, André; Łaciński, Łukasz; Jha, Shantenu

doi:10.1109/ccgrid.2010.91

Cited by 65 publications

(58 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [16], Klein and Perez propose to improve performance of distributed applications by prioritizing previously submitted applications. In [23], Luckow et al propose the SAGA big-job abstraction to acquire cloud resources, deploy virtual machines and submit grid jobs to the booked resources. SAGA bigjob replaces pilot-jobs which fail to acquire resources from clouds.…”

Section: Related Workmentioning

confidence: 99%

“…These approaches also fail to include fines into their pricing model. Other approaches deal with QoS assurance but describe neither details about SLA nor billing concerns [15], [13], [16], [23]. Finally, other approaches focus on translating SLA to low-level configurations [12], [30], [22] but they neither specify how QoS can be ensured nor apply QoS under a pricing model.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

An Integrated Approach for Specifying and Enforcing SLAs for Cloud Services

Freitas

Parlavantzas

Pazat

2012

2012 IEEE Fifth International Conference on Cloud Computing

View full text Add to dashboard Cite

Abstract-Cloud computing has evolved from the provisioning of virtual machines to the provisioning of complex services, delivered to customers under the terms of Service-Level Agreements (SLAs). SLAs specify the Quality of Service (QoS) that should be provided to customers as well as the billing model. A main concern for cloud service providers is to maintain the agreed SLA terms in order to avoid losses and penalties. Maintaining the SLA in turn requires translating the QoS to configurations of low-level mechanisms, able to enforce the agreed terms. Current systems provide no integrated support for SLA specification, translation, and enforcement. In this paper, we propose an approach for specifying and enforcing SLAs for cloud service providers. The approach covers the creation of SLA templates under a billing model, the design of performance and faulttolerance QoS assurance mechanisms as well as the translation of QoS to appropriate configurations of those mechanisms. We demonstrate the feasibility of our approach by using the Qu4DS framework for PaaS cloud providers. Moreover, we evaluate the impact of failures on the provider profit. The experiments were carried out on the Grid5000 testbed and demonstrate the effectiveness of ensuring fault tolerance in different scenarios.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

An Integrated Approach for Specifying and Enforcing SLAs for Cloud Services

Freitas

Parlavantzas

Pazat

2012

2012 IEEE Fifth International Conference on Cloud Computing

View full text Add to dashboard Cite

show abstract

“…SAGA was designed to be independent of the details of the underlying infrastructure. We have previously demonstrated the usage of the SAGA-based pilot-job framework [4]-called the big-job-to run RE simulations across multiple, heterogeneous, distributed grid and cloud infrastructures [5].…”

Section: Replica-exchange Frameworkmentioning

confidence: 99%

“…The RE framework uses a flexible pilot-job implementation-Simple API for Grid Applications (SAGA) BigJob [4]-to support the efficient execution of ensembles. The pilot-job provides a container for a number of sub-jobs (replicas), which can then be directly and concurrently executed via the pilot-job, and thus circumventing the need for replicas to individually wait for resources to become available.…”

Section: Introductionmentioning

confidence: 99%

Efficient large-scale replica-exchange simulations on production infrastructure

Thota

Luckow

Jha

2011

Phil. Trans. R. Soc. A.

Self Cite

View full text Add to dashboard Cite

Replica-exchange (RE) algorithms are used to understand physical phenomena-ranging from protein folding dynamics to binding affinity calculations. They represent a class of algorithms that involve a large number of loosely coupled ensembles, and are thus amenable to using distributed resources. We develop a framework for RE that supports different replica pairing (synchronous versus asynchronous) and exchange coordination mechanisms (centralized versus decentralized) and which can use a range of production cyberinfrastructures concurrently. We characterize the performance of both RE algorithms at an unprecedented number of cores employed-the number of replicas and the typical number of cores per replica-on the production distributed infrastructure. We find that the asynchronous algorithms outperform the synchronous algorithms, even though details of the specific implementations are important determinants of performance.

show abstract

“…ADAMS is built upon Simple API for Grid Applications (SAGA) and its pilot-job abstraction SAGA-BigJob [50]. Although distributed federated HPC grids have been traditionally the primary computing resources employed, the underlying technology has been employed on a range of cloud systems [51] Therefore, from a cyber-infrastructure perspective this work represents an important extension by demonstrating the capability of the SAGA-BigJob to support heterogenous & ordered phases of a scientific problem. However, the critical contribution of this work is the application of advances in cyberinfrastructure to make progress towards the general purpose solution of well-defined biological problem for a wide-range of input sizes.…”

Section: Introductionmentioning

confidence: 99%

Exploring the RNA folding energy landscape using scalable distributed cyberinfrastructure

Kim

Huang

Maddineni

et al. 2010

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Self Cite

View full text Add to dashboard Cite

The increasing significance of RNAs in transcriptional or post-transcriptional gene regulation processes has generated considerable interest towards the prediction of RNA folding and its sensitivity to environmental factors. We use Boltzmann-weighted sampling to generate RNA secondary structures, which are used to characterize the energy landscape, via the distributions of energies and base-pair distances. Depending upon the length of an RNA, the number of sequences investigated, and the sample size of generated structures -generating and analyzing sufficient samples can be computationally challenging. We introduce and develop a lightweight and extensible runtime environment that is effective across a range of RNA sizes and other parameters, as well as over a range of infrastructure -from traditional HPC grids to clouds, without requiring any changes at the application or user level. The Adaptive Distributed Application Management System (ADAMS) is built upon an extensbile and interoperable pilot-job and supports the concurrent execution of a broad range of task sizes across a range of infrastructure. We use ADAMS to investigate the folding energy landscape for two RNA systems of different sizes: a set of S-adenosyl methionine (SAM) binding RNA sequences known as SAM-I riboswitches and the S gene of the Bovine Corona Virus (BCoV) RNA genome that comprises 4092 nucleotides. Results of the energy and base-pair distance distributions suggest different energy landscapes, implying different folding dynamics. With obtained results, we demonstrated the possibility of utilizing this protocol to explore microscopic origins for reported sequence-dependent variation of binding affinity and gene expression in the two RNA systems.

show abstract

SAGA BigJob: An Extensible and Interoperable Pilot-Job Abstraction for Distributed Applications and Systems

Cited by 65 publications

References 14 publications

An Integrated Approach for Specifying and Enforcing SLAs for Cloud Services

An Integrated Approach for Specifying and Enforcing SLAs for Cloud Services

Efficient large-scale replica-exchange simulations on production infrastructure

Exploring the RNA folding energy landscape using scalable distributed cyberinfrastructure

Contact Info

Product

Resources

About