The ANL/IBM SP scheduling system

Lifka, David

doi:10.1007/3-540-60153-8_35

Cited by 369 publications

(223 citation statements)

References 1 publication

Supporting

Mentioning

217

Contrasting

Unclassified

Order By: Relevance

“…The exact queueing algorithm is EASY backfilling [16] with the modification that large jobs are always moved ahead of small ones upon entering the queue.…”

Section: Prototype Symbiotic Schedulermentioning

confidence: 99%

Symbiotic Space-Sharing on SDSC’s DataStar System

Weinberg

Snavely

2007

Job Scheduling Strategies for Parallel Processing

View full text Add to dashboard Cite

Abstract.Using a large HPC platform, we investigate the effectiveness of "symbiotic space-sharing", a technique that improves system throughput by executing parallel applications in combinations and configurations that alleviate pressure on shared resources. We demonstrate that relevant benchmarks commonly suffer a 10-60% penalty in runtime efficiency due to memory resource bottlenecks and up to several orders of magnitude for I/O. We show that this penalty can be often mitigated, and sometimes virtually eliminated, by symbiotic space-sharing techniques and deploy a prototype scheduler that leverages these findings to improve system throughput by 20%.

show abstract

“…The exact queueing algorithm is EASY backfilling [16] with the modification that large jobs are always moved ahead of small ones upon entering the queue.…”

Section: Prototype Symbiotic Schedulermentioning

confidence: 99%

Symbiotic Space-Sharing on SDSC’s DataStar System

Weinberg

Snavely

2007

Job Scheduling Strategies for Parallel Processing

View full text Add to dashboard Cite

show abstract

“…Such systems often require their users to provide estimates of job runtimes. These estimates are used by the system scheduler to plan ahead and to decide when to run each job [442,506]. The naive expectation is that users would be motivated to provide accurate estimates in order to facilitate better system performance.…”

Section: Runtime Estimatesmentioning

confidence: 99%

Workload Modeling for Computer Systems Performance Evaluation

Feitelson

2015

191

131

View full text Add to dashboard Cite

Reliable performance evaluations require the use of representative workloads. This is no easy task since modern computer systems and their workloads are complex, with many interrelated attributes and complicated structures. Experts often use sophisticated mathematics to analyze and describe workload models, making these models difficult for practitioners to grasp. This book aims to close this gap by emphasizing the intuition and the reasoning behind the definitions and derivations related to the workload models. It provides numerous examples from real production systems, with hundreds of graphs. Using this book, readers will be able to analyze collected workload data and clean it if necessary, derive statistical models that include skewed marginal distributions and correlations, and consider the need for generative models and feedback from the system. The descriptive statistics techniques covered are also useful for other domains.

show abstract

“…The local resource system usually optimizes the reservation details, e.g. by using a backfilling algorithm [15]. The result are fixed start-and end-times for the job.…”

Section: The Architecture Of Calanamentioning

confidence: 99%

Agent-Based Grid Scheduling with Calana

Dalheimer

Pfreundt

Merz

2006

Parallel Processing and Applied Mathematics

View full text Add to dashboard Cite

Abstract. Grid resource allocation is a complex task that is usually solved by systems relying on a centralized information system. In order to create a lightweight scheduling system, we investigated the potential of auctions for resource allocation. Each resource provider runs an agent bidding on the execution of software with respect to local restrictions. This way, the information system becomes obsolete. In addition, each provider can implement different bidding strategies in order to reflect his preferences.

show abstract

The ANL/IBM SP scheduling system

Abstract: 2/1/95 A bstract

Cited by 369 publications

References 1 publication

Symbiotic Space-Sharing on SDSC’s DataStar System

Symbiotic Space-Sharing on SDSC’s DataStar System

Workload Modeling for Computer Systems Performance Evaluation

Agent-Based Grid Scheduling with Calana

Contact Info

Product

Resources

About