Improving Energy-Efficiency of Grid Computing Clusters

Niemi, Tapio; Kommeri, Jukka; Happonen, Kalle; Klem, J.; Hameri, Ari‐Pekka

doi:10.1007/978-3-642-01671-4_11

Cited by 10 publications

(8 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…First we tested how the number of virtual machines affect throughput and energy efficiency of the virtualization host by running several virtual machines with one job each. In our earlier studies we have noticed that the commonly used one job per CPU core does not give the best performance or energy efficiency (Niemi et al, 2009b;Niemi et al, 2009a). Here we tested how it applies to virtualized environments.…”

Section: Physics Testsmentioning

confidence: 99%

Study of Virtualization Energy-efficiency in High-energy Physics Computing

Niemi¹,

Niinimäki²,

Kommeri³

2012

Proceedings of the Sixth International Symposium on E-Health Services and Technologies and the Third International Conference O

View full text Add to dashboard Cite

Modern multi-core servers are able to run growing amount of physics analysis tasks. As the count of CPU cores keep growing, a need for sharing a single server among several analysis tasks becomes more difficult. The need for varying analysis environments increase the complexity of an computing node software collection. In this paper we study how virtual machines should be deployed and loaded when running high-energy physics analysis applications to achieve high throughput and minimal energy consumption. We build a test environment using a realistic data analysis software and performed a large set of test runs. We used both 4 core single processor and two processor 12 core servers to evaluate bottlenecks of physics analysis software.Our results indicate that both throughput and energy efficiency strongly depend on how many virtual machines (VM) are run in a computing node and how many analysis applications are processed in parallel in a VM: It is more efficient to have less VMs with more parallel applications than one application in each VM. Thus, we suggest that jobs of the same user running in the same environment should be combined to the same VMs instead of running each job in a different VM.

show abstract

Section: Physics Testsmentioning

confidence: 99%

Study of Virtualization Energy-efficiency in High-energy Physics Computing

Niemi¹,

Niinimäki²,

Kommeri³

2012

Proceedings of the Sixth International Symposium on E-Health Services and Technologies and the Third International Conference O

View full text Add to dashboard Cite

show abstract

“…Niemi et al [29] demonstrated that running multiple jobs on the same node within a highperformance cluster was more energy efficient. We expect such to be the same here for our work.…”

Section: Energy Efficient High Throughput Computingmentioning

confidence: 99%

HTC‐Sim: a trace‐driven simulation framework for energy consumption in high‐throughput computing systems

Forshaw¹,

McGough²,

Thomas³

2016

Concurrency and Computation

View full text Add to dashboard Cite

SUMMARYHigh Throughput Computing (HTC) is a powerful paradigm allowing vast quantities of independent work to be performed simultaneously across many loosely coupled computers. These systems often exploit the idle time available on computers provisioned for other purposes -volunteer computing. However, until recently, little evaluation has been performed on the energy impact of HTC. Many organisations now seek to minimise energy consumption across their IT infrastructure. However, it is unclear how this will affect the usability of HTC systems especially when exploiting volunteer computers. We present here HTC-Sim, a simulation system which allows the evaluation of different energy reduction policies across an HTC system. We model systems which are comprised of both collections of computational resources dedicated to HTC work and resources provided through volunteer computing -a Desktop Grid. We demonstrate that our simulation software scales linearly with increasing HTC workload. We go further to evaluate a number of resource selection policies in terms of the overheads / slowdown incurred, and the energy impact on the HTC system.

show abstract

“…Minartz et al [12] explore energy saving through the dynamic provisioning of resources within a high performance computing cluster, while Niemi et al [13] demonstrate energy savings through the consolidation of multiple jobs onto the same hardware. Ponciano et al evaluate strategies for energy-aware resource provisioning and job allocation within opportunistic grids [14].…”

Section: B Energy Efficient High Throughput Computingmentioning

confidence: 99%

Trace-Driven Simulation for Energy Consumption in High Throughput Computing Systems

Forshaw

Thomas

McGough

2014

2014 IEEE/ACM 18th International Symposium on Distributed Simulation and Real Time Applications

View full text Add to dashboard Cite

any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Additional information:Use policyThe full-text may be used and/or reproduced, and given to third parties in any format or medium, without prior permission or charge, for personal research or study, educational, or not-for-prot purposes provided that:• a full bibliographic reference is made to the original source • a link is made to the metadata record in DRO • the full-text is not changed in any way The full-text must not be sold in any format or medium without the formal permission of the copyright holders.Please consult the full DRO policy for further details. Abstract-High Throughput Computing (HTC) is a powerful paradigm allowing vast quantities of independent work to be performed simultaneously. However, until recently little evaluation has been performed on the energy impact of HTC. Many organisations now seek to minimise energy consumption across their IT infrastructure though it is unclear how this will affect the usability of HTC systems. We present here HTC-Sim, a simulation system which allows the evaluation of different energy reduction policies across an HTC system comprising a collection of computational resources dedicated to HTC work and resources provided through cycle scavenging -a Desktop Grid. We demonstrate that our simulation software scales linearly with increasing HTC workload.

show abstract

Improving Energy-Efficiency of Grid Computing Clusters

Cited by 10 publications

References 14 publications

Study of Virtualization Energy-efficiency in High-energy Physics Computing

Study of Virtualization Energy-efficiency in High-energy Physics Computing

HTC‐Sim: a trace‐driven simulation framework for energy consumption in high‐throughput computing systems

Trace-Driven Simulation for Energy Consumption in High Throughput Computing Systems

Contact Info

Product

Resources

About