A large data processing algorithm for energy efficiency in a heterogeneous cluster

Wang, Lei; Ge, Weichun; Zhao, Li; Lei, Zhenjiang; Chen, Shuo

doi:10.1051/itmconf/20181703023

Cited by 1 publication

(1 citation statement)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Wang et al 51 present and algorithm to efficiently se-lect the ideal node utilization in a heterogeneous cluster for optimal energy efficiency when processing large data. Given that computing clusters are mainly comprised of heterogeneous nodes, the correct choice of nodes for a given task can reduce energy consumption by up to 60%.…”

Section: Related Workmentioning

confidence: 99%

Done Yet? A Critical Introspective of the Cloud Management Toolbox

Leznik

Volpert

Griesinger

et al. 2018

2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC)

View full text Add to dashboard Cite

With the rapid rise of the cloud computing paradigm, the manual maintenance and provisioning of the technological layers behind it, both in their hardware and virtualized form, became cumbersome and errorprone. This has opened up the need for automated capacity planning strategies in heterogeneous cloud computing environments. However, even with mechanisms to fully accommodate customers and fulfill servicelevel agreements, providers often tend to over-provision their hardware and virtual resources. A proliferation of unused capacity leads to higher energy costs, and correspondingly, the price for cloud technology services. Capacity planning algorithms rely on data collected from the utilized resources. Yet, the amount of data aggregated through the monitoring of hardware and virtual instances does not allow for a manual supervision, much less data analysis or a correlation and anomaly detection. Current data science advancements enable the assistance of efficient automation, scheduling and provisioning of cloud computing resources based on supervised and unsupervised machine learning techniques. In this work, we present the current state of the art in monitoring, storage, analysis and adaptation approaches for the data produced by cloud computing environments, to enable proactive, dynamic resource provisioning.

show abstract

Section: Related Workmentioning

confidence: 99%