Towards energy-aware scheduling in data centers using machine learning

Abstract

As energy-related costs have become a major economical factor for IT infrastructures and data-centers, companies and the research community are being challenged to find better and more efficient power-aware resource management strategies. There is a growing interest in "Green" IT and there is still a big gap in this area to be covered.In order to obtain an energy-efficient data center, we propose a framework that provides an intelligent consolidation methodology using different techniques such as turning on/off machines, power-aware consolidation algorithms, and machine learning techniques to deal with uncertain information while maximizing performance. For the machine learning approach, we use models learned from previous system behaviors in order to predict power consumption levels, CPU loads, and SLA timings, and improve scheduling decisions. Our framework is vertical, because it considers from watt consumption to workload features, and cross-disciplinary, as it uses a wide variety of techniques.We evaluate these techniques with a framework that covers the whole control cycle of a real scenario, using a simulation with representative heterogeneous workloads, and we measure the quality of the results according to a set of metrics focused toward our goals, besides traditional policies. The results obtained indicate that our approach is close to the optimal placement and behaves better when the level of uncertainty increases.

Maximizing the Energy Efficiency of Virtualized C-RAN via Optimizing the Number of Virtual Machines

“…The third method is based on machine learning or heuristics and is error acceptable as it is based on random distribution of the solution candidates. Also, it requires repeating the process of optimisation several times to guarantee the results, for example see [18]. Furthermore, this method is time consuming and costly on power.…”

Strategies for Increased Energy Awareness in Cloud Federations

“…They propose a pricing model using processor sharing for composite services in Clouds. Berral et al [12] present a framework to address energy efficiency using an intelligent consolidation methodology, which applies various techniques such as machine learning on scheduling algorithms to improve server workload predictions, power aware consolidation algorithms, and turning off spare servers and thereby saving energy in a data center. However, their approach is limited to a private datacenter, and does not consider hybrid Clouds with engineering approaches like federation.…”

An energy management system for cluster infrastructures

“…When CLUES finishes processing this request, the job is actually submitted to the resource manager (5), where it will be processed by the scheduler and finally sent to the cluster for execution (6). There are two more components that are called periodically by the CLUES scheduler: the hook system, that enables to perform user defined actions when an event happens (7), and the sensor system, that enables access to a set of environmental values to be stored in the scheduler (8).…”