Multi agent deep reinforcement learning for resource allocation in container‐based clouds environments

Abstract

Virtualization enables the deployment of several virtual servers on the same physical layer, critical component of the cloud. As cloud services advance, more apps that use repositories are developed, which adds to the overburden. Containers have evolved into the most reliable and lightweight virtualization technology for cloud services thanks to their flexible sorting, mobility, and scalability. In container‐based clouds, containers can potentially cut data centre energy usage more than virtual machines (VMs) do. Containers are less energy intensive than VMs. Resource allocation is the most prevalent method in cloud systems. However, resource allocation in container‐based clouds (RAC) is innovative and complicated due to its two‐level architecture. This includes the pairing of virtual machines and physical computers with containers. In cloud container services, planner components are essential. This lowers expenses while improving the performance and variety of workloads using cloud resources. The cloud infrastructure resource allocation framework is gaining popularity since it is energy‐efficient and focuses on cloud data management to maximize income and minimize costs. In this paper, we proposed a deep learning‐based architecture capable of achieving high data centre energy efficiency and preventing Service Level Agreement (SLA) violations from deploying green cloud resources. This research describes a hybrid optimum and multi‐agent deep reinforcement learning (MADRL) technique for dynamic task scheduling (DTS) in a container cloud environment. The MADRL‐DTS model for the RAC problem considers VM overheads, VM types, and an affinity restriction. Then, to address the RAC issue, we develop a DTS hyper‐heuristic technique. MADRL‐RAC may give allocation rules by recognizing workload trends and VM types from previous workload traces. Compared to modern procedures, the results demonstrate a significant reduction in energy consumption. The evaluation for energy‐efficient resource allocation is tested in several virtualized environments to get a high power usage effectiveness and CPU usage.

A Comprehensive Survey on Sustainable Resource Management in Cloud Computing Environments

“…The cloud resource manager applies various machine learning algorithms like, Reinforcement Learning [130]- [141], Deep Reinforcement Learning [142]- [154], Multi-agent based Reinforcement Learning [155]- [168], etc. for multiple operations and objectives such as optimized task scheduling and VM allocation, etc.…”