Deep reinforcement learning for application scheduling in resource-constrained, multi-tenant serverless computing environments

Mampage, Anupama; Karunasekera, Shanika; Buyya, Rajkumar

doi:10.1016/j.future.2023.02.006

Cited by 7 publications

(1 citation statement)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This structure causes challenges such as resource contention and efficient resource management. Mampa et al [23] introduced an efficient function scheduling mechanism employing a DRL-based technique. They conducted performance tests in the Kubeless environment and the results showed noticeable improvements in response time and resource usage cost.…”

Section: Cold Start Latency Reduction (Lr)mentioning

confidence: 99%

ATOM: AI-Powered Sustainable Resource Management for Serverless Edge Computing Environments

Golec,

Gill,

Cuadrado

et al. 2023

IEEE Trans. Sustain. Comput.

View full text Add to dashboard Cite

Serverless edge computing decreases unnecessary resource usage on end devices with limited processing power and storage capacity. Despite its benefits, serverless edge computing's zero scalability is the major source of the cold start delay, which is yet unsolved. This latency is unacceptable for time-sensitive Internet of Things (IoT) applications like autonomous cars. Most existing approaches need containers to idle and use extra computing resources. Edge devices have fewer resources than cloud-based systems, requiring new sustainable solutions. Therefore, we propose an AI-powered, sustainable resource management framework called ATOM for serverless edge computing. ATOM utilizes a deep reinforcement learning model to predict exactly when cold start latency will happen. We create a cold start dataset using a heart disease risk scenario and deploy using Google Cloud Functions. To demonstrate the superiority of ATOM, its performance is compared with two different baselines, which use the warm-start containers and a two-layer adaptive approach. The experimental results showed that although the ATOM required more calculation time of 118.76 seconds, it performed better in predicting cold start than baseline models with an RMSE ratio of 148.76. Additionally, the energy consumption and CO 2 emission amount of these models are evaluated and compared for the training and prediction phases.

show abstract

Section: Cold Start Latency Reduction (Lr)mentioning

confidence: 99%

ATOM: AI-Powered Sustainable Resource Management for Serverless Edge Computing Environments

Golec,

Gill,

Cuadrado

et al. 2023

IEEE Trans. Sustain. Comput.

View full text Add to dashboard Cite

show abstract

A survey on the scheduling mechanisms in serverless computing: a taxonomy, challenges, and trends

Ghorbian,

Ghobaei-Arani,

Esmaeili

2024

Cluster Comput

View full text Add to dashboard Cite

Edge-computing-assisted intelligent processing of AI-generated image content

Wang,

Deng,

et al. 2024

J Real-Time Image Proc

View full text Add to dashboard Cite

Artificial intelligence-generated image content (AIGIC) is produced through the extraction of features and patterns from a vast image dataset, requiring substantial computational resources for training. This study aims to enhance image processing and response time on terminal devices by utilizing 1 edge computing technology to offload specific training tasks to edge nodes. Additionally, task offloading and resource allocation strategies are developed to effectively generate image content on terminal devices. Edge computing aims to execute computing tasks in close proximity to data sources; however, the computing resources of edge devices are limited. Therefore, the development of suitable resource allocation strategies for resource-constrained environments is crucial in edge computing research. Serverless computing, which heavily relies on container technology for program hosting, is recognized as one of the most 1

show abstract

Deep reinforcement learning for application scheduling in resource-constrained, multi-tenant serverless computing environments

Cited by 7 publications

References 42 publications

ATOM: AI-Powered Sustainable Resource Management for Serverless Edge Computing Environments

ATOM: AI-Powered Sustainable Resource Management for Serverless Edge Computing Environments

A survey on the scheduling mechanisms in serverless computing: a taxonomy, challenges, and trends

Edge-computing-assisted intelligent processing of AI-generated image content

Contact Info

Product

Resources

About