Function Memory Optimization for Heterogeneous Serverless Platforms with CPU Time Accounting

Cordingly, Robert; Xu, Sonia; Lloyd, Wes

doi:10.1109/ic2e55432.2022.00019

Cited by 8 publications

(2 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It estimates the execution time of FaaS functions through Linux CPU time accounting principles and multiple regression. This tool is further employed by in the same authors’ follow-up work [ 11 ] to identify appropriate memory configurations, leading to a reduction both in execution time and cost.

DNN [ 21 ] is a cost-efficient function resource provisioning framework that selects a suitable resource configuration (i.e., function number and memory size) for serverless functions by providing predictable performance for serverless Distributed Deep Neural Network (DDNN) training workloads.…”

Section: Related Workmentioning

confidence: 99%

“…The existing solutions for configuring resources in serverless applications can be classified into two principal categories. The first category entails modeling performance based on historical datasets of functions, which can be used to predict the execution time of functions under diverse configurations, thereby facilitating the selection of an appropriate configuration plan [ 9 , 10 , 11 ]. However, this category of solutions is limited due to its reliance on the availability of extensive historical data, and fails to address data scarcity when new functions are submitted.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

FireFace: Leveraging Internal Function Features for Configuration of Functions on Serverless Edge Platforms

Li,

Zhang,

Lin

et al. 2023

Sensors

View full text Add to dashboard Cite

The emerging serverless computing has become a captivating paradigm for deploying cloud applications, alleviating developers’ concerns about infrastructure resource management by configuring necessary parameters such as latency and memory constraints. Existing resource configuration solutions for cloud-based serverless applications can be broadly classified into modeling based on historical data or a combination of sparse measurements and interpolation/modeling. In pursuit of service response and conserving network bandwidth, platforms have progressively expanded from the traditional cloud to the edge. Compared to cloud platforms, serverless edge platforms often lead to more running overhead due to their limited resources, resulting in undesirable financial costs for developers when using the existing solutions. Meanwhile, it is extremely challenging to handle the heterogeneity of edge platforms, characterized by distinct pricing owing to their varying resource preferences. To tackle these challenges, we propose an adaptive and efficient approach called FireFace, consisting of prediction and decision modules. The prediction module extracts the internal features of all functions within the serverless application and uses this information to predict the execution time of the functions under specific configuration schemes. Based on the prediction module, the decision module analyzes the environment information and uses the Adaptive Particle Swarm Optimization algorithm and Genetic Algorithm Operator (APSO-GA) algorithm to select the most suitable configuration plan for each function, including CPU, memory, and edge platforms. In this way, it is possible to effectively minimize the financial overhead while fulfilling the Service Level Objectives (SLOs). Extensive experimental results show that our prediction model obtains optimal results under all three metrics, and the prediction error rate for real-world serverless applications is in the range of 4.25∼9.51%. Our approach can find the optimal resource configuration scheme for each application, which saves 7.2∼44.8% on average compared to other classic algorithms. Moreover, FireFace exhibits rapid adaptability, efficiently adjusting resource allocation schemes in response to dynamic environments.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

FireFace: Leveraging Internal Function Features for Configuration of Functions on Serverless Edge Platforms

Li,

Zhang,

Lin

et al. 2023

Sensors

View full text Add to dashboard Cite

show abstract

Memory orchestration mechanisms in serverless computing: a taxonomy, review and future directions

Shojaee rad,

Ghobaei-Arani,

Ahsan

2024

Cluster Comput

View full text Add to dashboard Cite

Self-Provisioning Infrastructures for the Next Generation Serverless Computing

Nastic

2024

SN COMPUT. SCI.

View full text Add to dashboard Cite

Serverless computing has ushered in a transformative paradigm, with a promise to alleviate developers from the intricacies of infrastructure management. However, current serverless platforms predominantly offer only serverless compute capabilities. As a consequence, the application developers are once again tasked to explicitly provision and manage the backend services (BaaS), such as object stores or API gateways, the infrastructure, and the configuration models. This violates the main promise of serverless computing and erases much of the practical benefits of the serverless paradigm. It also introduces the challenges of managing the application execution environment, which includes maintaining provisioning and deployment scripts, configuring and managing access permissions, and scaling the services during runtime. To address these challenges, in this paper we introduce a novel paradigm for the next generation of serverless computing, called self-provisioning infrastructure. The self-provisioning infrastructure is an infrastructure that is capable to automatically and autonomously (with zero-configuration and zero-touch) provision serverless functions, their infrastructure, and their supporting BaaS services. To achieve this vision, we introduce novel design principles, models, and mechanisms that are formalized via novel programming, function, and system models. With this novel paradigm, we intend to fortify the core design principles of serverless computing but also extend them to the entire application execution environment. By doing so, we aim to enable the next-generation serverless computing in the Edge-Cloud continuum.

show abstract

Function Memory Optimization for Heterogeneous Serverless Platforms with CPU Time Accounting

Cited by 8 publications

References 20 publications

FireFace: Leveraging Internal Function Features for Configuration of Functions on Serverless Edge Platforms

FireFace: Leveraging Internal Function Features for Configuration of Functions on Serverless Edge Platforms

Memory orchestration mechanisms in serverless computing: a taxonomy, review and future directions

Self-Provisioning Infrastructures for the Next Generation Serverless Computing

Contact Info

Product

Resources

About