Serverless High-Performance Computing over Cloud

Abstract

HPC clouds may provide fast access to fully configurable and dynamically scalable virtualized HPC clusters to address the complex and challenging computation and storage-intensive requirements. The complex environmental, software, and hardware requirements and dependencies on such systems make it challenging to carry out our large-scale simulations, prediction systems, and other data and compute-intensive workloads over the cloud. The article aims to present an architecture that enables HPC workloads to be serverless over the cloud (Shoc), one of the most critical cloud capabilities for HPC workloads. On one hand, Shoc utilizes the abstraction power of container technologies like Singularity and Docker, combined with the scheduling and resource management capabilities of Kubernetes. On the other hand, Shoc allows running any CPU-intensive and data-intensive workloads in the cloud without needing to manage HPC infrastructure, complex software, and hardware environment deployments.

Реалізація Технологій Для Розгортання Програм У Контейнері

“…Постановка проблеми. На даний час підприємства та організації пристосовуються до змін та забезпечують доступність своїх сервісів, залишаючись попереду в технологічних інноваціях [1]. Одним із ключових підходів для досягнення цих цілей є розгортання застосунків у хмарі, що є частиною процесу управління хмарними ресурсами хмарних обчислень [2].…”

Cloud-Based Self-Organizing UAV Swarm Simulation Platform

“…A serverless high-performance computing (HPC) cloud platform is used to load the swarm's HPC tasks to address the timely behavior of the swarm [19]. It is based on the container technology abstract force, such as Singularity and Docker, combined with the Kubernetes used for deploying and operating containerized applications.…”

Optimizing Build Time of Shoc Workloads

“…As discussed in an early work [1], the proposed architecture models a serverless approach to submitting high-performance workloads to cloud environments. The main aim of the design is to reduce the complexity of working with cloud environments so that the end user running a cloud job is aware of the algorithm.…”