Suspending, migrating and resuming HPC virtual clusters

Anedda, Paolo; Leo, Simone; Manca, Simone; Gaggero, Massimo; Zanetti, Gianluigi

doi:10.1016/j.future.2010.05.007

Cited by 20 publications

(8 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…VCT [1] performs synchronized migration of a HPC virtual clusters running data-driven applications by reducing the amount of data transferred for their migration using compression. However, the main focus of this work is non-live migration of VMs and their disk images, when the VM memory and disk states are suspended to a file and resumed at a later time.…”

Section: Related Workmentioning

confidence: 99%

Traffic-Sensitive Live Migration of Virtual Machines

Deshpande

Keahey

2015

2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

View full text Add to dashboard Cite

In this paper we address the problem of network contention between the migration traffic and the Virtual Machine (VM) application traffic for the live migration of co-located Virtual Machines. When VMs are migrated with pre-copy, they run at the source host during the migration. Therefore the VM applications with predominantly outbound traffic contend with the outgoing migration traffic at the source host. Similarly, during post-copy migration, the VMs run at the destination host. Therefore the VM applications with predominantly inbound traffic contend with the incoming migration traffic at the destination host. Such contention increases the total migration time of the VMs and degrades the performance of the VM application. Here, we propose a traffic-sensitive live VM migration technique to reduce the contention of migration traffic with the VM application traffic. It uses a combination of pre-copy and post-copy techniques for the migration of the co-located VMs (those located on the same source host), instead of relying on any single pre-determined technique for the migration of all the VMs. We base the selection of migration techniques on the VMs' network traffic profiles so that the direction of migration traffic complements the direction of the most VM application traffic. We have implemented a prototype of traffic-sensitive migration on the KVM/QEMU platform. In the evaluation, we compare trafficsensitive migration against the approaches that use only pre-copy or only post-copy for VM migration. We show that our approach minimizes the network contention for migration, thus reducing the total migration time and the application degradation. 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing 978-1-4799-8006-2/15 $31.00

show abstract

Section: Related Workmentioning

confidence: 99%

Traffic-Sensitive Live Migration of Virtual Machines

Deshpande

Keahey

2015

2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

View full text Add to dashboard Cite

show abstract

“…Multi-cloud provisioning A great deal of research on dynamic resource allocation for physical and virtual machines and clusters of virtual machines [2] exists. The work of dynamic provisioning of resource in cloud computing may be classified into two categories.…”

Section: Multi-cloud Portabilitymentioning

confidence: 99%

soCloud: a service-oriented component-based PaaS for managing portability, provisioning, elasticity, and high availability across multiple clouds

2014

View full text Add to dashboard Cite

Multi-cloud computing is a promising paradigm to support very large scale world wide distributed applications. Multi-cloud computing is the usage of multiple, independent cloud environments, which assumed no priori agreement between cloud providers or third party. However, multi-cloud computing has to face several key challenges such as portability, provisioning, elasticity, and high availability. Developers will not only have to deploy applications to a specific cloud, but will also have to consider application portability from one cloud to another, and to deploy distributed applications spanning multiple clouds. This article presents soCloud a service-oriented component-based Platform as a Service for managing portability, elasticity, provisioning, and high availability across multiple clouds. soCloud is based on the OASIS Service Component Architecture standard in order to address portability. soCloud provides services for managing provisioning, elasticity, and high availability across multiple clouds. soCloud has been deployed and evaluated on top of ten existing cloud

show abstract

“…For example, a researcher can build the necessary environment closer to the data. Both [8], [9] discuss the fact that as the size of data sets grow, and if the construction of a VC can be performed in a straightforward manner, then it is possible to move the computing infrastructure to the data. This realization is in contrast to the traditional mechanism of moving the data to the location of a dedicated HPC cluster, such as a research university's supercomputer.…”

Section: Background and Related Workmentioning

confidence: 99%

Towards Reproducible eScience in the Cloud

Klinginsmith

Mahoui

2011

2011 IEEE Third International Conference on Cloud Computing Technology and Science

View full text Add to dashboard Cite

Whether it be data from ubiquitous devices such as sensors or data generated from telescopes or other laboratory instruments, technology apparent in many scientific disciplines is generating data at rates never witnessed before. Computational scientists are among the many who perform inductive experiments and analyses on these data with the goal of answering scientific questions. These computationally demanding experiments and analyses have become a common occurrence, resulting in a shift in scientific discovery, and thus leading to the term eScience.To perform eScience experiments and analysis at scale, one must have an infrastructure with enough computing power and storage space. The advent of cloud computing has allowed infrastructures and platforms to be created with theoretical limitless bounds, thus providing an attractive solution to this need.In this work, we create a reproducible process for the construction of eScience computing environments on top of cloud computing infrastructures. Our solution separates the construction of these environments into two distinct layers: (1) the infrastructure layer and (2) the software layer. We provide results of running our framework on two different computational clusters within two separate cloud computing environments to demonstrate that our framework can facilitate the replication or extension of an eScience experiment.

show abstract

Suspending, migrating and resuming HPC virtual clusters

Cited by 20 publications

References 21 publications

Traffic-Sensitive Live Migration of Virtual Machines

Traffic-Sensitive Live Migration of Virtual Machines

soCloud: a service-oriented component-based PaaS for managing portability, provisioning, elasticity, and high availability across multiple clouds

Towards Reproducible eScience in the Cloud

Contact Info

Product

Resources

About