High performance virtual machine migration with RDMA over modern interconnects

Huang, Wei; Gao, Qi; Liu, Jiuxing; Panda, Dhabaleswar K.

doi:10.1109/clustr.2007.4629212

Cited by 109 publications

(48 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Work has been done to optimize migration within the LAN by exploiting fast interconnects that support remote memory access technology [17]. Jin et al have proposed using memory compression algorithms to optimize migrations [19].…”

Section: Related Workmentioning

confidence: 99%

CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines

Wood

Ramakrishnan

Shenoy

et al. 2015

IEEE/ACM Trans. Networking

143

142

View full text Add to dashboard Cite

Virtual machine technology and the ease with which VMs can be migrated within the LAN, has changed the scope of resource management from allocating resources on a single server to manipulating pools of resources within a data center. We expect WAN migration of virtual machines to likewise transform the scope of provisioning compute resources from a single data center to multiple data centers spread across the country or around the world. In this paper we present the CloudNet architecure as a cloud framework consisting of cloud computing platforms linked with a VPN based network infrastructure to provide seamless and secure connectivity between enterprise and cloud data center sites. To realize our vision of efficiently pooling geographically distributed data center resources, CloudNet provides optimized support for live WAN migration of virtual machines. Specifically, we present a set of optimizations that minimize the cost of transferring storage and virtual machine memory during migrations over low bandwidth and high latency Internet links. We evaluate our system on an operational cloud platform distributed across the continental US. During simultaneous migrations of four VMs between data centers in Texas and Illinois, CloudNet's optimizations reduce memory migration time by 65% and lower bandwidth consumption for the storage and memory transfer by 19GB, a 50% reduction.

show abstract

Section: Related Workmentioning

confidence: 99%

CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines

Wood

Ramakrishnan

Shenoy

et al. 2015

IEEE/ACM Trans. Networking

143

142

View full text Add to dashboard Cite

show abstract

“…Separate work has demonstrated that compression can reduce migration time down to seven seconds [45] and RDMA on a 10Gbps network can reduce it further to two seconds [27]. Simultaneous migrations and the congestion of the network by workload traffic will also affect the migration time.…”

Section: Discussionmentioning

confidence: 99%

Using Network Knowledge to Improve Workload Performance in Virtualized Data Centers

Erickson

Heller

McKeown

et al. 2014

2014 IEEE International Conference on Cloud Engineering

View full text Add to dashboard Cite

Abstract-The scale and expense of modern data centers motivates running them as efficiently as possible. This paper explores how virtualized data center performance can be improved when network traffic and topology data informs VM placement. Our practical heuristics, tested on network-heavy, scale-out workloads in an 80 server cluster, improve overall performance by up to 70% compared to random placement in a multi-tenant configuration.

show abstract

“…• We extend previous studies of migration performance [7], [15] to quantify the impact of: i) the monitoring mechanism for dirty pages; ii) the memory and the network contention; and iii) the parallel programming model and the application data set.…”

Section: Introductionmentioning

confidence: 99%

Optimized pre-copy live migration for memory intensive applications

Ibrahim

Hofmeyr

Iancu

et al. 2011

Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis

View full text Add to dashboard Cite

Abstract-Live migration is a widely used technique for resource consolidation and fault tolerance. KVM and Xen use iterative pre-copy approaches which work well in practice for commercial applications. In this paper, we study pre-copy live migration of MPI and OpenMP scientific applications running on KVM and present a detailed performance analysis of the migration process. We show that due to a high rate of memory changes, the current KVM rate control and target downtime heuristics do not cope well with HPC applications: statically choosing rate limits and downtimes is infeasible and current mechanisms sometimes provide sub-optimal performance. We present a novel on-line algorithm able to provide minimal downtime and minimal impact on end-to-end application performance. At the core of this algorithm is controlling migration based on the application memory rate of change.

show abstract

High performance virtual machine migration with RDMA over modern interconnects

Cited by 109 publications

References 11 publications

CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines

CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines

Using Network Knowledge to Improve Workload Performance in Virtualized Data Centers

Optimized pre-copy live migration for memory intensive applications

Contact Info

Product

Resources

About