Partition-Aware Routing to Improve Network Isolation in Infiniband Based Multi-tenant Clusters

Zahid, Feroz; Gran, Ernst Gunnar; Bogdański, Bartosz; Johnsen, Bjorn Dag; Skeie, Tor

doi:10.1109/ccgrid.2015.96

Cited by 9 publications

(17 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[2][3][4]25 Others have focused in cloud tenant isolation in the link level, 26,27 whereas Ranadive, in his doctoral dissertation, dedicated his efforts on virtualized resource management with lossless networks. [2][3][4]25 Others have focused in cloud tenant isolation in the link level, 26,27 whereas Ranadive, in his doctoral dissertation, dedicated his efforts on virtualized resource management with lossless networks.…”

Section: Related Workmentioning

confidence: 99%

“…In addition, in the presence of multiple tenant groups in the network, techniques like tenant-aware routing can be integrated with the proposed routing scheme to provide network-wide isolation among tenants 26,27. The value of the weight reflects the proportion of the vSwitch to leaf switch link capacity allocated to a VM.…”

mentioning

confidence: 99%

“…The scheme can be combined with per VM rate limits enforcement on each vSwitch to ensure that a VM is not allowed to exceed its allocated capacity. In addition, in the presence of multiple tenant groups in the network, techniques like tenant-aware routing can be integrated with the proposed routing scheme to provide network-wide isolation among tenants 26,27.…”

mentioning

confidence: 99%

See 2 more Smart Citations

Efficient routing and reconfiguration in virtualized HPC environments with vSwitch‐enabled lossless networks

Tasoulas

Zahid

Gran

et al. 2018

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

To meet the demands of communication-intensive workloads in the cloud, virtual machines (VMs) should utilize low overhead network communication paradigms. In general, such paradigms enable VMs to directly communicate with the hardware by means of a passthrough technology like Single-Root I/O Virtualization (SR-IOV). However, when passthrough-based virtualization is coupled with lossless interconnection networks, live migrations introduce scalability challenges due to the substantial network reconfiguration overhead. With these challenges in mind, we proposed a virtual switch (vSwitch) SR-IOV architecture for InfiniBand in our previous work titled "Towards the InfiniBand SR-IOV vSwitch Architecture". In this paper, we first suggest solutions to rectify the space-domain scalability issues that are present in vSwitch-enabled subnets as a result of the VMs using dedicated layer-two addresses. Then, we discuss routing strategies for virtualized environments using vSwitches and present a routing algorithm for Fat-Trees. We also present a reconfiguration method that minimizes imposed reconfiguration overhead on Fat-Trees.We perform an extensive evaluation of our prototype algorithms, and as vSwitch-enabled hardware does not yet exist, we deduce from empirical observations by emulating vSwitches with existing hardware, as well as large-scale simulations. Our results show significant reduction in the reconfiguration times as route recalculations can be eliminated, and for certain scenarios, the number of reconfiguration subnet management packets sent to switches is reduced from several hundred thousand down to a single one without degrading the routing quality.

show abstract

Section: Related Workmentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

Efficient routing and reconfiguration in virtualized HPC environments with vSwitch‐enabled lossless networks

Tasoulas

Zahid

Gran

et al. 2018

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

show abstract

“…This may result in degraded load-balancing. In Paper II [148], we proposed a partition-aware fat-tree routing algorithm, pFTree. The pFTree routing algorithm utilizes a multifold mechanism to provide performance isolation among partitions belonging to different tenant groups in a subnet.…”

Section: Paper Ii: Partition-aware Routing To Improve Network Isolatimentioning

confidence: 99%

A Weighted Fat-Tree Routing Algorithm for Efficient Load-Balancing in Infini Band Enterprise Clusters

Zahid

Gran

Bogdański

et al. 2015

2015 23rd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing

Self Cite

View full text Add to dashboard Cite

“…Others have focused on cloud tenant isolation at the link level [121,122] while Ranadive, in his doctoral dissertation dedicated his efforts on virtualized resource management with lossless networks [123]. In particular, because the hypervisor is usually bypassed with high performance network technologies and SR-IOV as we explained in the first paragraph of this section, it is not as simple to monitor the resource usage and performance of the VMs.…”

Section: Infiniband Sr-iov and Live Migrations In The Cloudmentioning

confidence: 99%

A Novel Query Caching Scheme for Dynamic InfiniBand Subnets

Tasoulas

Gran

Johnsen³

et al. 2015

2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

Self Cite

View full text Add to dashboard Cite

The advent of the Internet of Things, sensor and social networks, to mention just a few examples, all contribute towards the solid establishment of the Big Data era. High Performance Computing (HPC) becomes necessary for the efficient processing of the massive amounts of data our society generates, and cloud computing is a critical component to deliver this processing power to a broader audience that cannot afford to acquire and maintain such complex computing systems themselves. However, HPC specific technology and performance is not yet apt to be delivered efficiently over highly flexible and dynamic environments, as typically are the virtualized cloud infrastructures.In this thesis, we address challenges that arise in high performance dynamic cloud environments, that are equipped with HPC specific technology, in the context of networking and virtualization. We use InfiniBand, a high performance lossless interconnection network as the basis of our research, and first show that lossless networks pose prime challenges when the nature of the infrastructure is very dynamic, i.e. exhibits continuous changes. Then we propose a network I/O virtualization architecture, the InfiniBand vSwitch architecture, that can make lossless network technologies more favorable in the cloud. Moreover, we propose different network reconfiguration methods to enable performance-driven reconfigurations in very large network topologies that are commonly found in data centers. Performance-driven reconfigurations are frequently needed to adapt to unpredictable workload changes resulting from the shared and on-demand nature of a cloud platform, or when cloud providers employ live migration of virtual machines to optimize the resource usage of their infrastructure. Last but not least, we propose a new Quality-of-Service metric, called delay, to capture the directly observable service degradation in consolidated cloud environments. We suggest that the delay can be used as a direct service level agreement metric between cloud providers and cloud tenants. AcknowledgementsFirst, I would like to express my gratitude to my three supervisors; Ernst Gunnar Gran, Tor Skeie and Kyrre Begnum. Without their positiveness, supervision, suggestions and encouragement, my PhD journey would not have been so fruitful and enjoyable during both the good and hard times. Then I would like to thank Bjørn Dag Johnsen from Oracle Norway, our closest collaborate in the ERAC project, the project that mainly funded this thesis, for his enthusiastic attitude and participation in the important discussions that shaped the direction of my work and introduced industrial relevance. My appreciation goes as well to Feroz Zahid for being the most easygoing colleague whom I could imagine sharing office with, and a brilliant and ambitious associate, and Sven-Arne Reinemo for his supervision during my early days.A special thank you must be directed to Hårek Haugerud, Anis Yazidi, Hugo Lewi Hammer, Laurence Marie Anna Habib and the whole NETSYS group at the Oslo and Akershus...

show abstract

Partition-Aware Routing to Improve Network Isolation in Infiniband Based Multi-tenant Clusters

Cited by 9 publications

References 17 publications

Efficient routing and reconfiguration in virtualized HPC environments with vSwitch‐enabled lossless networks

Efficient routing and reconfiguration in virtualized HPC environments with vSwitch‐enabled lossless networks

A Weighted Fat-Tree Routing Algorithm for Efficient Load-Balancing in Infini Band Enterprise Clusters

A Novel Query Caching Scheme for Dynamic InfiniBand Subnets

Contact Info

Product

Resources

About