Impact of Inter-application Contention in Current and Future HPC Systems

Jokanović, Ana; Rodríguez, Germán; Sancho, José Carlos; Labarta, Jesús

doi:10.1109/hoti.2010.25

Cited by 16 publications

(12 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Application variability. Several studies about the variability of cloud services and HPC application performance were presented by [4,5,24,[29][30][31]. They show significant variability for such applications, which strengthens the motivation for using LaaS.…”

Section: Related Workmentioning

confidence: 94%

Links as a Service (LaaS): Guaranteed Tenant Isolation in the Shared Cloud

Zahavi

Shpiner

Rottenstreich

et al. 2019

IEEE J. Select. Areas Commun.

View full text Add to dashboard Cite

The most demanding tenants of shared clouds require complete isolation from their neighbors, in order to guarantee that their application performance is not affected by other tenants. Unfortunately, while shared clouds can offer an option whereby tenants obtain dedicated servers, they do not offer any network provisioning service, which would shield these tenants from network interference.In this paper, we introduce Links as a Service (LaaS), a new abstraction for cloud service that provides isolation of network links. Each tenant gets an exclusive set of links forming a virtual fat-tree, and is guaranteed to receive the exact same bandwidth and delay as if it were alone in the shared cloud. Consequently, each tenant can use the forwarding method that best fits its application. Under simple assumptions, we derive theoretical conditions for enabling LaaS without capacity over-provisioning in fat-trees. New tenants are only admitted in the network when they can be allocated hosts and links that maintain these conditions. LaaS is implementable with common network gear, tested to scale to large networks and provides full tenant isolation at the worst cost of a 10% reduction in the cloud utilization.

show abstract

Section: Related Workmentioning

confidence: 94%

Links as a Service (LaaS): Guaranteed Tenant Isolation in the Shared Cloud

Zahavi

Shpiner

Rottenstreich

et al. 2019

IEEE J. Select. Areas Commun.

View full text Add to dashboard Cite

show abstract

“…The first option should be chosen when the node allocation for the target application is good enough according to (4 the second case, the target application is put on hold in the scheduler queue until the preferred node allocation is obtained, that is, the jobs currently running release needed nodes.…”

Section: Modelling the Performance Of Multiple Applications In A Sharmentioning

confidence: 99%

“…In [4], we evaluated the impact of several routing schemes on inter-aplication contention. The effect of interference between application can be reduced using certain routing schemes.…”

Section: Introductionmentioning

confidence: 99%

“…We have to be aware that the level of inter‐application contention is impacted by several other factors, such as routing, topology, Message Passing Interface (MPI) tasks ordering and relative starting time between the applications. In [4], we evaluated the impact of several routing schemes on inter‐aplication contention. The effect of interference between application can be reduced using certain routing schemes.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

On the trade‐off of mixing scientific applications on capacity high‐performance computing systems

Jokanović

Sancho

Rodríguez

et al. 2013

IET Computers & Digital Techniques

Self Cite

View full text Add to dashboard Cite

Network contention is seen as a major hurdle to achieve higher throughput in today's large-scale high-performance computing systems. Even more so with the current trend of employing blocking networks driven by the need of reducing cost. Additionally, the effect is aggravated by current system schedulers that allocate jobs as soon as nodes become available, thus producing job fragmentation, that is, the tasks of one job might be spread throughout the system instead of being allocated contiguously. This fragmentation increases the probability of sharing network resources with other applications, which produces higher inter-application network contention. In this study, the authors perform a broad analysis of diverse applications' performance variability because of the topology connectivity and fragmentation and a classification of applications based on their sensitiveness to these two factors. Once they understood the inherent characteristics of applications, the authors analysed the applications performance in a shared environment, that is, when mixing with other applications. They show that inter-application contention might be a significant factor of degradation even in the networks with high connectivity. Their results suggest different strategies on task allocation policies: grouping sensitive and insensitive applications, reducing the number of applications sharing the first level switch or isolation of sensitive applications.

show abstract

“…Consequently, efficient execution of parallel applications in such environments needs more deliberations of them. In doing so, there are a lot of studies including [2][3][4][5][6] which provide insights into the conditions in which efficient performance of multi-core clustered systems can be gained.…”

Section: Introductionmentioning

confidence: 99%

A Novel Process Mapping Strategy in Clustered Environments

Soryani

Analoui

Zarrinchian

2012

IJGCA

View full text Add to dashboard Cite

Nowadays the number of available processing cores within computing nodes which are used in recent clustered environments, are growing up with a rapid rate. Despite this trend, the number of available network interfaces in such computing nodes has almost been remained unchanged. This issue can lead to high usage of network interface in many workloads, especially in heavy-communicating workloads. As a result, network interface may raise as a performance bottleneck and can drastically degrade the performance. The goal of this paper is to introduce a new process mapping strategy in multi-core clusters aimed at reducing network interface contention and improving inter-node communication performance of parallel applications. Performance evaluation of the new mapping algorithm in synthetic and real workloads indicates that the new strategy can achieve 5% to 90% performance improvement in heavy communicating workloads, compared to other well-known methods.

show abstract

Impact of Inter-application Contention in Current and Future HPC Systems

Cited by 16 publications

References 16 publications

Links as a Service (LaaS): Guaranteed Tenant Isolation in the Shared Cloud

Links as a Service (LaaS): Guaranteed Tenant Isolation in the Shared Cloud

On the trade‐off of mixing scientific applications on capacity high‐performance computing systems

A Novel Process Mapping Strategy in Clustered Environments

Contact Info

Product

Resources

About